-- Logs begin at Mon 2022-07-25 15:27:10 UTC, end at Mon 2022-07-25 16:38:59 UTC. -- Jul 25 16:03:46.225640 dv-cinder-836973-15-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 16:03:46.237486 dv-cinder-836973-15-smb devstack@keystone.service[80357]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 16:03:46.238133 dv-cinder-836973-15-smb devstack@keystone.service[80357]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 16:03:46 2022] *** Jul 25 16:03:46.238133 dv-cinder-836973-15-smb devstack@keystone.service[80357]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 16:03:46.238133 dv-cinder-836973-15-smb devstack@keystone.service[80357]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 16:03:46.238133 dv-cinder-836973-15-smb devstack@keystone.service[80357]: nodename: dv-cinder-836973-15-smb Jul 25 16:03:46.238133 dv-cinder-836973-15-smb devstack@keystone.service[80357]: machine: x86_64 Jul 25 16:03:46.238133 dv-cinder-836973-15-smb devstack@keystone.service[80357]: clock source: unix Jul 25 16:03:46.238133 dv-cinder-836973-15-smb devstack@keystone.service[80357]: pcre jit disabled Jul 25 16:03:46.238133 dv-cinder-836973-15-smb devstack@keystone.service[80357]: detected number of CPU cores: 4 Jul 25 16:03:46.238133 dv-cinder-836973-15-smb devstack@keystone.service[80357]: current working directory: / Jul 25 16:03:46.238133 dv-cinder-836973-15-smb devstack@keystone.service[80357]: detected binary path: /usr/bin/uwsgi-core Jul 25 16:03:46.238133 dv-cinder-836973-15-smb devstack@keystone.service[80357]: your processes number limit is 47680 Jul 25 16:03:46.238713 dv-cinder-836973-15-smb devstack@keystone.service[80357]: your memory page size is 4096 bytes Jul 25 16:03:46.238713 dv-cinder-836973-15-smb devstack@keystone.service[80357]: detected max file descriptor number: 2048 Jul 25 16:03:46.238713 dv-cinder-836973-15-smb devstack@keystone.service[80357]: lock engine: pthread robust mutexes Jul 25 16:03:46.238713 dv-cinder-836973-15-smb devstack@keystone.service[80357]: thunder lock: enabled Jul 25 16:03:46.238713 dv-cinder-836973-15-smb devstack@keystone.service[80357]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 16:03:46.238962 dv-cinder-836973-15-smb devstack@keystone.service[80357]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 16:03:46.278813 dv-cinder-836973-15-smb devstack@keystone.service[80357]: Python main interpreter initialized at 0x556db1d9d9c0 Jul 25 16:03:46.278813 dv-cinder-836973-15-smb devstack@keystone.service[80357]: python threads support enabled Jul 25 16:03:46.278813 dv-cinder-836973-15-smb devstack@keystone.service[80357]: your server socket listen backlog is limited to 100 connections Jul 25 16:03:46.278813 dv-cinder-836973-15-smb devstack@keystone.service[80357]: your mercy for graceful operations on workers is 90 seconds Jul 25 16:03:46.279188 dv-cinder-836973-15-smb devstack@keystone.service[80357]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 16:03:46.279263 dv-cinder-836973-15-smb devstack@keystone.service[80357]: *** Operational MODE: preforking *** Jul 25 16:03:46.279526 dv-cinder-836973-15-smb devstack@keystone.service[80357]: *** uWSGI is running in multiple interpreter mode *** Jul 25 16:03:46.279526 dv-cinder-836973-15-smb devstack@keystone.service[80357]: spawned uWSGI master process (pid: 80357) Jul 25 16:03:46.279734 dv-cinder-836973-15-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 25 16:03:46.280539 dv-cinder-836973-15-smb devstack@keystone.service[80357]: spawned uWSGI worker 1 (pid: 80365, cores: 1) Jul 25 16:03:46.280644 dv-cinder-836973-15-smb devstack@keystone.service[80357]: spawned uWSGI worker 2 (pid: 80366, cores: 1) Jul 25 16:03:46.284412 dv-cinder-836973-15-smb devstack@keystone.service[80357]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 16:03:51.841930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 16:03:51.841930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: from cryptography.utils import int_from_bytes Jul 25 16:03:51.843181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 16:03:51.843181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: from cryptography.utils import int_from_bytes Jul 25 16:03:51.843916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 16:03:51.843916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: from cryptography.utils import int_from_bytes Jul 25 16:03:51.844120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 16:03:51.844120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: from cryptography.utils import int_from_bytes Jul 25 16:03:51.894512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 16:03:51.894743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 16:03:51.894861 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 16:03:51.895018 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] command line args: [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 16:03:51.895157 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 16:03:51.895157 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] command line args: [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 16:03:51.895390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 16:03:51.895390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ================================================================================ {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 16:03:51.895605 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 16:03:51.895605 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ================================================================================ {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 16:03:51.896355 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] admin_token = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.896487 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] admin_token = **** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.896610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] config_dir = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.896610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.896819 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] config_dir = [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.896933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] config_source = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.897044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.897169 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] debug = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.897345 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] config_source = [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.897501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.897825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] debug = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.897825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.898163 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.898310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.898455 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.898651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.898818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.898977 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.899131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.899274 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.899473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.899766 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] list_limit = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.899941 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] log_config_append = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.900102 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] log_config_append = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.900303 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.900471 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.900471 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] log_dir = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.900763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] log_dir = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.900891 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] log_file = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.901065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] log_file = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.901182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.901345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.901345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.901855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.901855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.902136 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.902259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.902435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.902599 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.902774 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.902969 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.903095 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.903211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.903329 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.903448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.903576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.903749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.903865 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.903987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.904107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.904295 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.904424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.904532 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.904644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.904807 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.904933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.905051 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.905173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.905344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.905459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.905568 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.905688 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.905886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] publish_errors = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.906060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] publish_errors = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.906173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.906295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.906408 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.906526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.906643 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.906820 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.906944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.907082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.907213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.907332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.907444 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] standard_threads = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.907563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] standard_threads = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.907743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.907864 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.907980 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.908104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.908215 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.908489 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.908643 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] use_journal = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.908776 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] use_journal = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.908907 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] use_json = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.909011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] use_json = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.909123 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] use_stderr = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.909234 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] use_stderr = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.909363 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] use_syslog = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.909473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] use_syslog = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.909589 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.909709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:03:51.909834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.909952 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.910069 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.910188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.910302 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.910417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.910532 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.910652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.910761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.910876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.910982 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.911102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.911213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.911332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.911521 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.912210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.912345 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.912510 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.912637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.912758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.912874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.912982 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.913097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.913206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.913313 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.913431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.913551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.913665 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.913780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.913902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.914023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.914023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.914338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.914338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.914544 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.914664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.914779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.914779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.914998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.915106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.915212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.915328 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.915436 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.915436 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.915657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.915769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.915895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.916010 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.916129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.916303 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.916418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.916541 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.916655 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.916763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.916873 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.916994 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.917104 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.917214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.917319 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.917423 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.917548 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.917668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.917793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.917793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.917992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.917992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.918200 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.918200 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.918418 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.918528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.918644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.918761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.918886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.919002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.919138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.919253 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.919370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.919490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.919710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.919864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.919977 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.920085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.920212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.920342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.920459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.920597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.920869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.921013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.921114 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.921223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.921443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.921561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.921672 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.921787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.921897 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.922003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.922120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.922234 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.922351 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.922463 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.922570 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.922677 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.922837 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.922980 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.923117 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.923260 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.923414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.923612 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.923793 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.923948 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.924108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.924289 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.924409 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.924522 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.924654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.924772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.924886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.925009 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.925122 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.925237 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.925359 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.925479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.925599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.925723 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.925855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.925855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.926135 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.926252 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.926415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.926530 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.926691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.926805 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.927058 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.927191 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.927310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.927482 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.927598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.927766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.927881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.928043 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.928171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.928362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.928499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.928675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.928848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.928848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.929133 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.929255 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.929367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.929367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.929573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.929573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.929795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.930007 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.930160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.930278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.930530 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.930673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.930790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.930906 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.931019 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.931130 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.931252 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.931383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.931507 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.931622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.931737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.931848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.932023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.932153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.932292 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.932408 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.932523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.932523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.932727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.932959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.933077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.933191 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.933305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.933418 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.933531 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.933655 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.933790 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.933790 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.934019 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.934118 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.934287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.934405 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.934517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.934691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.934813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.934925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.935031 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.935489 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.935614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.935746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.935861 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.935976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.936090 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.936212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.936362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.936497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.936614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.936723 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.936830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.936944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.937067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.937197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] auth.external = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.937197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.937407 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.937407 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.external = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.937614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.937746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.937898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.937898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] auth.password = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.938134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.938248 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] auth.token = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.938357 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.938470 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.938581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.password = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.938709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.938824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.token = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.938937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.939046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.939159 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.939270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.939393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.939522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.939635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.939747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.939858 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.939968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.940097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] credential.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.940211 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.940449 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.940562 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.940672 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.940783 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.940909 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.941032 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.941146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.941266 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.941377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.941490 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.941609 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.941726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.941840 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.941956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.942067 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.942188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.942324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.942443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.942557 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.943163 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.943283 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.943384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.943493 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.943616 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.943732 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.943845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.943958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.944069 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.944191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.944324 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.944442 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] federation.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.944556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.944669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.944782 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.944917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.945031 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.945144 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.945259 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.945373 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.945489 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.945612 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.945729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.945845 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.945959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.946066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.946178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.946308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.946426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.946539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.946539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.946726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.946837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.946961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.947074 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.947186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.947295 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.947419 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.947539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.947772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.947893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.948004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.948117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.948229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.948392 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.948527 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.948642 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.948754 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.948868 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.948982 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.949106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.949218 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.949329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.949449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.949562 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.949675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.949802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.949922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.950051 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.950172 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.950279 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.950446 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.950862 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.951056 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.951170 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.951302 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.951401 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.951504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.951632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.951748 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.951864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.951985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.952106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.952225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.952451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.952583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.952700 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.952816 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.952930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.953034 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.953158 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.953280 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.953396 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.953509 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.953623 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.953740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.953869 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.953983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.954103 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.954227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.954341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.954455 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.954581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.954696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.954810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.954924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.955035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.955147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.955272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.955386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.955508 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.955628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.955745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.955861 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.955985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.955985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.956202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.956350 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.956469 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.956591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.956742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.956742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.956742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.956742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.956742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.957033 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.957101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.957189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.957259 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.957326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.957405 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.957479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.957560 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.957640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.957728 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.957810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.957882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.957952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.958033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.958107 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.958204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.958389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.958475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.958548 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.958624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.958698 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.958759 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.958817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.958876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.958934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.959000 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.959061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.959120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.959179 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.959179 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.959290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.959357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.959430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.959554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.959687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.959818 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.959961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.960093 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.960224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.960487 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.960617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.960763 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.960908 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.961041 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.961174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.961398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.961534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.961669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.961829 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.962002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.962159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.962159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.962401 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.962532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.962677 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.962808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.962952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.962952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.963199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.963332 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.963434 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.963434 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.963711 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.963846 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.963978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.964112 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.964284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.964284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.964644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.964777 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.964909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.965041 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.965192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.965325 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.965473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.965610 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.965744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.965882 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.966017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.966137 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.966273 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.966410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.966549 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.966681 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.966824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.966964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.967095 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.967223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.967352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.967486 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.967628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.967759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.967887 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.968018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.968148 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.968409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.968561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.968693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] resource.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.968823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.968956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.969088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.969218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.969363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.969495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.969625 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.969758 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.969900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.970035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.970180 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.970314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.970446 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.970578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.970578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.970819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.971063 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.971198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.971332 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] role.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.971478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.971615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] role.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.971747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.971894 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.972031 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] role.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.972165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.972324 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] role.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.972453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.972586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.972731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.972863 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.972994 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.973125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.973259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.973392 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.973536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.973670 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.973804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.974479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.974614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.974760 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.974893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.975026 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.975159 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.975288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.975417 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.975563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.975699 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.975831 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.975961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.976090 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.976090 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.976399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.976534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.976669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.976669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.976871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.976946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.977024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.977150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.977280 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.977411 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.977570 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.977689 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.977864 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.977998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.978132 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.978266 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.978397 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.978530 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.978678 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.978810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.978941 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.979073 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.979205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.979337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.979485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.979623 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.979753 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.979851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.979986 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.980131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.980305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.980438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.980563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.980690 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.980818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.980967 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.981101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.981235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] token.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.981364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.981481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.981600 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.981734 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.981872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] token.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.982003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.982192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.982324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.982453 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.982623 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.982757 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.982886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.983017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.983147 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.983278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.983420 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.983553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.983685 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.983877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.984012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.984145 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.984378 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.984517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.984654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.984787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.984918 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.985047 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.985192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.985323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.985456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.985587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.985719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.985849 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.985993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.986129 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.986263 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.connection = **** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.986387 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.986502 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.986586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.986648 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.986648 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.986761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.connection = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.986830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.986899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.986960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987019 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987135 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987200 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987262 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987320 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987379 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987678 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987736 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.987978 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.988037 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.988095 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.988160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.988221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.988316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.988380 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.988440 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.988499 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.988558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.988616 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.988683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 16:03:51.988745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.988745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.988745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:03:51.988745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 16:03:52.013628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.013937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.014036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.014220 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.014349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.014484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.023217 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.023464 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.054957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.055257 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.055397 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.055552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.109401 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.109654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.162571 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.162870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.163035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.163169 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.230535 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.230535 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.230797 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.231726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.231828 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.231898 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.231960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.232031 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.232103 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.232183 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.232277 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.232277 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.256039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.256242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.256350 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.256470 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.256622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.256711 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.256790 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.256912 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.256998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.257126 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.257209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.257338 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.257431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.257554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.268798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.269336 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.282098 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.282334 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.282423 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.282549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.282662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.282772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.282894 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.283017 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.283140 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.283264 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.283381 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.283502 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80366) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.283639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.283759 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 16:03:52.301549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.301737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.301823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 16:03:52.301922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 16:03:52.302721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.302839 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.302917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 16:03:52.302991 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 16:03:52.303169 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.303262 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.303421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.303503 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.303668 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.303749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.303918 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.304000 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.314810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.314930 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.315083 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.315166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.315341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.315425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.315615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.315697 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.324129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.324304 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.327437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.327561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.327711 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.327799 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.327993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.328079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.328293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.328379 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.328576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.328659 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.328833 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.328918 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.329100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.329183 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.329369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.329459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.329632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.329715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.329897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.329978 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.330159 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.330243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.359744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.359910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.361328 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.361420 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.361605 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.361690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.366929 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.367030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.367324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.367422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.367606 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.367687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.374907 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.375011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.375189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.375271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.380058 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.380171 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.380236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.380320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.380413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.380489 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.380591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.380778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.380859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.381065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.381147 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.381342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.381423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.381611 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.381704 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.381877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.400855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.401145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.401888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.402186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.405933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.406926 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.409616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.410022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.410622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.411037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.415696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.416693 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.419343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.420363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.422999 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.423291 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.423568 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.423851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.424027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.424476 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.424565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.424640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.424715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.424910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.425192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.425482 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.443786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.444072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.444359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.444618 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.444899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.445201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.445473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.445738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.453324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.453703 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.455023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.455293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.455498 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.455775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.459238 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.459536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.459707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.459820 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.460109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.460225 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.460405 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.460689 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.460841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.461181 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.476975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.477182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.477352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.477547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.477686 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.477831 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.478014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.478113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.478316 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.478475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.478609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.478754 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.478873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.479025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.496986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.497166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.500239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.500385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.503562 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.503663 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.505422 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.505555 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.507080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.507237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.507355 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.507520 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.507618 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.507806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.514942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.515335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.516575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.516983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.519780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.520065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.520220 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.520482 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.520565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.521334 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.521427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.521720 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.530719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.531004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.531144 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.531281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.531475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.531724 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.539778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80366) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.540054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.540228 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 16:03:52.540387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.540542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.540624 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.540825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.541039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.541540 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.541635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.541741 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.541817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.541817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.541963 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.542160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.542254 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.542380 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.542459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.542531 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.542603 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.542772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.542863 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.543049 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.543130 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.543307 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80366) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.543388 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.543605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.543871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 16:03:52.581309 dv-cinder-836973-15-smb devstack@keystone.service[80366]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556db1d9d9c0 pid: 80366 (default app) Jul 25 16:03:52.582524 dv-cinder-836973-15-smb devstack@keystone.service[80365]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556db1d9d9c0 pid: 80365 (default app) Jul 25 16:03:52.585360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b5390-33ab-4a8a-a903-5a95f1bfad28 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:03:52.585651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b5390-33ab-4a8a-a903-5a95f1bfad28 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:03:52.585925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b5390-33ab-4a8a-a903-5a95f1bfad28 None None] PATH_INFO: `/v3` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:03:52.590148 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 791 bytes} [Mon Jul 25 16:03:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:00.359338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e99693-9f3f-4b98-8a46-0ac502252808 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:00.359904 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e99693-9f3f-4b98-8a46-0ac502252808 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:00.359904 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e99693-9f3f-4b98-8a46-0ac502252808 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:00.364244 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:00.370558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e4819-216d-4dfe-8776-d99d6dee2725 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:00.371038 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e4819-216d-4dfe-8776-d99d6dee2725 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:00.371128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e4819-216d-4dfe-8776-d99d6dee2725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:00.442839 dv-cinder-836973-15-smb devstack@keystone.service[80366]: INFO dbcounter [None req-aa7e4819-216d-4dfe-8776-d99d6dee2725 None None] Registered counter for database keystone Jul 25 16:04:00.464135 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG oslo_db.sqlalchemy.engines [None req-aa7e4819-216d-4dfe-8776-d99d6dee2725 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:04:00.470441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writer thread running {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:04:00.653815 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG passlib.handlers.bcrypt [None req-aa7e4819-216d-4dfe-8776-d99d6dee2725 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80366) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 16:04:00.654158 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG passlib.handlers.bcrypt [None req-aa7e4819-216d-4dfe-8776-d99d6dee2725 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80366) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 16:04:00.709556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-aa7e4819-216d-4dfe-8776-d99d6dee2725 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:00.711247 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-aa7e4819-216d-4dfe-8776-d99d6dee2725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:00.850816 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 16:04:00.980085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e99693-9f3f-4b98-8a46-0ac502252808 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:01.054268 dv-cinder-836973-15-smb devstack@keystone.service[80365]: INFO dbcounter [None req-f6e99693-9f3f-4b98-8a46-0ac502252808 None None] Registered counter for database keystone Jul 25 16:04:01.075247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG oslo_db.sqlalchemy.engines [None req-f6e99693-9f3f-4b98-8a46-0ac502252808 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:04:01.082243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writer thread running {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:04:01.208899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e99693-9f3f-4b98-8a46-0ac502252808 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:01.213262 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a178abf-270e-4c85-822e-9620c38a250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:01.213994 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a178abf-270e-4c85-822e-9620c38a250c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:01.214277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a178abf-270e-4c85-822e-9620c38a250c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:01.214557 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a178abf-270e-4c85-822e-9620c38a250c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:01.223582 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a178abf-270e-4c85-822e-9620c38a250c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:01.275643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6a178abf-270e-4c85-822e-9620c38a250c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 16:04:01.275840 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a178abf-270e-4c85-822e-9620c38a250c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:01.295862 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1324 bytes} [Mon Jul 25 16:04:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 16:04:01.302264 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e4819-216d-4dfe-8776-d99d6dee2725 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:01.317021 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e4819-216d-4dfe-8776-d99d6dee2725 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:01.322903 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64c2db-e6e4-4acc-a20d-78b1771d881a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:01.324053 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64c2db-e6e4-4acc-a20d-78b1771d881a admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:01.324376 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64c2db-e6e4-4acc-a20d-78b1771d881a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:01.324660 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64c2db-e6e4-4acc-a20d-78b1771d881a admin admin] PATH_INFO: `/v3/projects/b95a5c35a0f44e44aca71af300d042a5` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:01.326218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64c2db-e6e4-4acc-a20d-78b1771d881a admin admin] RBAC: Authorizing `identity:get_project(project_id=b95a5c35a0f44e44aca71af300d042a5)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:01.380888 dv-cinder-836973-15-smb devstack@keystone.service[80366]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ca64c2db-e6e4-4acc-a20d-78b1771d881a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 16:04:01.381539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64c2db-e6e4-4acc-a20d-78b1771d881a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:01.386017 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 3/5] 10.222.0.70 () {56 vars in 1207 bytes} [Mon Jul 25 16:04:01 2022] GET /identity/v3/projects/b95a5c35a0f44e44aca71af300d042a5 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:03.418560 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494422ed-3a9b-494b-a8c2-ebc02c6ea062 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:03.419098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494422ed-3a9b-494b-a8c2-ebc02c6ea062 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:03.419098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494422ed-3a9b-494b-a8c2-ebc02c6ea062 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:03.423270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 3/6] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:03.431627 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216a477-c6a3-4ea8-99ae-755b419ff841 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:03.432132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216a477-c6a3-4ea8-99ae-755b419ff841 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:03.432217 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216a477-c6a3-4ea8-99ae-755b419ff841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:03.453622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8216a477-c6a3-4ea8-99ae-755b419ff841 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:03.455190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8216a477-c6a3-4ea8-99ae-755b419ff841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:03.464457 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 16:04:03.486895 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494422ed-3a9b-494b-a8c2-ebc02c6ea062 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:03.500624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494422ed-3a9b-494b-a8c2-ebc02c6ea062 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:03.505626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30798a79-8920-4aa6-a02f-2b36bf91dc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:03.506326 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30798a79-8920-4aa6-a02f-2b36bf91dc23 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:03.506610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30798a79-8920-4aa6-a02f-2b36bf91dc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:03.506885 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30798a79-8920-4aa6-a02f-2b36bf91dc23 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:03.517236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30798a79-8920-4aa6-a02f-2b36bf91dc23 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:03.519275 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30798a79-8920-4aa6-a02f-2b36bf91dc23 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:03.530494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1324 bytes} [Mon Jul 25 16:04:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 16:04:03.536384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216a477-c6a3-4ea8-99ae-755b419ff841 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:03.545732 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216a477-c6a3-4ea8-99ae-755b419ff841 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:03.550590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5ffe9-bdaa-4a71-a3ab-e28a6e3d6734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:03.552106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5ffe9-bdaa-4a71-a3ab-e28a6e3d6734 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:03.552106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5ffe9-bdaa-4a71-a3ab-e28a6e3d6734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:03.552106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5ffe9-bdaa-4a71-a3ab-e28a6e3d6734 admin admin] PATH_INFO: `/v3/users/39c896452be844fc919b8104a7db12a5` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:03.553454 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5ffe9-bdaa-4a71-a3ab-e28a6e3d6734 admin admin] RBAC: Authorizing `identity:get_user(user_id=39c896452be844fc919b8104a7db12a5)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:03.555327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5ffe9-bdaa-4a71-a3ab-e28a6e3d6734 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:03.558146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 5/9] 10.222.0.70 () {56 vars in 1198 bytes} [Mon Jul 25 16:04:03 2022] GET /identity/v3/users/39c896452be844fc919b8104a7db12a5 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:05.662968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085466e-f965-45ec-8042-f18b47c78a02 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:05.663458 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085466e-f965-45ec-8042-f18b47c78a02 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:05.663458 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085466e-f965-45ec-8042-f18b47c78a02 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:05.664870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:05.670203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1585d-1eda-4122-834f-1825a30aba0a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:05.670669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1585d-1eda-4122-834f-1825a30aba0a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:05.670905 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1585d-1eda-4122-834f-1825a30aba0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:05.689339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-aea1585d-1eda-4122-834f-1825a30aba0a None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:05.690552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-aea1585d-1eda-4122-834f-1825a30aba0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:05.745883 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b2f29-d4fd-4300-b951-f12781678ab6 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:05.746541 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b2f29-d4fd-4300-b951-f12781678ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:05.746541 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b2f29-d4fd-4300-b951-f12781678ab6 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:05.747853 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 6/11] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:04:05.754541 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bb467-de68-4f23-8adb-53f62772686e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:05.755597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bb467-de68-4f23-8adb-53f62772686e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:05.756024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bb467-de68-4f23-8adb-53f62772686e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:05.785722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 6/12] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:05.808223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1585d-1eda-4122-834f-1825a30aba0a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:05.811868 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG passlib.handlers.bcrypt [None req-6d5bb467-de68-4f23-8adb-53f62772686e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80365) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 16:04:05.812330 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG passlib.handlers.bcrypt [None req-6d5bb467-de68-4f23-8adb-53f62772686e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80365) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 16:04:05.831807 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:05.858518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6d5bb467-de68-4f23-8adb-53f62772686e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:05.860127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6d5bb467-de68-4f23-8adb-53f62772686e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:05.911768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1585d-1eda-4122-834f-1825a30aba0a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:05.948647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965552aa-4da9-4e65-9e48-29aa469f5def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:05.949807 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965552aa-4da9-4e65-9e48-29aa469f5def None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:05.950182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965552aa-4da9-4e65-9e48-29aa469f5def None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:05.950553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965552aa-4da9-4e65-9e48-29aa469f5def None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:05.963100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965552aa-4da9-4e65-9e48-29aa469f5def None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:05.964281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 7/13] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:05.974993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-965552aa-4da9-4e65-9e48-29aa469f5def None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:05.974993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:05.974993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:05.974993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:05.974993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:05.974993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:05.974993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:05.974993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:05.974993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:05.974993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:05.974993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:05.974993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:05.974993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:05.974993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:05.974993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:05.974993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:05.976061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:05.976061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:05.976061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:05.976061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:05.976061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:05.976061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:05.976061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:05.976061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:05.976061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:05.976061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:05.976061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:05.976061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:05.976061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:05.976061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:05.976061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:05.976061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:05.977042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:05.977042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:05.977042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:05.977042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:05.977042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:05.977042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:05.977042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:05.977042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:05.977042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:05.977042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:05.977042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:05.977042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:05.977042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 7/14] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:04:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:04:05.981826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bb467-de68-4f23-8adb-53f62772686e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:05.986031 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965552aa-4da9-4e65-9e48-29aa469f5def None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:06.100522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bb467-de68-4f23-8adb-53f62772686e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:06.101319 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:06.103274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:06.125581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965552aa-4da9-4e65-9e48-29aa469f5def None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:06.145200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f3439-b457-469f-a986-76e5a517aa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:06.146200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f3439-b457-469f-a986-76e5a517aa7e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:06.146501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f3439-b457-469f-a986-76e5a517aa7e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:06.146784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f3439-b457-469f-a986-76e5a517aa7e None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:06.147720 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f3439-b457-469f-a986-76e5a517aa7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:06.148033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f3439-b457-469f-a986-76e5a517aa7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:06.149519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f3439-b457-469f-a986-76e5a517aa7e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:06.160661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fcc16-9204-4e88-a517-4bd32918a081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:06.161360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fcc16-9204-4e88-a517-4bd32918a081 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:06.161637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fcc16-9204-4e88-a517-4bd32918a081 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:06.162163 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fcc16-9204-4e88-a517-4bd32918a081 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:06.162277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 8/15] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:06.168410 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f3439-b457-469f-a986-76e5a517aa7e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:06.246235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fcc16-9204-4e88-a517-4bd32918a081 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:06.247552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fcc16-9204-4e88-a517-4bd32918a081 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:06.277989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f3439-b457-469f-a986-76e5a517aa7e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:06.314928 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afb202-f506-472c-8afb-5f91c2ebb3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:06.315823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afb202-f506-472c-8afb-5f91c2ebb3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:06.316108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afb202-f506-472c-8afb-5f91c2ebb3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:06.316416 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afb202-f506-472c-8afb-5f91c2ebb3e8 None admin] PATH_INFO: `/v3/users/39c896452be844fc919b8104a7db12a5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:06.318057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afb202-f506-472c-8afb-5f91c2ebb3e8 None admin] RBAC: Authorizing `identity:get_user(user_id=39c896452be844fc919b8104a7db12a5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:06.319552 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afb202-f506-472c-8afb-5f91c2ebb3e8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:06.321293 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 9/16] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:06 2022] GET /identity/v3/users/39c896452be844fc919b8104a7db12a5 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:06.326793 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afb202-f506-472c-8afb-5f91c2ebb3e8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:06.342980 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:06.364696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 8/17] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 16:04:06.370448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fcc16-9204-4e88-a517-4bd32918a081 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:06.372342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:06.444974 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afb202-f506-472c-8afb-5f91c2ebb3e8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:06.476760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fcc16-9204-4e88-a517-4bd32918a081 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:06.482028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115f4c9-59c2-45a5-aeb2-8c5268d8789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:06.482799 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115f4c9-59c2-45a5-aeb2-8c5268d8789e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:06.483051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115f4c9-59c2-45a5-aeb2-8c5268d8789e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:06.483324 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115f4c9-59c2-45a5-aeb2-8c5268d8789e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:06.484623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115f4c9-59c2-45a5-aeb2-8c5268d8789e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:06.486093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115f4c9-59c2-45a5-aeb2-8c5268d8789e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:06.487737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 10/18] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:06.495514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115f4c9-59c2-45a5-aeb2-8c5268d8789e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:06.513917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150530a4-51b5-4cdf-9415-66941e4c8f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:06.515126 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150530a4-51b5-4cdf-9415-66941e4c8f2a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:06.515126 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150530a4-51b5-4cdf-9415-66941e4c8f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:06.515331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150530a4-51b5-4cdf-9415-66941e4c8f2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:06.526352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150530a4-51b5-4cdf-9415-66941e4c8f2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:06.528124 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150530a4-51b5-4cdf-9415-66941e4c8f2a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:06.550823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-150530a4-51b5-4cdf-9415-66941e4c8f2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:04:06.550823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:06.550823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:06.550823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:06.550823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:06.550823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:06.550823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:06.550823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:06.550823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:06.550823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:06.550823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:06.550823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:06.550823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:04:06.550823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:04:06.550823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:06.552452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:06.553297 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:04:06.553297 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:04:06.553297 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:04:06.553297 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:06.553297 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 9/19] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:04:06.559523 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150530a4-51b5-4cdf-9415-66941e4c8f2a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:06.595810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:06.605098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115f4c9-59c2-45a5-aeb2-8c5268d8789e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:06.606732 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:06.643497 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf53bb2-7445-4302-9636-95ea968109d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:06.644188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf53bb2-7445-4302-9636-95ea968109d9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:06.644512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf53bb2-7445-4302-9636-95ea968109d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:06.644787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf53bb2-7445-4302-9636-95ea968109d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:06.646249 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf53bb2-7445-4302-9636-95ea968109d9 None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.domain.id=default, user.id=39c896452be844fc919b8104a7db12a5) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:06.646559 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf53bb2-7445-4302-9636-95ea968109d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:06.648105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf53bb2-7445-4302-9636-95ea968109d9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:06.658958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 11/20] 10.222.0.70 () {56 vars in 1322 bytes} [Mon Jul 25 16:04:06 2022] GET /identity/v3/role_assignments?user.id=39c896452be844fc919b8104a7db12a5&scope.domain.id=default&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 233 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:06.777589 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150530a4-51b5-4cdf-9415-66941e4c8f2a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:06.815817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e18fa1-22f2-4acb-ac78-59a6044fe830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:06.816527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18fa1-22f2-4acb-ac78-59a6044fe830 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:06.816823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18fa1-22f2-4acb-ac78-59a6044fe830 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:06.817127 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18fa1-22f2-4acb-ac78-59a6044fe830 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:06.821253 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e18fa1-22f2-4acb-ac78-59a6044fe830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:06.821253 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e18fa1-22f2-4acb-ac78-59a6044fe830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:06.823193 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e18fa1-22f2-4acb-ac78-59a6044fe830 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:06.849835 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 10/21] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:09.034136 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54016ad-28c8-411c-8532-b69348294dad None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:09.034668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54016ad-28c8-411c-8532-b69348294dad None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:09.034860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54016ad-28c8-411c-8532-b69348294dad None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:09.036579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 12/22] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:09.042048 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ab444-47ab-46b3-9064-c7671f20c447 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:09.042529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ab444-47ab-46b3-9064-c7671f20c447 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:09.042601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ab444-47ab-46b3-9064-c7671f20c447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:09.065520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-bd4ab444-47ab-46b3-9064-c7671f20c447 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:09.066738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bd4ab444-47ab-46b3-9064-c7671f20c447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:09.159763 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 11/23] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:09.194960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54016ad-28c8-411c-8532-b69348294dad None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:09.377990 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54016ad-28c8-411c-8532-b69348294dad None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:09.437614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d341d-7652-4c17-9efc-38e5b6e832cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:09.438442 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d341d-7652-4c17-9efc-38e5b6e832cd None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:09.438726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d341d-7652-4c17-9efc-38e5b6e832cd None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:09.439005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d341d-7652-4c17-9efc-38e5b6e832cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:09.460045 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d341d-7652-4c17-9efc-38e5b6e832cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:09.476554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-8e1d341d-7652-4c17-9efc-38e5b6e832cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:09.476554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:09.476554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:09.476554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:09.476554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:09.476554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:09.476554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:09.476554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:09.476554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:09.476554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:09.476554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:09.476554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:09.476554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:09.476554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:09.476554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:09.476554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:09.477466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:09.477466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:09.477466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:09.477466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:09.477466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:09.477466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:09.477466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:09.477466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:09.477466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:09.477466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:09.477466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:09.477466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:09.477466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:09.477466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:09.477466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:09.477466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:09.478263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:09.478263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:09.478263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:09.478263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:09.478263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:09.478263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:09.478263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:09.478263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:09.478263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:09.478263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:09.478263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:09.478263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:09.478263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 13/24] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:04:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:09.489592 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ab444-47ab-46b3-9064-c7671f20c447 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:09.518860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:09.608787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ab444-47ab-46b3-9064-c7671f20c447 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:09.609001 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96e1b2-d168-4d32-9e38-cff9fa362cb5 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:09.609502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96e1b2-d168-4d32-9e38-cff9fa362cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:09.609957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96e1b2-d168-4d32-9e38-cff9fa362cb5 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:09.611949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 14/25] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:09.621854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bdcef-1d2d-47cb-8c91-b4c38a05680b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:09.622457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bdcef-1d2d-47cb-8c91-b4c38a05680b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:09.622939 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bdcef-1d2d-47cb-8c91-b4c38a05680b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:09.663219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195452e-7b44-4245-84a4-08bab51cab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:09.664284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195452e-7b44-4245-84a4-08bab51cab17 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:09.664792 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195452e-7b44-4245-84a4-08bab51cab17 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:09.665273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195452e-7b44-4245-84a4-08bab51cab17 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:09.665467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c39bdcef-1d2d-47cb-8c91-b4c38a05680b None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:09.666269 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195452e-7b44-4245-84a4-08bab51cab17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:09.666590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195452e-7b44-4245-84a4-08bab51cab17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:09.667582 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c39bdcef-1d2d-47cb-8c91-b4c38a05680b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:09.668074 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195452e-7b44-4245-84a4-08bab51cab17 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:09.692494 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 12/26] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:09.693832 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:09.699739 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195452e-7b44-4245-84a4-08bab51cab17 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:09.757752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 15/27] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:09.791648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaa584-aa87-4a95-96df-a0cfbc807b59 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:09.792590 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaa584-aa87-4a95-96df-a0cfbc807b59 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:09.793433 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaa584-aa87-4a95-96df-a0cfbc807b59 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:09.796225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 16/28] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:04:09.803418 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362623aa-beb8-4044-aa1a-e6b3d5b3082d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:09.804272 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362623aa-beb8-4044-aa1a-e6b3d5b3082d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:09.805053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362623aa-beb8-4044-aa1a-e6b3d5b3082d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:09.843245 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-362623aa-beb8-4044-aa1a-e6b3d5b3082d None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:09.844509 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-362623aa-beb8-4044-aa1a-e6b3d5b3082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:09.871831 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:09.892769 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195452e-7b44-4245-84a4-08bab51cab17 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:09.942080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f8a78-2a74-4434-ad5b-f1f6b7616457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:09.943355 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f8a78-2a74-4434-ad5b-f1f6b7616457 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:09.943888 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f8a78-2a74-4434-ad5b-f1f6b7616457 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:09.944613 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f8a78-2a74-4434-ad5b-f1f6b7616457 None admin] PATH_INFO: `/v3/users/39c896452be844fc919b8104a7db12a5` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:09.946022 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 17/29] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:09.946661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f8a78-2a74-4434-ad5b-f1f6b7616457 None admin] RBAC: Authorizing `identity:get_user(user_id=39c896452be844fc919b8104a7db12a5)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:09.947011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362623aa-beb8-4044-aa1a-e6b3d5b3082d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:09.948842 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f8a78-2a74-4434-ad5b-f1f6b7616457 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:09.951895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 13/30] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:09 2022] GET /identity/v3/users/39c896452be844fc919b8104a7db12a5 => generated 247 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:09.958130 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e7a6b-d12b-42d1-bf8a-7b7096e92874 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:09.958442 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e7a6b-d12b-42d1-bf8a-7b7096e92874 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:09.958675 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e7a6b-d12b-42d1-bf8a-7b7096e92874 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:09.960141 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 14/31] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:09.961363 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e7a6b-d12b-42d1-bf8a-7b7096e92874 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:10.067961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:10.100745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362623aa-beb8-4044-aa1a-e6b3d5b3082d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:10.120061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e7a6b-d12b-42d1-bf8a-7b7096e92874 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:10.142254 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4569f3e-6d0e-4bb1-a678-146c4fe99bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:10.143495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4569f3e-6d0e-4bb1-a678-146c4fe99bbe None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:10.144062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4569f3e-6d0e-4bb1-a678-146c4fe99bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:10.144577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4569f3e-6d0e-4bb1-a678-146c4fe99bbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:10.167078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4569f3e-6d0e-4bb1-a678-146c4fe99bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:10.168945 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4569f3e-6d0e-4bb1-a678-146c4fe99bbe None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:10.190617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a4569f3e-6d0e-4bb1-a678-146c4fe99bbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:04:10.190617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:10.190617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:10.190617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:10.190617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:10.190617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:10.190617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:10.190617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:10.190617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:10.190617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:10.190617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:10.190617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:10.190617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:04:10.190617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:04:10.190617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:10.191485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:10.192872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:04:10.192872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:04:10.192872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:04:10.192872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:10.193077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52be10b-6a72-46a6-a045-d21f7651d91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:10.193648 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52be10b-6a72-46a6-a045-d21f7651d91b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:10.193853 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52be10b-6a72-46a6-a045-d21f7651d91b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:10.194233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52be10b-6a72-46a6-a045-d21f7651d91b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:10.195546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52be10b-6a72-46a6-a045-d21f7651d91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:10.200862 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52be10b-6a72-46a6-a045-d21f7651d91b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:10.201167 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 18/32] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:10.202177 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 15/33] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:10.203355 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e63ef-657d-4bc5-8747-4edcb3af3dea None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:10.203472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52be10b-6a72-46a6-a045-d21f7651d91b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:10.203979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e63ef-657d-4bc5-8747-4edcb3af3dea None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:10.204486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e63ef-657d-4bc5-8747-4edcb3af3dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:10.235083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3c4e63ef-657d-4bc5-8747-4edcb3af3dea None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:10.236738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3c4e63ef-657d-4bc5-8747-4edcb3af3dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:10.243879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:10.319020 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 19/34] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:10.320550 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e63ef-657d-4bc5-8747-4edcb3af3dea None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:10.334023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52be10b-6a72-46a6-a045-d21f7651d91b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:10.373832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc488e-1b1b-49c9-afa5-0449e2e1e6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:10.374535 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc488e-1b1b-49c9-afa5-0449e2e1e6d3 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:10.374823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc488e-1b1b-49c9-afa5-0449e2e1e6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:10.375104 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc488e-1b1b-49c9-afa5-0449e2e1e6d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:10.375871 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc488e-1b1b-49c9-afa5-0449e2e1e6d3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:10.377392 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc488e-1b1b-49c9-afa5-0449e2e1e6d3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:10.508426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:10.510362 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 16/35] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Jul 25 16:04:10 2022] POST /identity/v3/roles => generated 219 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:04:10.511632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc488e-1b1b-49c9-afa5-0449e2e1e6d3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:10.554464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e63ef-657d-4bc5-8747-4edcb3af3dea None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:10.600017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922139bf-88b6-4664-ac01-a2303033bc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:10.601163 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922139bf-88b6-4664-ac01-a2303033bc2a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:10.601706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922139bf-88b6-4664-ac01-a2303033bc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:10.602188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922139bf-88b6-4664-ac01-a2303033bc2a None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:10.603265 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922139bf-88b6-4664-ac01-a2303033bc2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:10.605570 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922139bf-88b6-4664-ac01-a2303033bc2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:10.607343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922139bf-88b6-4664-ac01-a2303033bc2a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:10.649519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 20/36] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:10.653277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922139bf-88b6-4664-ac01-a2303033bc2a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:10.693100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:10.724015 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc488e-1b1b-49c9-afa5-0449e2e1e6d3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:10.787881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b03565-1325-4985-8a22-54981da596d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:10.788755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b03565-1325-4985-8a22-54981da596d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:10.789039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b03565-1325-4985-8a22-54981da596d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:10.789324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b03565-1325-4985-8a22-54981da596d9 None admin] PATH_INFO: `/v3/domains/default/users/39c896452be844fc919b8104a7db12a5/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:10.791658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b03565-1325-4985-8a22-54981da596d9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=39c896452be844fc919b8104a7db12a5, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:10.793540 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b03565-1325-4985-8a22-54981da596d9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:10.816060 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 17/37] 10.222.0.70 () {58 vars in 1361 bytes} [Mon Jul 25 16:04:10 2022] PUT /identity/v3/domains/default/users/39c896452be844fc919b8104a7db12a5/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:04:10.816060 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b03565-1325-4985-8a22-54981da596d9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:10.839623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922139bf-88b6-4664-ac01-a2303033bc2a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:10.877994 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:10.894214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4230655-486f-4361-9512-9e2f5454006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:10.895499 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4230655-486f-4361-9512-9e2f5454006c None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:10.896895 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4230655-486f-4361-9512-9e2f5454006c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:10.900332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4230655-486f-4361-9512-9e2f5454006c None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:10.900332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4230655-486f-4361-9512-9e2f5454006c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:10.900332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4230655-486f-4361-9512-9e2f5454006c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:10.987770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b03565-1325-4985-8a22-54981da596d9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:11.040597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 21/38] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Jul 25 16:04:10 2022] POST /identity/v3/roles => generated 225 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:04:11.040597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44397b-52ff-48c6-a454-b6a92a2387c1 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:11.040597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44397b-52ff-48c6-a454-b6a92a2387c1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:11.040597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44397b-52ff-48c6-a454-b6a92a2387c1 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:11.040597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 22/39] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:11.040597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130ef7b-8c63-44f3-8388-d9131ee2135e None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:11.040597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130ef7b-8c63-44f3-8388-d9131ee2135e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:11.041144 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130ef7b-8c63-44f3-8388-d9131ee2135e None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:11.041144 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 23/40] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:11.048293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb5384-5cd1-48ad-8ec0-0af3d196444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:11.048293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5384-5cd1-48ad-8ec0-0af3d196444d None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:11.048293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5384-5cd1-48ad-8ec0-0af3d196444d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:11.048293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb5384-5cd1-48ad-8ec0-0af3d196444d None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:11.048824 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb5384-5cd1-48ad-8ec0-0af3d196444d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:11.048824 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb5384-5cd1-48ad-8ec0-0af3d196444d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:11.048947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fbc2d-e7e1-466a-9958-c11134ca1da9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:11.048947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fbc2d-e7e1-466a-9958-c11134ca1da9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:11.048947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fbc2d-e7e1-466a-9958-c11134ca1da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:11.065764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:11.078675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-955fbc2d-e7e1-466a-9958-c11134ca1da9 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:11.080457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-955fbc2d-e7e1-466a-9958-c11134ca1da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:11.095404 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 18/41] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 25 16:04:10 2022] POST /identity/v3/projects => generated 301 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:04:11.099559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf8fc9-8ec0-42f2-b108-f14f6f1591d4 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:11.100351 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf8fc9-8ec0-42f2-b108-f14f6f1591d4 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:11.101257 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf8fc9-8ec0-42f2-b108-f14f6f1591d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:11.139224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-0edf8fc9-8ec0-42f2-b108-f14f6f1591d4 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:11.141041 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0edf8fc9-8ec0-42f2-b108-f14f6f1591d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:11.206586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 24/42] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:11.253369 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fbc2d-e7e1-466a-9958-c11134ca1da9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:11.254523 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 19/43] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:11.279975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf8fc9-8ec0-42f2-b108-f14f6f1591d4 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:11.435774 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fbc2d-e7e1-466a-9958-c11134ca1da9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:11.442146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf8fc9-8ec0-42f2-b108-f14f6f1591d4 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:11.465386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:11.474083 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:11.490136 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbb271-6de6-4cbb-bfe0-40be042b37cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:11.491100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbb271-6de6-4cbb-bfe0-40be042b37cf None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:11.491560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbb271-6de6-4cbb-bfe0-40be042b37cf None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:11.492066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbb271-6de6-4cbb-bfe0-40be042b37cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:11.493967 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbb271-6de6-4cbb-bfe0-40be042b37cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:11.495495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9e25f-e890-438e-a483-ef7cc9582632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:11.496186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9e25f-e890-438e-a483-ef7cc9582632 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:11.496504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9e25f-e890-438e-a483-ef7cc9582632 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:11.496656 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbb271-6de6-4cbb-bfe0-40be042b37cf None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:11.496791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9e25f-e890-438e-a483-ef7cc9582632 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:11.497537 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9e25f-e890-438e-a483-ef7cc9582632 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:11.498423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 20/44] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:11.499065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9e25f-e890-438e-a483-ef7cc9582632 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:11.506275 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbb271-6de6-4cbb-bfe0-40be042b37cf None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:11.517470 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 25/45] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Jul 25 16:04:11 2022] POST /identity/v3/roles => generated 223 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:04:11.697550 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbb271-6de6-4cbb-bfe0-40be042b37cf None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:11.748851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593d8ed-9605-4188-bb30-50bb36db8005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:11.749659 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593d8ed-9605-4188-bb30-50bb36db8005 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:11.749989 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593d8ed-9605-4188-bb30-50bb36db8005 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:11.750334 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593d8ed-9605-4188-bb30-50bb36db8005 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:11.751355 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593d8ed-9605-4188-bb30-50bb36db8005 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:11.753459 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593d8ed-9605-4188-bb30-50bb36db8005 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:11.795528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 21/46] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 25 16:04:11 2022] POST /identity/v3/projects => generated 312 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:04:13.082548 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ecef-5b44-4737-8d91-bedf5376540c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:13.083200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ecef-5b44-4737-8d91-bedf5376540c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:13.083200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ecef-5b44-4737-8d91-bedf5376540c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:13.084533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 26/47] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:13.090628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f066d-9352-4620-89f1-4b951c1940d9 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:13.091131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f066d-9352-4620-89f1-4b951c1940d9 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:13.091292 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f066d-9352-4620-89f1-4b951c1940d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:13.111150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-627f066d-9352-4620-89f1-4b951c1940d9 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:13.112418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-627f066d-9352-4620-89f1-4b951c1940d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:13.157004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:13.188165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 22/48] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:13.211101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1ecef-5b44-4737-8d91-bedf5376540c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:13.326267 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1ecef-5b44-4737-8d91-bedf5376540c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:13.362850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d56c29-66a2-480c-8216-8a6e25b544b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:13.363573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d56c29-66a2-480c-8216-8a6e25b544b9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:13.364418 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d56c29-66a2-480c-8216-8a6e25b544b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:13.364705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d56c29-66a2-480c-8216-8a6e25b544b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:13.375361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d56c29-66a2-480c-8216-8a6e25b544b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:13.383270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c3d56c29-66a2-480c-8216-8a6e25b544b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:13.383270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:13.383270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:13.383270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:13.383270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:13.383270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:13.383270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:13.383270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:13.383270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:13.383270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:13.383270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:13.383270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:13.383270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:13.383270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:13.383270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:13.383270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:13.384121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:13.384121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:13.384121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:13.384121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:13.384121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:13.384121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:13.384121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:13.384121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:13.384121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:13.384121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:13.384121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:13.384121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:13.384121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:13.384121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:13.384121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:13.384121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:13.384891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:13.384891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:13.384891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:13.384891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:13.384891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:13.384891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:13.384891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:13.384891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:13.384891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:13.384891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:13.384891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:13.384891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:13.384891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 27/49] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:04:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:13.391817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f066d-9352-4620-89f1-4b951c1940d9 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:13.492654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f066d-9352-4620-89f1-4b951c1940d9 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:13.528883 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35f18a-7a49-4deb-818e-3a6d4c698331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:13.529566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35f18a-7a49-4deb-818e-3a6d4c698331 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:13.529857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35f18a-7a49-4deb-818e-3a6d4c698331 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:13.530140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35f18a-7a49-4deb-818e-3a6d4c698331 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:13.530901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35f18a-7a49-4deb-818e-3a6d4c698331 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:13.531221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35f18a-7a49-4deb-818e-3a6d4c698331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:13.532644 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35f18a-7a49-4deb-818e-3a6d4c698331 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:13.541634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 23/50] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:13.547078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d56c29-66a2-480c-8216-8a6e25b544b9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:13.590732 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:13.654972 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d56c29-66a2-480c-8216-8a6e25b544b9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:13.693233 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317f467-cccd-4229-8f46-cfa6ef8e6c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:13.694129 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317f467-cccd-4229-8f46-cfa6ef8e6c88 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:13.694414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317f467-cccd-4229-8f46-cfa6ef8e6c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:13.694689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317f467-cccd-4229-8f46-cfa6ef8e6c88 None admin] PATH_INFO: `/v3/users/39c896452be844fc919b8104a7db12a5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:13.695912 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317f467-cccd-4229-8f46-cfa6ef8e6c88 None admin] RBAC: Authorizing `identity:get_user(user_id=39c896452be844fc919b8104a7db12a5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:13.697403 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317f467-cccd-4229-8f46-cfa6ef8e6c88 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:13.699055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 28/51] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:13 2022] GET /identity/v3/users/39c896452be844fc919b8104a7db12a5 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:13.704563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35f18a-7a49-4deb-818e-3a6d4c698331 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:13.741885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:13.810492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35f18a-7a49-4deb-818e-3a6d4c698331 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:13.843227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e16e51-42fa-48df-bd0d-6cef6bd08288 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:13.843603 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e16e51-42fa-48df-bd0d-6cef6bd08288 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:13.843887 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e16e51-42fa-48df-bd0d-6cef6bd08288 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:13.845393 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 29/52] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:13.847560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527ab45-6053-466c-9cc1-513f3a20db1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:13.848922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527ab45-6053-466c-9cc1-513f3a20db1d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:13.849201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527ab45-6053-466c-9cc1-513f3a20db1d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:13.849475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527ab45-6053-466c-9cc1-513f3a20db1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:13.850691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527ab45-6053-466c-9cc1-513f3a20db1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:13.852043 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff50c9-c209-41a9-b5fa-38ed3f4cb8b6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:13.852187 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527ab45-6053-466c-9cc1-513f3a20db1d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:13.852742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff50c9-c209-41a9-b5fa-38ed3f4cb8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:13.853061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff50c9-c209-41a9-b5fa-38ed3f4cb8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:13.853857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 24/53] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:13.860645 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527ab45-6053-466c-9cc1-513f3a20db1d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:13.872919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a4ff50c9-c209-41a9-b5fa-38ed3f4cb8b6 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:13.874149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a4ff50c9-c209-41a9-b5fa-38ed3f4cb8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:13.968211 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 30/54] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:13.979251 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527ab45-6053-466c-9cc1-513f3a20db1d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:13.982697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:13.989529 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff50c9-c209-41a9-b5fa-38ed3f4cb8b6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:14.021933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bef087-eb7f-4642-bdf5-188b4feede40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:14.022635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bef087-eb7f-4642-bdf5-188b4feede40 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:14.022933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bef087-eb7f-4642-bdf5-188b4feede40 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:14.023217 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bef087-eb7f-4642-bdf5-188b4feede40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:14.024087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bef087-eb7f-4642-bdf5-188b4feede40 None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.domain.id=default, user.id=39c896452be844fc919b8104a7db12a5) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:14.024438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bef087-eb7f-4642-bdf5-188b4feede40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:14.025918 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bef087-eb7f-4642-bdf5-188b4feede40 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:14.029947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:14.033932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 25/55] 10.222.0.70 () {56 vars in 1322 bytes} [Mon Jul 25 16:04:13 2022] GET /identity/v3/role_assignments?user.id=39c896452be844fc919b8104a7db12a5&scope.domain.id=default&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 530 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:14.110602 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff50c9-c209-41a9-b5fa-38ed3f4cb8b6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:14.150167 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c12c8-7098-4e6f-a450-e7b050cf885b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:14.151008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c12c8-7098-4e6f-a450-e7b050cf885b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:14.151300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c12c8-7098-4e6f-a450-e7b050cf885b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:14.151838 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c12c8-7098-4e6f-a450-e7b050cf885b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:14.153143 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c12c8-7098-4e6f-a450-e7b050cf885b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:14.154654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c12c8-7098-4e6f-a450-e7b050cf885b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:14.156444 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 31/56] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:14.163369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bef087-eb7f-4642-bdf5-188b4feede40 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:14.284500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bef087-eb7f-4642-bdf5-188b4feede40 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:14.320120 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3d57f-d2ca-4c43-8272-20fd25c8f01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:14.320826 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3d57f-d2ca-4c43-8272-20fd25c8f01d None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:14.321117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3d57f-d2ca-4c43-8272-20fd25c8f01d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:14.321400 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3d57f-d2ca-4c43-8272-20fd25c8f01d None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:14.322122 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3d57f-d2ca-4c43-8272-20fd25c8f01d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:14.323601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3d57f-d2ca-4c43-8272-20fd25c8f01d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:14.352758 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 26/57] 10.222.0.70 () {60 vars in 1140 bytes} [Mon Jul 25 16:04:14 2022] POST /identity/v3/projects => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:04:16.488325 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ea875-cadd-40cf-b62e-791fdb79b8b8 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:16.488884 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ea875-cadd-40cf-b62e-791fdb79b8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:16.488884 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ea875-cadd-40cf-b62e-791fdb79b8b8 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:16.490279 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 32/58] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:16.496943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a5adb-70b2-49f7-b933-6ab43d163784 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:16.497468 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a5adb-70b2-49f7-b933-6ab43d163784 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:16.497468 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a5adb-70b2-49f7-b933-6ab43d163784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:16.517865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7d7a5adb-70b2-49f7-b933-6ab43d163784 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:16.519096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7d7a5adb-70b2-49f7-b933-6ab43d163784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:16.537451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:16.599482 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 27/59] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:16.636107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ea875-cadd-40cf-b62e-791fdb79b8b8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:16.789178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ea875-cadd-40cf-b62e-791fdb79b8b8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:16.791804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:16.827834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64917839-4685-489c-98df-82e3ad90d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:16.828678 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64917839-4685-489c-98df-82e3ad90d20f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:16.828959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64917839-4685-489c-98df-82e3ad90d20f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:16.829236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64917839-4685-489c-98df-82e3ad90d20f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:16.830441 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64917839-4685-489c-98df-82e3ad90d20f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:16.832316 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64917839-4685-489c-98df-82e3ad90d20f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:16.834312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 33/60] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:16.840180 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a5adb-70b2-49f7-b933-6ab43d163784 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:16.954757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a5adb-70b2-49f7-b933-6ab43d163784 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:16.994748 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7274b7-5c5d-4bb9-8af4-7108003de701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:16.995444 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7274b7-5c5d-4bb9-8af4-7108003de701 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:16.995785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7274b7-5c5d-4bb9-8af4-7108003de701 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:16.996050 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7274b7-5c5d-4bb9-8af4-7108003de701 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:16.996810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7274b7-5c5d-4bb9-8af4-7108003de701 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:16.998312 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7274b7-5c5d-4bb9-8af4-7108003de701 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:17.029593 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 28/61] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:04:16 2022] POST /identity/v3/users => generated 275 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:04:20.725249 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa6d25-7694-4690-bbd4-a825ced8ed43 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:20.726280 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa6d25-7694-4690-bbd4-a825ced8ed43 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:20.726762 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa6d25-7694-4690-bbd4-a825ced8ed43 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:20.728431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 34/62] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:20.736690 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af1389-7361-49de-b17b-8d5fb3e2a1fa None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:20.737183 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af1389-7361-49de-b17b-8d5fb3e2a1fa None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:20.737254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af1389-7361-49de-b17b-8d5fb3e2a1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:20.756305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:20.765368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-61af1389-7361-49de-b17b-8d5fb3e2a1fa None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:20.766606 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-61af1389-7361-49de-b17b-8d5fb3e2a1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:20.797215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d8f5b-11d9-4c53-922e-a5f69a814fae None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:20.797849 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d8f5b-11d9-4c53-922e-a5f69a814fae None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:20.798322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d8f5b-11d9-4c53-922e-a5f69a814fae None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:20.799953 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 35/63] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:20.810147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a364b84-7433-4b19-be4d-46ebb27b69c2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:20.810781 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a364b84-7433-4b19-be4d-46ebb27b69c2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:20.811255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a364b84-7433-4b19-be4d-46ebb27b69c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:20.850054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9a364b84-7433-4b19-be4d-46ebb27b69c2 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:20.852100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9a364b84-7433-4b19-be4d-46ebb27b69c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:20.899782 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 29/64] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:20.910940 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c255a-cf15-4371-afc6-a047275f5754 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:20.911803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c255a-cf15-4371-afc6-a047275f5754 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:20.912509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c255a-cf15-4371-afc6-a047275f5754 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:20.915369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 30/65] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:20 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:20.935107 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9138658-1544-4f8f-a8b3-b14f5539c286 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:20.935927 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9138658-1544-4f8f-a8b3-b14f5539c286 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:20.936737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9138658-1544-4f8f-a8b3-b14f5539c286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:20.940949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 36/66] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:20.960153 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48773f8-a46c-46ae-bd84-e232203be8df None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:20.960689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48773f8-a46c-46ae-bd84-e232203be8df None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:20.961133 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48773f8-a46c-46ae-bd84-e232203be8df None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:20.962658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 37/67] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:04:20.970736 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48773f8-a46c-46ae-bd84-e232203be8df None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:20.980874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b9138658-1544-4f8f-a8b3-b14f5539c286 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:20.981984 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b9138658-1544-4f8f-a8b3-b14f5539c286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:21.056239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 31/68] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:21.059923 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9138658-1544-4f8f-a8b3-b14f5539c286 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:21.090716 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48773f8-a46c-46ae-bd84-e232203be8df None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:21.093847 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:21.138644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f2930-35a3-40ae-8693-febfd32aac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:21.139458 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f2930-35a3-40ae-8693-febfd32aac87 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:21.139949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f2930-35a3-40ae-8693-febfd32aac87 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:21.140237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f2930-35a3-40ae-8693-febfd32aac87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:21.150167 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:21.153543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f2930-35a3-40ae-8693-febfd32aac87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:21.169353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-613f2930-35a3-40ae-8693-febfd32aac87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:21.169353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:21.169353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:21.169353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:21.169353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:21.169353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:21.169353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:21.169353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:21.169353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:21.169353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:21.169353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:21.169353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:21.169353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:21.169353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:21.169353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:21.169353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:21.170261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:21.170261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:21.170261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:21.170261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:21.170261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:21.170261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:21.170261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:21.170261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:21.170261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:21.170261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:21.170261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:21.170261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:21.170261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:21.170261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:21.170261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:21.170261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:21.170992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:21.170992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:21.170992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:21.170992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:21.170992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:21.170992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:21.170992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:21.170992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:21.170992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:21.170992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:21.170992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:21.170992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:21.172043 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 38/69] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:04:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:21.173655 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a24b5e-0108-46df-9067-12f7028f0374 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:21.173943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a24b5e-0108-46df-9067-12f7028f0374 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:21.174217 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a24b5e-0108-46df-9067-12f7028f0374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:21.196594 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9138658-1544-4f8f-a8b3-b14f5539c286 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:21.204421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-41a24b5e-0108-46df-9067-12f7028f0374 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:21.205635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-41a24b5e-0108-46df-9067-12f7028f0374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:21.244003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fae4f-6beb-48bd-b0ae-42e4cb020d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:21.244955 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fae4f-6beb-48bd-b0ae-42e4cb020d48 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:21.245233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fae4f-6beb-48bd-b0ae-42e4cb020d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:21.245622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fae4f-6beb-48bd-b0ae-42e4cb020d48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:21.257729 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fae4f-6beb-48bd-b0ae-42e4cb020d48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:21.265625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-a49fae4f-6beb-48bd-b0ae-42e4cb020d48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:21.265625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:21.265625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:21.265625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:21.265625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:21.265625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:21.265625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:21.265625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:21.265625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:21.265625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:21.265625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:21.265625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:21.265625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:21.265625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:21.265625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:21.265625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:21.266520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:21.266520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:21.266520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:21.266520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:21.266520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:21.266520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:21.266520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:21.266520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:21.266520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:21.266520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:21.266520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:21.266520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:21.266520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:21.266520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:21.266520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:21.266520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:21.267259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:21.267259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:21.267259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:21.267259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:21.267259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:21.267259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:21.267259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:21.267259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:21.267259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:21.267259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:21.267259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:21.267259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:21.267259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 32/70] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:21.267874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fae4f-6beb-48bd-b0ae-42e4cb020d48 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:21.310812 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 39/71] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:21.312186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a24b5e-0108-46df-9067-12f7028f0374 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:21.401006 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fae4f-6beb-48bd-b0ae-42e4cb020d48 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:21.424353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:21.429984 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:21.437290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a24b5e-0108-46df-9067-12f7028f0374 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:21.440072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc32885-dc06-498f-964f-0bd5e7222435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:21.441117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc32885-dc06-498f-964f-0bd5e7222435 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:21.441442 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc32885-dc06-498f-964f-0bd5e7222435 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:21.442347 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc32885-dc06-498f-964f-0bd5e7222435 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:21.454693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc32885-dc06-498f-964f-0bd5e7222435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:21.463423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-9bc32885-dc06-498f-964f-0bd5e7222435 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:21.463423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:21.463423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:21.463423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:21.463423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:21.463423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:21.463423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:21.463423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:21.463423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:21.463423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:21.463423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:21.463423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:21.463423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:21.463423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:21.463423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:21.463423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:21.464752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:21.464752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:21.464752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:21.464752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:21.464752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:21.464752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:21.464752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:21.464752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:21.464752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:21.464752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:21.464752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:21.464752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:21.464752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:21.464752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:21.464752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:21.464752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:21.465884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:21.465884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:21.465884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:21.465884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:21.465884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:21.465884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:21.465884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:21.465884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:21.465884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:21.465884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:21.465884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:21.465884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:21.465884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 33/72] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:21.465884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc32885-dc06-498f-964f-0bd5e7222435 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:21.487623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec723bb7-c671-432b-91f0-2cf7e2cb9dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:21.488229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec723bb7-c671-432b-91f0-2cf7e2cb9dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:21.488547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec723bb7-c671-432b-91f0-2cf7e2cb9dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:21.488828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec723bb7-c671-432b-91f0-2cf7e2cb9dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:21.489585 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec723bb7-c671-432b-91f0-2cf7e2cb9dc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:21.489903 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec723bb7-c671-432b-91f0-2cf7e2cb9dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:21.491310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec723bb7-c671-432b-91f0-2cf7e2cb9dc4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:21.499964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 40/73] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:21.500838 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec723bb7-c671-432b-91f0-2cf7e2cb9dc4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:21.592233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc32885-dc06-498f-964f-0bd5e7222435 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:21.607264 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec723bb7-c671-432b-91f0-2cf7e2cb9dc4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:21.632587 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8b190-d7a8-4e73-ac9a-057fc21ebf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:21.633281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8b190-d7a8-4e73-ac9a-057fc21ebf62 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:21.633574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8b190-d7a8-4e73-ac9a-057fc21ebf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:21.633852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8b190-d7a8-4e73-ac9a-057fc21ebf62 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:21.634614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8b190-d7a8-4e73-ac9a-057fc21ebf62 None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:21.634926 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8b190-d7a8-4e73-ac9a-057fc21ebf62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:21.636407 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8b190-d7a8-4e73-ac9a-057fc21ebf62 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:21.645411 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc486e0b-6ee7-4334-abc0-d98c15a063d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:21.645784 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 34/74] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:21.646292 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8b190-d7a8-4e73-ac9a-057fc21ebf62 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:21.650895 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc486e0b-6ee7-4334-abc0-d98c15a063d2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:21.651184 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc486e0b-6ee7-4334-abc0-d98c15a063d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:21.651467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc486e0b-6ee7-4334-abc0-d98c15a063d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:21.663709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc486e0b-6ee7-4334-abc0-d98c15a063d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:21.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-bc486e0b-6ee7-4334-abc0-d98c15a063d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:04:21.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:21.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:21.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:21.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:21.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:21.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:21.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:21.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:21.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:21.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:21.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:21.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:21.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:21.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:21.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:21.674173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:21.674173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:21.674173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:21.674173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:21.674173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:21.674173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:21.674173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:21.674173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:21.674173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:21.674173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:21.674173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:21.674173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:21.674173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:21.674173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:21.674173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:21.674173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:21.675071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:21.675071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:21.675071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:21.675071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:21.675071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:21.675071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:21.675071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:21.675071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:21.675071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:21.675071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:21.675071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:04:21.675071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:21.675071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 41/75] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:04:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:21.675876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609c099-9f6e-4252-b7c5-414d3d2f6241 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:21.676543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609c099-9f6e-4252-b7c5-414d3d2f6241 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:21.676822 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609c099-9f6e-4252-b7c5-414d3d2f6241 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:21.680318 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 42/76] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:21.680546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609c099-9f6e-4252-b7c5-414d3d2f6241 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:21.699297 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:21.741828 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:21.807078 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8b190-d7a8-4e73-ac9a-057fc21ebf62 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:21.816232 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609c099-9f6e-4252-b7c5-414d3d2f6241 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:21.850276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e28eb-9393-46e6-9d6d-9e7c9b3b9a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:21.850969 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e28eb-9393-46e6-9d6d-9e7c9b3b9a9b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:21.851254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e28eb-9393-46e6-9d6d-9e7c9b3b9a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:21.851533 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e28eb-9393-46e6-9d6d-9e7c9b3b9a9b None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:21.852310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e28eb-9393-46e6-9d6d-9e7c9b3b9a9b None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:21.852633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e28eb-9393-46e6-9d6d-9e7c9b3b9a9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:21.854029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e28eb-9393-46e6-9d6d-9e7c9b3b9a9b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:21.856957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2125a5-99d2-4b49-853b-7122765b9771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:21.857854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2125a5-99d2-4b49-853b-7122765b9771 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:21.858147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2125a5-99d2-4b49-853b-7122765b9771 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:21.858427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2125a5-99d2-4b49-853b-7122765b9771 None admin] PATH_INFO: `/v3/users/39c896452be844fc919b8104a7db12a5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:21.859678 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2125a5-99d2-4b49-853b-7122765b9771 None admin] RBAC: Authorizing `identity:get_user(user_id=39c896452be844fc919b8104a7db12a5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:21.861184 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2125a5-99d2-4b49-853b-7122765b9771 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:21.862832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 35/77] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:21.862998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 43/78] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:21 2022] GET /identity/v3/users/39c896452be844fc919b8104a7db12a5 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:21.864545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e28eb-9393-46e6-9d6d-9e7c9b3b9a9b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:21.864959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2125a5-99d2-4b49-853b-7122765b9771 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:21.953152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:21.974092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2125a5-99d2-4b49-853b-7122765b9771 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:21.976169 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e28eb-9393-46e6-9d6d-9e7c9b3b9a9b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:21.986956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:22.012747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0259d-f373-429d-a106-795f7cd0ea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:22.012977 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45654b7-a229-4923-8ca7-1c2493209dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:22.013393 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0259d-f373-429d-a106-795f7cd0ea7a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:22.013731 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0259d-f373-429d-a106-795f7cd0ea7a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:22.013839 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45654b7-a229-4923-8ca7-1c2493209dcd None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:22.014026 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0259d-f373-429d-a106-795f7cd0ea7a None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:22.014144 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45654b7-a229-4923-8ca7-1c2493209dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:22.014307 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45654b7-a229-4923-8ca7-1c2493209dcd None admin] PATH_INFO: `/v3/users/a7a1941bc6e143339ac7d433511016f2` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:22.014794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0259d-f373-429d-a106-795f7cd0ea7a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:22.015102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0259d-f373-429d-a106-795f7cd0ea7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:22.016530 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0259d-f373-429d-a106-795f7cd0ea7a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:22.025386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 44/79] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:04:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:22.026972 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df7d99-e42a-4dfe-90c2-be4a3e68c4e8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:22.027272 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df7d99-e42a-4dfe-90c2-be4a3e68c4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:22.027557 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df7d99-e42a-4dfe-90c2-be4a3e68c4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:22.034019 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45654b7-a229-4923-8ca7-1c2493209dcd None admin] RBAC: Authorizing `identity:get_user(user_id=a7a1941bc6e143339ac7d433511016f2)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:22.037472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45654b7-a229-4923-8ca7-1c2493209dcd None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:22.041714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 36/80] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:21 2022] GET /identity/v3/users/a7a1941bc6e143339ac7d433511016f2 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:22.042216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45654b7-a229-4923-8ca7-1c2493209dcd None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:22.046748 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-67df7d99-e42a-4dfe-90c2-be4a3e68c4e8 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:22.047970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-67df7d99-e42a-4dfe-90c2-be4a3e68c4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:22.123768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 45/81] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:22.124679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df7d99-e42a-4dfe-90c2-be4a3e68c4e8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:22.163283 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45654b7-a229-4923-8ca7-1c2493209dcd None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:22.200610 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4b338-d514-40c4-85c5-c7688fc21ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:22.201506 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4b338-d514-40c4-85c5-c7688fc21ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:22.201794 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4b338-d514-40c4-85c5-c7688fc21ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:22.202079 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4b338-d514-40c4-85c5-c7688fc21ca6 None admin] PATH_INFO: `/v3/users/a7a1941bc6e143339ac7d433511016f2` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:22.203298 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4b338-d514-40c4-85c5-c7688fc21ca6 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a1941bc6e143339ac7d433511016f2)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:22.204803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4b338-d514-40c4-85c5-c7688fc21ca6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:22.206444 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 37/82] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:22 2022] GET /identity/v3/users/a7a1941bc6e143339ac7d433511016f2 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:22.211038 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4b338-d514-40c4-85c5-c7688fc21ca6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:22.218309 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:22.252846 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df7d99-e42a-4dfe-90c2-be4a3e68c4e8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:22.260600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:22.292665 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b43f1-6b55-4efe-a481-8265a649c7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:22.293253 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b43f1-6b55-4efe-a481-8265a649c7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:22.293543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b43f1-6b55-4efe-a481-8265a649c7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:22.293831 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b43f1-6b55-4efe-a481-8265a649c7d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:22.333935 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4b338-d514-40c4-85c5-c7688fc21ca6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:22.380501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f44d05-7be9-438b-bd02-f71eb65826e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:22.381404 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f44d05-7be9-438b-bd02-f71eb65826e7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:22.381690 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f44d05-7be9-438b-bd02-f71eb65826e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:22.381972 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f44d05-7be9-438b-bd02-f71eb65826e7 None admin] PATH_INFO: `/v3/users/a7a1941bc6e143339ac7d433511016f2` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:22.382898 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b43f1-6b55-4efe-a481-8265a649c7d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:22.383279 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f44d05-7be9-438b-bd02-f71eb65826e7 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a1941bc6e143339ac7d433511016f2)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:22.384441 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b43f1-6b55-4efe-a481-8265a649c7d8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:22.384802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f44d05-7be9-438b-bd02-f71eb65826e7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:22.386558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 38/83] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:22 2022] GET /identity/v3/users/a7a1941bc6e143339ac7d433511016f2 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:22.387386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f44d05-7be9-438b-bd02-f71eb65826e7 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:22.470366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:22.498914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 46/84] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:22.499803 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b43f1-6b55-4efe-a481-8265a649c7d8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:22.530662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f44d05-7be9-438b-bd02-f71eb65826e7 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:22.535323 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:22.587250 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef498e1-fb9c-43f6-b866-8303f451c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:22.588109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef498e1-fb9c-43f6-b866-8303f451c1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:22.588579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef498e1-fb9c-43f6-b866-8303f451c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:22.589021 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef498e1-fb9c-43f6-b866-8303f451c1d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:22.628139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b43f1-6b55-4efe-a481-8265a649c7d8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:22.667830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef498e1-fb9c-43f6-b866-8303f451c1d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:22.669407 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef498e1-fb9c-43f6-b866-8303f451c1d8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:22.670468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63082c9f-b4c4-4f53-bdb8-53c7c0a94d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:22.670468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63082c9f-b4c4-4f53-bdb8-53c7c0a94d7e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:22.671091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63082c9f-b4c4-4f53-bdb8-53c7c0a94d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:22.671556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63082c9f-b4c4-4f53-bdb8-53c7c0a94d7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:22.672989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63082c9f-b4c4-4f53-bdb8-53c7c0a94d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:22.674465 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63082c9f-b4c4-4f53-bdb8-53c7c0a94d7e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:22.676738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 47/85] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:22.677570 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63082c9f-b4c4-4f53-bdb8-53c7c0a94d7e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:22.732341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:22.789450 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 39/86] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:22.790348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef498e1-fb9c-43f6-b866-8303f451c1d8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:22.796774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:22.799983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63082c9f-b4c4-4f53-bdb8-53c7c0a94d7e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:22.836902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981c5a0-9e01-4605-a61c-59ceadb82e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:22.837645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981c5a0-9e01-4605-a61c-59ceadb82e8e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:22.837868 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981c5a0-9e01-4605-a61c-59ceadb82e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:22.838161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981c5a0-9e01-4605-a61c-59ceadb82e8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:22.898204 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef498e1-fb9c-43f6-b866-8303f451c1d8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:22.909090 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981c5a0-9e01-4605-a61c-59ceadb82e8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:22.910607 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981c5a0-9e01-4605-a61c-59ceadb82e8e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:22.933027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521867d7-95ed-43b4-a874-32d685a776e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:22.933692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521867d7-95ed-43b4-a874-32d685a776e6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:22.933973 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521867d7-95ed-43b4-a874-32d685a776e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:22.934251 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521867d7-95ed-43b4-a874-32d685a776e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:22.954331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:23.007469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521867d7-95ed-43b4-a874-32d685a776e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:23.011696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521867d7-95ed-43b4-a874-32d685a776e6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:23.015134 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:23.020599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 48/87] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:23.021463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981c5a0-9e01-4605-a61c-59ceadb82e8e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:23.128631 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981c5a0-9e01-4605-a61c-59ceadb82e8e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:23.129735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 40/88] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:23.130661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521867d7-95ed-43b4-a874-32d685a776e6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:23.173940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348bf08-da8f-4473-a7cc-6cbc4ff07572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:23.175141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348bf08-da8f-4473-a7cc-6cbc4ff07572 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:23.175434 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348bf08-da8f-4473-a7cc-6cbc4ff07572 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:23.175718 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348bf08-da8f-4473-a7cc-6cbc4ff07572 None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:23.177474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348bf08-da8f-4473-a7cc-6cbc4ff07572 None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:23.178931 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348bf08-da8f-4473-a7cc-6cbc4ff07572 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:23.180683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 49/89] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:23 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:23.181471 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348bf08-da8f-4473-a7cc-6cbc4ff07572 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:23.199793 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:23.241872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521867d7-95ed-43b4-a874-32d685a776e6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:23.244265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:23.278806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafffb2d-e011-46f5-bc1b-0376117bfaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:23.279282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafffb2d-e011-46f5-bc1b-0376117bfaaf None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:23.279573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafffb2d-e011-46f5-bc1b-0376117bfaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:23.279855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafffb2d-e011-46f5-bc1b-0376117bfaaf None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:23.280606 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafffb2d-e011-46f5-bc1b-0376117bfaaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:23.282070 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafffb2d-e011-46f5-bc1b-0376117bfaaf None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:23.292989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348bf08-da8f-4473-a7cc-6cbc4ff07572 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:23.303551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 41/90] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:04:23 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:04:23.304534 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafffb2d-e011-46f5-bc1b-0376117bfaaf None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:23.343401 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc40f4-cd7e-4f39-87df-a9546e9f818a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:23.344337 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc40f4-cd7e-4f39-87df-a9546e9f818a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:23.344695 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc40f4-cd7e-4f39-87df-a9546e9f818a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:23.344917 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc40f4-cd7e-4f39-87df-a9546e9f818a None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:23.346874 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc40f4-cd7e-4f39-87df-a9546e9f818a None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:23.348433 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc40f4-cd7e-4f39-87df-a9546e9f818a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:23.350267 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 50/91] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:23 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:23.351290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc40f4-cd7e-4f39-87df-a9546e9f818a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:23.421824 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafffb2d-e011-46f5-bc1b-0376117bfaaf None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:23.449411 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:23.463357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89bb75-156d-4981-a5be-8fa6c5908df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:23.464245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89bb75-156d-4981-a5be-8fa6c5908df6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:23.464552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89bb75-156d-4981-a5be-8fa6c5908df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:23.464827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89bb75-156d-4981-a5be-8fa6c5908df6 None admin] PATH_INFO: `/v3/projects/43908993317f49c5ab0f64ce116191d7` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:23.466045 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89bb75-156d-4981-a5be-8fa6c5908df6 None admin] RBAC: Authorizing `identity:get_project(project_id=43908993317f49c5ab0f64ce116191d7)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:23.467528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89bb75-156d-4981-a5be-8fa6c5908df6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:23.475151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 42/92] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:23 2022] GET /identity/v3/projects/43908993317f49c5ab0f64ce116191d7 => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:23.475151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89bb75-156d-4981-a5be-8fa6c5908df6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:23.483743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc40f4-cd7e-4f39-87df-a9546e9f818a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:23.501526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:23.530294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19bcd3-bc47-411a-9a13-e7e9e0185e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:23.531867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19bcd3-bc47-411a-9a13-e7e9e0185e28 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:23.532380 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19bcd3-bc47-411a-9a13-e7e9e0185e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:23.532834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19bcd3-bc47-411a-9a13-e7e9e0185e28 None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:23.534072 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19bcd3-bc47-411a-9a13-e7e9e0185e28 None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:23.536142 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19bcd3-bc47-411a-9a13-e7e9e0185e28 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:23.537956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 51/93] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:23 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:23.538743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19bcd3-bc47-411a-9a13-e7e9e0185e28 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:23.590369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89bb75-156d-4981-a5be-8fa6c5908df6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:23.634862 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2de73a-4a36-4f73-b84a-9a08d2a18076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:23.636844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2de73a-4a36-4f73-b84a-9a08d2a18076 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:23.636844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2de73a-4a36-4f73-b84a-9a08d2a18076 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:23.637005 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2de73a-4a36-4f73-b84a-9a08d2a18076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:23.637806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2de73a-4a36-4f73-b84a-9a08d2a18076 None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=c386c04bad694a429d89ba0a586c8a45, user.id=39c896452be844fc919b8104a7db12a5) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:23.638118 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2de73a-4a36-4f73-b84a-9a08d2a18076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:23.639580 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2de73a-4a36-4f73-b84a-9a08d2a18076 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:23.646315 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 43/94] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:23 2022] GET /identity/v3/role_assignments?user.id=39c896452be844fc919b8104a7db12a5&scope.project.id=c386c04bad694a429d89ba0a586c8a45&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:23.647139 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2de73a-4a36-4f73-b84a-9a08d2a18076 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:23.679403 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19bcd3-bc47-411a-9a13-e7e9e0185e28 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:23.733469 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e864c-2f59-47b4-a463-36bc2bbc2e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:23.734926 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e864c-2f59-47b4-a463-36bc2bbc2e74 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:23.735423 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e864c-2f59-47b4-a463-36bc2bbc2e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:23.736155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e864c-2f59-47b4-a463-36bc2bbc2e74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:23.737560 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e864c-2f59-47b4-a463-36bc2bbc2e74 None admin] RBAC: Adding query filter params (role.id=6a0b49157bc649ef99e870c62ee6f4fe, scope.project.id=c386c04bad694a429d89ba0a586c8a45, user.id=a7a1941bc6e143339ac7d433511016f2) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:23.738130 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e864c-2f59-47b4-a463-36bc2bbc2e74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:23.740697 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e864c-2f59-47b4-a463-36bc2bbc2e74 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:23.749548 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 52/95] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:23 2022] GET /identity/v3/role_assignments?user.id=a7a1941bc6e143339ac7d433511016f2&scope.project.id=c386c04bad694a429d89ba0a586c8a45&role.id=6a0b49157bc649ef99e870c62ee6f4fe => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:23.751048 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e864c-2f59-47b4-a463-36bc2bbc2e74 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:23.780289 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:23.802484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:23.827677 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2de73a-4a36-4f73-b84a-9a08d2a18076 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:23.894107 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754cac9-84c0-4eff-92ca-30f233d0f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:23.894469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754cac9-84c0-4eff-92ca-30f233d0f3af None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:23.895321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754cac9-84c0-4eff-92ca-30f233d0f3af None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:23.895605 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754cac9-84c0-4eff-92ca-30f233d0f3af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:23.896499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754cac9-84c0-4eff-92ca-30f233d0f3af None admin] RBAC: Adding query filter params (role.id=6a0b49157bc649ef99e870c62ee6f4fe, scope.project.id=43908993317f49c5ab0f64ce116191d7, user.id=a7a1941bc6e143339ac7d433511016f2) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:23.896811 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754cac9-84c0-4eff-92ca-30f233d0f3af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:23.898344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754cac9-84c0-4eff-92ca-30f233d0f3af None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:23.910425 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 44/96] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:23 2022] GET /identity/v3/role_assignments?user.id=a7a1941bc6e143339ac7d433511016f2&scope.project.id=43908993317f49c5ab0f64ce116191d7&role.id=6a0b49157bc649ef99e870c62ee6f4fe => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:23.946914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e864c-2f59-47b4-a463-36bc2bbc2e74 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:24.002230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603fcd9-09f5-4361-b549-173fbfd4e1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:24.002928 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603fcd9-09f5-4361-b549-173fbfd4e1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:24.003211 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603fcd9-09f5-4361-b549-173fbfd4e1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:24.003491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603fcd9-09f5-4361-b549-173fbfd4e1c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:24.004544 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603fcd9-09f5-4361-b549-173fbfd4e1c0 None admin] RBAC: Adding query filter params (role.id=e4ade3cd570d4865b356cbe822b76fe9, scope.project.id=c386c04bad694a429d89ba0a586c8a45, user.id=a7a1941bc6e143339ac7d433511016f2) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:24.004861 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603fcd9-09f5-4361-b549-173fbfd4e1c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:24.006370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603fcd9-09f5-4361-b549-173fbfd4e1c0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:24.017434 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 53/97] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:23 2022] GET /identity/v3/role_assignments?user.id=a7a1941bc6e143339ac7d433511016f2&scope.project.id=c386c04bad694a429d89ba0a586c8a45&role.id=e4ade3cd570d4865b356cbe822b76fe9 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:26.466576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9ae29-5014-4507-8e78-e7904c6df316 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:26.467188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9ae29-5014-4507-8e78-e7904c6df316 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:26.467188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9ae29-5014-4507-8e78-e7904c6df316 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:26.469287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 45/98] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:26.475856 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8977fb6-5513-4b94-92db-41a2f07b3d3f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:26.476384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8977fb6-5513-4b94-92db-41a2f07b3d3f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:26.476464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8977fb6-5513-4b94-92db-41a2f07b3d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:26.505632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a8977fb6-5513-4b94-92db-41a2f07b3d3f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:26.506814 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a8977fb6-5513-4b94-92db-41a2f07b3d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:26.599314 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 54/99] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:26.622286 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9ae29-5014-4507-8e78-e7904c6df316 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:26.763425 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9ae29-5014-4507-8e78-e7904c6df316 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:26.783322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2edbd8-eabd-4ab4-b622-849571b44178 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:26.783981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2edbd8-eabd-4ab4-b622-849571b44178 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:26.784513 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2edbd8-eabd-4ab4-b622-849571b44178 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:26.786667 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 55/100] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:26.792284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f28e66-f708-4d3d-a49e-f57afb4b548c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:26.792886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f28e66-f708-4d3d-a49e-f57afb4b548c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:26.793367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f28e66-f708-4d3d-a49e-f57afb4b548c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:26.801349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:26.812963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f165ccd-fb2f-4a3c-badb-4538c0bc1184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:26.814138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f165ccd-fb2f-4a3c-badb-4538c0bc1184 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:26.814653 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f165ccd-fb2f-4a3c-badb-4538c0bc1184 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:26.815126 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f165ccd-fb2f-4a3c-badb-4538c0bc1184 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:26.815232 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d8f28e66-f708-4d3d-a49e-f57afb4b548c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:26.817075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d8f28e66-f708-4d3d-a49e-f57afb4b548c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:26.817487 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f165ccd-fb2f-4a3c-badb-4538c0bc1184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:26.819285 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f165ccd-fb2f-4a3c-badb-4538c0bc1184 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:26.821424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 46/101] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:26.828050 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f165ccd-fb2f-4a3c-badb-4538c0bc1184 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:26.863063 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:26.899060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 56/102] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:26.905024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1441-1e22-4647-ac03-0977fa93e835 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:26.905818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1441-1e22-4647-ac03-0977fa93e835 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:26.906346 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1441-1e22-4647-ac03-0977fa93e835 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:26.908180 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 57/103] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:26.909778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c27e0-d628-44cf-9c47-2df90a4ea00d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:26.916283 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c27e0-d628-44cf-9c47-2df90a4ea00d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:26.917102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c27e0-d628-44cf-9c47-2df90a4ea00d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:26.918993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 58/104] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:26.921637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201e2ce-09b7-4a79-b91d-178190dedb45 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:26.922281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201e2ce-09b7-4a79-b91d-178190dedb45 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:26.922847 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201e2ce-09b7-4a79-b91d-178190dedb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:26.946200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4201e2ce-09b7-4a79-b91d-178190dedb45 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:26.947993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4201e2ce-09b7-4a79-b91d-178190dedb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:26.977077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f165ccd-fb2f-4a3c-badb-4538c0bc1184 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:27.013739 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c97272-4062-4894-9982-b6462c59155d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:27.014325 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c97272-4062-4894-9982-b6462c59155d None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:27.014620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c97272-4062-4894-9982-b6462c59155d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:27.014901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c97272-4062-4894-9982-b6462c59155d None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:27.015613 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c97272-4062-4894-9982-b6462c59155d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:27.017119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c97272-4062-4894-9982-b6462c59155d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:27.023554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 59/105] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:27.025210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930699bf-6b6d-488e-9d62-9ba34e34deec None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:27.025658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930699bf-6b6d-488e-9d62-9ba34e34deec None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:27.026090 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930699bf-6b6d-488e-9d62-9ba34e34deec None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:27.027942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 60/106] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:27.029206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7543028-2bf5-4159-a4e3-78b164edee3b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:27.029676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7543028-2bf5-4159-a4e3-78b164edee3b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:27.030139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7543028-2bf5-4159-a4e3-78b164edee3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:27.050241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a7543028-2bf5-4159-a4e3-78b164edee3b None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:27.052232 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a7543028-2bf5-4159-a4e3-78b164edee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:27.057547 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 47/107] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 25 16:04:26 2022] POST /identity/v3/projects => generated 302 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:04:27.058797 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c97272-4062-4894-9982-b6462c59155d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:27.128584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:27.138724 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 61/108] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:27.140409 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470afa4-1b62-488a-86b7-1f6171fbdc91 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:27.141221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470afa4-1b62-488a-86b7-1f6171fbdc91 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:27.141221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470afa4-1b62-488a-86b7-1f6171fbdc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:27.155184 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:27.180758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7470afa4-1b62-488a-86b7-1f6171fbdc91 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:27.183778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7470afa4-1b62-488a-86b7-1f6171fbdc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:27.187385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c97272-4062-4894-9982-b6462c59155d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:27.228170 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aa555-3719-4736-a671-3ac57e52ed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:27.230806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aa555-3719-4736-a671-3ac57e52ed73 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:27.230806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aa555-3719-4736-a671-3ac57e52ed73 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:27.230806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aa555-3719-4736-a671-3ac57e52ed73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:27.247985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aa555-3719-4736-a671-3ac57e52ed73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:27.255886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-4d9aa555-3719-4736-a671-3ac57e52ed73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:27.255886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:27.255886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:27.255886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:27.255886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:27.255886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:27.255886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:27.255886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:27.255886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:27.255886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:27.255886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:27.255886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:27.255886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:27.255886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:27.255886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:27.255886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:27.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:27.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:27.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:27.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:27.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:27.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:27.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:27.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:27.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:27.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:27.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:27.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:27.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:27.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:27.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:27.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:27.257602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:27.257602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:27.257602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:27.257602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:27.257602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:27.257602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:27.257602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:27.257602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:27.257602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:27.257602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:27.257602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:27.257602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:27.258872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 48/109] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:27.264346 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aa555-3719-4736-a671-3ac57e52ed73 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:27.284776 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 62/110] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:27.286114 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470afa4-1b62-488a-86b7-1f6171fbdc91 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:27.394122 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aa555-3719-4736-a671-3ac57e52ed73 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:27.411701 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470afa4-1b62-488a-86b7-1f6171fbdc91 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:27.438024 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea8a09-dd8e-48c9-8334-479f85a4e5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:27.439074 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea8a09-dd8e-48c9-8334-479f85a4e5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:27.439366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea8a09-dd8e-48c9-8334-479f85a4e5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:27.439649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea8a09-dd8e-48c9-8334-479f85a4e5f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:27.440164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:27.448632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:27.453185 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc13c5-1104-40a7-9a2f-770482acfd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:27.454238 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc13c5-1104-40a7-9a2f-770482acfd48 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:27.454717 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc13c5-1104-40a7-9a2f-770482acfd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:27.454840 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea8a09-dd8e-48c9-8334-479f85a4e5f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:27.455287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc13c5-1104-40a7-9a2f-770482acfd48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:27.464683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-24ea8a09-dd8e-48c9-8334-479f85a4e5f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:04:27.464683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:27.464683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:27.464683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:27.464683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:27.464683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:27.464683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:27.464683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:27.464683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:27.464683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:27.464683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:27.464683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:27.464683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:27.464683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:27.464683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:27.464683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:27.465738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:27.465738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:27.465738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:27.465738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:27.465738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:27.465738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:27.465738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:27.465738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:27.465738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:27.465738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:27.465738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:27.465738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:27.465738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:27.465738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:27.465738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:27.465738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:27.466635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:27.466635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:27.466635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:27.466635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:27.466635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:27.466635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:27.466635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:27.466635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:27.466635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:27.466635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:27.466635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:04:27.466635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:27.467749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 49/111] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:04:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:27.468506 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea8a09-dd8e-48c9-8334-479f85a4e5f1 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:27.470481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc13c5-1104-40a7-9a2f-770482acfd48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:27.479512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-63cc13c5-1104-40a7-9a2f-770482acfd48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:27.479512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:27.479512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:27.479512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:27.479512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:27.479512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:27.479512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:27.479512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:27.479512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:27.479512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:27.479512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:27.479512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:27.479512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:27.479512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:27.479512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:27.479512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:27.480950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:27.480950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:27.480950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:27.480950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:27.480950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:27.480950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:27.480950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:27.480950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:27.480950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:27.480950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:27.480950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:27.480950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:27.480950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:27.480950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:27.480950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:27.480950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:27.481653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:27.481653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:27.481653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:27.481653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:27.481653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:27.481653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:27.481653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:27.481653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:27.481653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:27.481653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:27.481653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:27.481653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:27.481653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 63/112] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:27.482909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc13c5-1104-40a7-9a2f-770482acfd48 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:27.580885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea8a09-dd8e-48c9-8334-479f85a4e5f1 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:27.592850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc13c5-1104-40a7-9a2f-770482acfd48 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:27.617068 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d9ba4-bf78-423b-93dc-d7c969b6c643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:27.617743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d9ba4-bf78-423b-93dc-d7c969b6c643 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:27.618031 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d9ba4-bf78-423b-93dc-d7c969b6c643 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:27.618311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d9ba4-bf78-423b-93dc-d7c969b6c643 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:27.619387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d9ba4-bf78-423b-93dc-d7c969b6c643 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:27.619702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d9ba4-bf78-423b-93dc-d7c969b6c643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:27.621122 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d9ba4-bf78-423b-93dc-d7c969b6c643 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:27.626808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab60297-b86c-4048-872b-31a0e6f84687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:27.627614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab60297-b86c-4048-872b-31a0e6f84687 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:27.627898 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab60297-b86c-4048-872b-31a0e6f84687 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:27.628175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab60297-b86c-4048-872b-31a0e6f84687 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:27.631019 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 50/113] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:27.632675 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23987e6-f4b2-4a7f-ba5d-15554464307a None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:27.633147 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23987e6-f4b2-4a7f-ba5d-15554464307a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:27.633428 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23987e6-f4b2-4a7f-ba5d-15554464307a None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:27.634693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 51/114] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:27.635618 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23987e6-f4b2-4a7f-ba5d-15554464307a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:27.644188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab60297-b86c-4048-872b-31a0e6f84687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:27.653154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-aab60297-b86c-4048-872b-31a0e6f84687 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:27.653154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:27.653154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:27.653154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:27.653154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:27.653154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:27.653154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:27.653154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:27.653154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:27.653154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:27.653154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:27.653154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:27.653154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:27.653154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:27.653154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:27.653154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:27.654454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:27.654454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:27.654454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:27.654454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:27.654454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:27.654454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:27.654454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:27.654454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:27.654454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:27.654454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:27.654454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:27.654454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:27.654454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:27.654454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:27.654454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:27.654454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:27.662827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:27.662827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:27.662827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:27.662827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:27.662827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:27.662827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:27.662827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:27.662827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:27.662827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:27.662827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:27.662827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:27.662827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:27.662827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 64/115] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:27.662827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab60297-b86c-4048-872b-31a0e6f84687 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:27.706942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:27.727300 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:27.766761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab60297-b86c-4048-872b-31a0e6f84687 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:27.775201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23987e6-f4b2-4a7f-ba5d-15554464307a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:27.808059 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c0ade-2796-4174-bf11-d063ab8d4615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:27.808797 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c0ade-2796-4174-bf11-d063ab8d4615 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:27.809083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c0ade-2796-4174-bf11-d063ab8d4615 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:27.809361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c0ade-2796-4174-bf11-d063ab8d4615 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:27.810104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c0ade-2796-4174-bf11-d063ab8d4615 None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:27.810476 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c0ade-2796-4174-bf11-d063ab8d4615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:27.811786 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c0ade-2796-4174-bf11-d063ab8d4615 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:27.813521 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4755527-693f-4f05-84aa-36fdc1b5b515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:27.814332 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4755527-693f-4f05-84aa-36fdc1b5b515 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:27.814620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4755527-693f-4f05-84aa-36fdc1b5b515 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:27.814903 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4755527-693f-4f05-84aa-36fdc1b5b515 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:27.815655 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4755527-693f-4f05-84aa-36fdc1b5b515 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:27.815967 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4755527-693f-4f05-84aa-36fdc1b5b515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:27.818062 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4755527-693f-4f05-84aa-36fdc1b5b515 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:27.825586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 65/116] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:27.825586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c0ade-2796-4174-bf11-d063ab8d4615 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:27.829659 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 52/117] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:04:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:27.835934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9d30c-6bbc-4fc4-a8ea-4bff822d42c3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:27.836309 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9d30c-6bbc-4fc4-a8ea-4bff822d42c3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:27.836584 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9d30c-6bbc-4fc4-a8ea-4bff822d42c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:27.856487 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-42d9d30c-6bbc-4fc4-a8ea-4bff822d42c3 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:27.857957 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-42d9d30c-6bbc-4fc4-a8ea-4bff822d42c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:27.934501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c0ade-2796-4174-bf11-d063ab8d4615 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:27.935622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 53/118] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:27.936510 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9d30c-6bbc-4fc4-a8ea-4bff822d42c3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:27.945014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:27.976846 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d7ea1-4e12-4478-a1c5-d4f7df7e16c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:27.977739 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d7ea1-4e12-4478-a1c5-d4f7df7e16c8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:27.978032 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d7ea1-4e12-4478-a1c5-d4f7df7e16c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:27.978319 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d7ea1-4e12-4478-a1c5-d4f7df7e16c8 None admin] PATH_INFO: `/v3/users/39c896452be844fc919b8104a7db12a5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:27.979542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d7ea1-4e12-4478-a1c5-d4f7df7e16c8 None admin] RBAC: Authorizing `identity:get_user(user_id=39c896452be844fc919b8104a7db12a5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:27.981047 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d7ea1-4e12-4478-a1c5-d4f7df7e16c8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:27.982723 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 66/119] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:27 2022] GET /identity/v3/users/39c896452be844fc919b8104a7db12a5 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:27.983526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d7ea1-4e12-4478-a1c5-d4f7df7e16c8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:28.003483 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:28.068082 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9d30c-6bbc-4fc4-a8ea-4bff822d42c3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:28.114689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d7ea1-4e12-4478-a1c5-d4f7df7e16c8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:28.115821 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1adcba-8af2-4e2a-94cd-20cf55a7f554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:28.116785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1adcba-8af2-4e2a-94cd-20cf55a7f554 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:28.117276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1adcba-8af2-4e2a-94cd-20cf55a7f554 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:28.117758 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1adcba-8af2-4e2a-94cd-20cf55a7f554 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:28.119155 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1adcba-8af2-4e2a-94cd-20cf55a7f554 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:28.119717 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1adcba-8af2-4e2a-94cd-20cf55a7f554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:28.122022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1adcba-8af2-4e2a-94cd-20cf55a7f554 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:28.131449 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 54/120] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:28.132591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1adcba-8af2-4e2a-94cd-20cf55a7f554 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:28.158324 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b7a16-801a-4dc8-b754-f653cbee8218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:28.159343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b7a16-801a-4dc8-b754-f653cbee8218 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:28.159633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b7a16-801a-4dc8-b754-f653cbee8218 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:28.159914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b7a16-801a-4dc8-b754-f653cbee8218 None admin] PATH_INFO: `/v3/users/a7a1941bc6e143339ac7d433511016f2` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:28.161252 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b7a16-801a-4dc8-b754-f653cbee8218 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a1941bc6e143339ac7d433511016f2)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:28.162719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b7a16-801a-4dc8-b754-f653cbee8218 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:28.164580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 67/121] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:27 2022] GET /identity/v3/users/a7a1941bc6e143339ac7d433511016f2 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:28.165304 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b7a16-801a-4dc8-b754-f653cbee8218 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:28.211750 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:28.259967 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1adcba-8af2-4e2a-94cd-20cf55a7f554 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:28.274682 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:28.289084 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b7a16-801a-4dc8-b754-f653cbee8218 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:28.302253 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce160493-c1d3-432b-a8bc-234bd43301c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:28.303259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce160493-c1d3-432b-a8bc-234bd43301c6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:28.303654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce160493-c1d3-432b-a8bc-234bd43301c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:28.303941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce160493-c1d3-432b-a8bc-234bd43301c6 None admin] PATH_INFO: `/v3/users/a7a1941bc6e143339ac7d433511016f2` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:28.305240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce160493-c1d3-432b-a8bc-234bd43301c6 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a1941bc6e143339ac7d433511016f2)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:28.306825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce160493-c1d3-432b-a8bc-234bd43301c6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:28.308804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 55/122] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:28 2022] GET /identity/v3/users/a7a1941bc6e143339ac7d433511016f2 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:28.309433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce160493-c1d3-432b-a8bc-234bd43301c6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:28.339578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17533a14-ec18-4368-a387-dbbf7bae1327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:28.340581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17533a14-ec18-4368-a387-dbbf7bae1327 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:28.341060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17533a14-ec18-4368-a387-dbbf7bae1327 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:28.341610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17533a14-ec18-4368-a387-dbbf7bae1327 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:28.358264 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17533a14-ec18-4368-a387-dbbf7bae1327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:28.372877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-17533a14-ec18-4368-a387-dbbf7bae1327 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:28.372877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:28.372877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:28.372877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:28.372877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:28.372877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:28.372877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:28.372877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:28.372877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:28.372877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:28.372877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:28.372877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:28.372877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:28.372877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:28.372877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:28.372877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:28.373746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:28.373746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:28.373746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:28.373746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:28.373746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:28.373746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:28.373746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:28.373746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:28.373746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:28.373746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:28.373746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:28.373746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:28.373746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:28.373746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:28.373746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:28.373746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:28.374467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:28.374467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:28.374467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:28.374467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:28.374467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:28.374467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:28.374467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:28.374467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:28.374467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:28.374467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:28.374467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:28.374467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:28.375019 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 68/123] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:28.375891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17533a14-ec18-4368-a387-dbbf7bae1327 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:28.454223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce160493-c1d3-432b-a8bc-234bd43301c6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:28.492656 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb723705-0870-45c3-b98d-100ac87dc08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:28.493723 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb723705-0870-45c3-b98d-100ac87dc08a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:28.494054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb723705-0870-45c3-b98d-100ac87dc08a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:28.494332 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb723705-0870-45c3-b98d-100ac87dc08a None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:28.495498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb723705-0870-45c3-b98d-100ac87dc08a None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:28.497088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb723705-0870-45c3-b98d-100ac87dc08a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:28.503222 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 56/124] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:28 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:28.503222 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb723705-0870-45c3-b98d-100ac87dc08a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:28.508298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17533a14-ec18-4368-a387-dbbf7bae1327 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:28.510045 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:28.546826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7630e-2870-4106-a4cc-6cbe19f0cfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:28.547711 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7630e-2870-4106-a4cc-6cbe19f0cfb6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:28.547996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7630e-2870-4106-a4cc-6cbe19f0cfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:28.548350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7630e-2870-4106-a4cc-6cbe19f0cfb6 None admin] PATH_INFO: `/v3/users/c914e346883841f097d6af0b1ee22e27` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:28.555701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:28.566159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7630e-2870-4106-a4cc-6cbe19f0cfb6 None admin] RBAC: Authorizing `identity:get_user(user_id=c914e346883841f097d6af0b1ee22e27)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:28.568437 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7630e-2870-4106-a4cc-6cbe19f0cfb6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:28.570181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 69/125] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:28 2022] GET /identity/v3/users/c914e346883841f097d6af0b1ee22e27 => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:28.571210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7630e-2870-4106-a4cc-6cbe19f0cfb6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:28.616877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb723705-0870-45c3-b98d-100ac87dc08a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:28.651375 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1199ab4-1d7a-444c-a309-b8ddee95eb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:28.652968 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1199ab4-1d7a-444c-a309-b8ddee95eb61 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:28.653448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1199ab4-1d7a-444c-a309-b8ddee95eb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:28.653864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1199ab4-1d7a-444c-a309-b8ddee95eb61 None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:28.655213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1199ab4-1d7a-444c-a309-b8ddee95eb61 None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:28.656844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1199ab4-1d7a-444c-a309-b8ddee95eb61 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:28.658692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 57/126] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:28 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:28.659601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1199ab4-1d7a-444c-a309-b8ddee95eb61 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:28.677149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7630e-2870-4106-a4cc-6cbe19f0cfb6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:28.716024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd80c51-96bd-4775-9062-73687fa1e710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:28.716939 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd80c51-96bd-4775-9062-73687fa1e710 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:28.717694 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd80c51-96bd-4775-9062-73687fa1e710 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:28.717978 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd80c51-96bd-4775-9062-73687fa1e710 None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:28.719180 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd80c51-96bd-4775-9062-73687fa1e710 None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:28.720662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd80c51-96bd-4775-9062-73687fa1e710 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:28.722351 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 70/127] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:28 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:28.723644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd80c51-96bd-4775-9062-73687fa1e710 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:28.753252 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:28.771944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1199ab4-1d7a-444c-a309-b8ddee95eb61 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:28.789895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:28.811126 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e42be-294d-4302-9b36-c0fc3f6d239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:28.811853 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e42be-294d-4302-9b36-c0fc3f6d239a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:28.812097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e42be-294d-4302-9b36-c0fc3f6d239a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:28.812409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e42be-294d-4302-9b36-c0fc3f6d239a None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:28.813198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e42be-294d-4302-9b36-c0fc3f6d239a None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:28.813464 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e42be-294d-4302-9b36-c0fc3f6d239a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:28.814861 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e42be-294d-4302-9b36-c0fc3f6d239a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:28.824504 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 58/128] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:28.829961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e42be-294d-4302-9b36-c0fc3f6d239a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:28.833579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd80c51-96bd-4775-9062-73687fa1e710 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:28.873931 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6026c-d78b-4a6f-9d42-b3cfb240978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:28.874847 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6026c-d78b-4a6f-9d42-b3cfb240978d None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:28.875129 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6026c-d78b-4a6f-9d42-b3cfb240978d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:28.875406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6026c-d78b-4a6f-9d42-b3cfb240978d None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45/users/39c896452be844fc919b8104a7db12a5/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:28.877511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6026c-d78b-4a6f-9d42-b3cfb240978d None admin] RBAC: Authorizing `identity:create_grant(project_id=c386c04bad694a429d89ba0a586c8a45, user_id=39c896452be844fc919b8104a7db12a5, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:28.879474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6026c-d78b-4a6f-9d42-b3cfb240978d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:28.896933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 71/129] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:04:28 2022] PUT /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45/users/39c896452be844fc919b8104a7db12a5/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:04:28.901169 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6026c-d78b-4a6f-9d42-b3cfb240978d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:28.970487 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e42be-294d-4302-9b36-c0fc3f6d239a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:29.007845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:29.024159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6026c-d78b-4a6f-9d42-b3cfb240978d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:29.028666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e133a-4eea-4917-a546-16c586dc9e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:29.029650 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e133a-4eea-4917-a546-16c586dc9e5c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:29.030137 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e133a-4eea-4917-a546-16c586dc9e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:29.030695 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e133a-4eea-4917-a546-16c586dc9e5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:29.064957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2701959-efa2-4a25-98f3-23d468d5a45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:29.065885 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2701959-efa2-4a25-98f3-23d468d5a45d None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:29.066176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2701959-efa2-4a25-98f3-23d468d5a45d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:29.067078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2701959-efa2-4a25-98f3-23d468d5a45d None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45/users/a7a1941bc6e143339ac7d433511016f2/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:29.069195 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2701959-efa2-4a25-98f3-23d468d5a45d None admin] RBAC: Authorizing `identity:create_grant(project_id=c386c04bad694a429d89ba0a586c8a45, user_id=a7a1941bc6e143339ac7d433511016f2, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:29.070701 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2701959-efa2-4a25-98f3-23d468d5a45d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:29.091222 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 72/130] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:04:28 2022] PUT /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45/users/a7a1941bc6e143339ac7d433511016f2/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:04:29.096176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2701959-efa2-4a25-98f3-23d468d5a45d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:29.111932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:29.141576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e133a-4eea-4917-a546-16c586dc9e5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:29.143158 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e133a-4eea-4917-a546-16c586dc9e5c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:29.222688 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2701959-efa2-4a25-98f3-23d468d5a45d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:29.265927 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 59/131] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:29.266952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e133a-4eea-4917-a546-16c586dc9e5c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:29.306419 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa97c1-4206-47b8-887a-20b0971f03ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:29.307352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa97c1-4206-47b8-887a-20b0971f03ce None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:29.307646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa97c1-4206-47b8-887a-20b0971f03ce None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:29.307932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa97c1-4206-47b8-887a-20b0971f03ce None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45/users/a7a1941bc6e143339ac7d433511016f2/roles/e4ade3cd570d4865b356cbe822b76fe9` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:29.315962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa97c1-4206-47b8-887a-20b0971f03ce None admin] RBAC: Authorizing `identity:create_grant(project_id=c386c04bad694a429d89ba0a586c8a45, user_id=a7a1941bc6e143339ac7d433511016f2, role_id=e4ade3cd570d4865b356cbe822b76fe9)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:29.317564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa97c1-4206-47b8-887a-20b0971f03ce None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:29.343784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 73/132] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:04:29 2022] PUT /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45/users/a7a1941bc6e143339ac7d433511016f2/roles/e4ade3cd570d4865b356cbe822b76fe9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:04:29.344470 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa97c1-4206-47b8-887a-20b0971f03ce None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:29.362035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:29.378848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:29.437944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e133a-4eea-4917-a546-16c586dc9e5c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:29.517250 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b7075-f78f-4e58-8498-4b286e8159c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:29.519066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b7075-f78f-4e58-8498-4b286e8159c0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:29.520102 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b7075-f78f-4e58-8498-4b286e8159c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:29.520727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b7075-f78f-4e58-8498-4b286e8159c0 None admin] PATH_INFO: `/v3/users/a7a1941bc6e143339ac7d433511016f2` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:29.523005 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b7075-f78f-4e58-8498-4b286e8159c0 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a1941bc6e143339ac7d433511016f2)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:29.524771 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b7075-f78f-4e58-8498-4b286e8159c0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:29.528092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 60/133] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:29 2022] GET /identity/v3/users/a7a1941bc6e143339ac7d433511016f2 => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:29.530731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8bbe8-5ba6-4c5d-8044-d00eabc571b5 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:29.531418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8bbe8-5ba6-4c5d-8044-d00eabc571b5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:29.534392 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8bbe8-5ba6-4c5d-8044-d00eabc571b5 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:29.537863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 61/134] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:29.538768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8bbe8-5ba6-4c5d-8044-d00eabc571b5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:29.560166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa97c1-4206-47b8-887a-20b0971f03ce None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:29.611734 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae3061-ae2b-4089-8b6c-2e803ce5e70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:29.613677 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3061-ae2b-4089-8b6c-2e803ce5e70b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:29.614424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3061-ae2b-4089-8b6c-2e803ce5e70b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:29.614869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3061-ae2b-4089-8b6c-2e803ce5e70b None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:29.617056 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae3061-ae2b-4089-8b6c-2e803ce5e70b None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:29.619379 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae3061-ae2b-4089-8b6c-2e803ce5e70b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:29.622145 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 74/135] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:29 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:29.623722 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de335-5193-4f07-b6df-03b8c7e828d6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:29.624435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de335-5193-4f07-b6df-03b8c7e828d6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:29.624758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de335-5193-4f07-b6df-03b8c7e828d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:29.650259 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bc2de335-5193-4f07-b6df-03b8c7e828d6 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:29.652119 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bc2de335-5193-4f07-b6df-03b8c7e828d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:29.679064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8bbe8-5ba6-4c5d-8044-d00eabc571b5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:29.760451 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 75/136] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:29.761795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de335-5193-4f07-b6df-03b8c7e828d6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:29.763801 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a249c-b785-49f3-a748-3d4ce5a3a348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:29.765158 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a249c-b785-49f3-a748-3d4ce5a3a348 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:29.765548 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a249c-b785-49f3-a748-3d4ce5a3a348 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:29.766191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a249c-b785-49f3-a748-3d4ce5a3a348 None admin] PATH_INFO: `/v3/projects/43908993317f49c5ab0f64ce116191d7` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:29.778224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a249c-b785-49f3-a748-3d4ce5a3a348 None admin] RBAC: Authorizing `identity:get_project(project_id=43908993317f49c5ab0f64ce116191d7)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:29.778224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a249c-b785-49f3-a748-3d4ce5a3a348 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:29.778224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 62/137] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:29 2022] GET /identity/v3/projects/43908993317f49c5ab0f64ce116191d7 => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:29.780629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:29.784840 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a249c-b785-49f3-a748-3d4ce5a3a348 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:29.826053 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:29.950501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de335-5193-4f07-b6df-03b8c7e828d6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:29.989100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcccf8-c4ed-4ec1-9a47-69b664f29d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:29.989783 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcccf8-c4ed-4ec1-9a47-69b664f29d74 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:29.990076 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcccf8-c4ed-4ec1-9a47-69b664f29d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:29.990357 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcccf8-c4ed-4ec1-9a47-69b664f29d74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:29.991190 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcccf8-c4ed-4ec1-9a47-69b664f29d74 None admin] RBAC: Adding query filter params (role.id=defadc42e7f7403fafbf9c95017e276f, scope.project.id=c386c04bad694a429d89ba0a586c8a45, user.id=c914e346883841f097d6af0b1ee22e27) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:29.991502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcccf8-c4ed-4ec1-9a47-69b664f29d74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:29.992989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcccf8-c4ed-4ec1-9a47-69b664f29d74 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:29.999227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 76/138] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:29 2022] GET /identity/v3/role_assignments?user.id=c914e346883841f097d6af0b1ee22e27&scope.project.id=c386c04bad694a429d89ba0a586c8a45&role.id=defadc42e7f7403fafbf9c95017e276f => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:29.999912 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcccf8-c4ed-4ec1-9a47-69b664f29d74 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:30.034948 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a249c-b785-49f3-a748-3d4ce5a3a348 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:30.134323 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58003d7-37a0-435c-bc12-b5044caa47fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:30.135277 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58003d7-37a0-435c-bc12-b5044caa47fb None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:30.135567 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58003d7-37a0-435c-bc12-b5044caa47fb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:30.135849 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58003d7-37a0-435c-bc12-b5044caa47fb None admin] PATH_INFO: `/v3/projects/43908993317f49c5ab0f64ce116191d7/users/a7a1941bc6e143339ac7d433511016f2/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:30.150945 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:30.153359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58003d7-37a0-435c-bc12-b5044caa47fb None admin] RBAC: Authorizing `identity:create_grant(project_id=43908993317f49c5ab0f64ce116191d7, user_id=a7a1941bc6e143339ac7d433511016f2, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:30.154965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58003d7-37a0-435c-bc12-b5044caa47fb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:30.190089 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 63/139] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:04:29 2022] PUT /identity/v3/projects/43908993317f49c5ab0f64ce116191d7/users/a7a1941bc6e143339ac7d433511016f2/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:04:30.204144 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcccf8-c4ed-4ec1-9a47-69b664f29d74 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:30.261921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47683aa2-6838-4447-9952-cc33e0846d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:30.262911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47683aa2-6838-4447-9952-cc33e0846d3a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:30.263300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47683aa2-6838-4447-9952-cc33e0846d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:30.263705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47683aa2-6838-4447-9952-cc33e0846d3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:30.267752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47683aa2-6838-4447-9952-cc33e0846d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:30.269538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47683aa2-6838-4447-9952-cc33e0846d3a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:30.271495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 77/140] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:30.277817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58003d7-37a0-435c-bc12-b5044caa47fb None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:30.395590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:30.427204 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58003d7-37a0-435c-bc12-b5044caa47fb None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:30.476682 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fde7d-f964-4a71-961f-9c47619954ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:30.477577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fde7d-f964-4a71-961f-9c47619954ef None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:30.478055 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fde7d-f964-4a71-961f-9c47619954ef None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:30.478410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fde7d-f964-4a71-961f-9c47619954ef None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:30.479220 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fde7d-f964-4a71-961f-9c47619954ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:30.480825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fde7d-f964-4a71-961f-9c47619954ef None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:30.505911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 64/141] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:04:30 2022] POST /identity/v3/users => generated 283 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:04:31.638210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd877b-a2a0-435b-8881-4c687bf02e0a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:31.638687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd877b-a2a0-435b-8881-4c687bf02e0a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:31.638687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd877b-a2a0-435b-8881-4c687bf02e0a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:31.640443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 78/142] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:31.646611 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748a020-48cc-4905-9de9-76930cadf0eb None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:31.647085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748a020-48cc-4905-9de9-76930cadf0eb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:31.647295 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748a020-48cc-4905-9de9-76930cadf0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:31.673946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c748a020-48cc-4905-9de9-76930cadf0eb None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:31.675193 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c748a020-48cc-4905-9de9-76930cadf0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:31.729779 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46bc8b-39a5-4663-a793-fc62e2a42f0c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:31.730075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46bc8b-39a5-4663-a793-fc62e2a42f0c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:31.730368 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46bc8b-39a5-4663-a793-fc62e2a42f0c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:31.731966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 79/143] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:04:31.737778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a2541-0a20-4014-996e-88d9ace35510 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:31.738466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a2541-0a20-4014-996e-88d9ace35510 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:31.738963 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a2541-0a20-4014-996e-88d9ace35510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:31.759552 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3f6a2541-0a20-4014-996e-88d9ace35510 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:31.761188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3f6a2541-0a20-4014-996e-88d9ace35510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:31.831203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 65/144] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:31.838222 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 80/145] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:31.861414 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748a020-48cc-4905-9de9-76930cadf0eb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:31.907124 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a2541-0a20-4014-996e-88d9ace35510 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:32.000533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:32.000720 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:32.041910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a2541-0a20-4014-996e-88d9ace35510 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:32.080368 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae15cb-6b49-4daf-b6c2-d3a2244149db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:32.081561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae15cb-6b49-4daf-b6c2-d3a2244149db None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:32.082108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae15cb-6b49-4daf-b6c2-d3a2244149db None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:32.082596 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae15cb-6b49-4daf-b6c2-d3a2244149db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:32.094804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae15cb-6b49-4daf-b6c2-d3a2244149db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:32.103342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-98ae15cb-6b49-4daf-b6c2-d3a2244149db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:32.103342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:32.103342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:32.103342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:32.103342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:32.103342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:32.103342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:32.103342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:32.103342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:32.103342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:32.103342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:32.103342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:32.103342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:32.103342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:32.103342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:32.103342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:32.104229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:32.104229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:32.104229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:32.104229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:32.104229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:32.104229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:32.104229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:32.104229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:32.104229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:32.104229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:32.104229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:32.104229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:32.104229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:32.104229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:32.104229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:32.104229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:32.104995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:32.104995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:32.104995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:32.104995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:32.104995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:32.104995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:32.104995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:32.104995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:32.104995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:32.104995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:32.104995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:32.104995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:32.107481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 81/146] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:04:32.121505 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae15cb-6b49-4daf-b6c2-d3a2244149db None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:32.130290 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748a020-48cc-4905-9de9-76930cadf0eb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:32.184312 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632cb2b-fc27-455b-8a6c-56836ccbdaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:32.185184 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632cb2b-fc27-455b-8a6c-56836ccbdaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:32.185466 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632cb2b-fc27-455b-8a6c-56836ccbdaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:32.185744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632cb2b-fc27-455b-8a6c-56836ccbdaf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:32.201054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632cb2b-fc27-455b-8a6c-56836ccbdaf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:32.212095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f632cb2b-fc27-455b-8a6c-56836ccbdaf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:32.212095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:32.212095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:32.212095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:32.212095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:32.212095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:32.212095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:32.212095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:32.212095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:32.212095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:32.212095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:32.212095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:32.212095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:32.212095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:32.212095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:32.212095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:32.213014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:32.213014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:32.213014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:32.213014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:32.213014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:32.213014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:32.213014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:32.213014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:32.213014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:32.213014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:32.213014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:32.213014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:32.213014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:32.213014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:32.213014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:32.213014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:32.213736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:32.213736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:32.213736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:32.213736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:32.213736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:32.213736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:32.213736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:32.213736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:32.213736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:32.213736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:32.213736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:32.213736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:32.213736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 66/147] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:04:32.223802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632cb2b-fc27-455b-8a6c-56836ccbdaf4 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:32.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae15cb-6b49-4daf-b6c2-d3a2244149db None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:32.343555 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:32.360326 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dff4e-6605-4039-9549-9d2373382655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:32.361026 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dff4e-6605-4039-9549-9d2373382655 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:32.361315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dff4e-6605-4039-9549-9d2373382655 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:32.361601 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dff4e-6605-4039-9549-9d2373382655 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:32.362478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dff4e-6605-4039-9549-9d2373382655 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:32.362795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dff4e-6605-4039-9549-9d2373382655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:32.364876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dff4e-6605-4039-9549-9d2373382655 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:32.369645 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632cb2b-fc27-455b-8a6c-56836ccbdaf4 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:32.386270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 82/148] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:32.392376 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dff4e-6605-4039-9549-9d2373382655 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:32.399513 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:32.433484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84955a09-097c-4721-9267-961762f1dcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:32.434192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84955a09-097c-4721-9267-961762f1dcaa None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:32.434533 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84955a09-097c-4721-9267-961762f1dcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:32.434756 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84955a09-097c-4721-9267-961762f1dcaa None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:32.435525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84955a09-097c-4721-9267-961762f1dcaa None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:32.435835 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84955a09-097c-4721-9267-961762f1dcaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:32.440310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84955a09-097c-4721-9267-961762f1dcaa None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:32.455759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 67/149] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:32.462172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84955a09-097c-4721-9267-961762f1dcaa None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:32.554487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dff4e-6605-4039-9549-9d2373382655 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:32.609061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e76e8-96bb-4872-ac0f-d326bb44329f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:32.609978 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e76e8-96bb-4872-ac0f-d326bb44329f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:32.610286 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e76e8-96bb-4872-ac0f-d326bb44329f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:32.610542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e76e8-96bb-4872-ac0f-d326bb44329f None admin] PATH_INFO: `/v3/users/39c896452be844fc919b8104a7db12a5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:32.611865 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e76e8-96bb-4872-ac0f-d326bb44329f None admin] RBAC: Authorizing `identity:get_user(user_id=39c896452be844fc919b8104a7db12a5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:32.613514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e76e8-96bb-4872-ac0f-d326bb44329f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:32.615261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 83/150] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:32 2022] GET /identity/v3/users/39c896452be844fc919b8104a7db12a5 => generated 247 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:32.616589 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1049c8-f835-40da-b87b-716aa89bdea0 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:32.616881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1049c8-f835-40da-b87b-716aa89bdea0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:32.617160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1049c8-f835-40da-b87b-716aa89bdea0 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:32.618487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 84/151] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:32.624190 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1049c8-f835-40da-b87b-716aa89bdea0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:32.719603 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:32.767281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84955a09-097c-4721-9267-961762f1dcaa None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:32.797287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1049c8-f835-40da-b87b-716aa89bdea0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:32.869020 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8641377-9d72-42df-ada2-5f11a0abbef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:32.869924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8641377-9d72-42df-ada2-5f11a0abbef3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:32.870211 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8641377-9d72-42df-ada2-5f11a0abbef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:32.870579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8641377-9d72-42df-ada2-5f11a0abbef3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:32.878461 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5406b6-67d3-4156-8be1-4dd262967228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:32.880004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5406b6-67d3-4156-8be1-4dd262967228 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:32.880313 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5406b6-67d3-4156-8be1-4dd262967228 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:32.880595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5406b6-67d3-4156-8be1-4dd262967228 None admin] PATH_INFO: `/v3/users/a7a1941bc6e143339ac7d433511016f2` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:32.885014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5406b6-67d3-4156-8be1-4dd262967228 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a1941bc6e143339ac7d433511016f2)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:32.886498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5406b6-67d3-4156-8be1-4dd262967228 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:32.888202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 68/152] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:32 2022] GET /identity/v3/users/a7a1941bc6e143339ac7d433511016f2 => generated 275 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:32.889455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d0e4e-a1d2-49f2-8632-09c0756d4fef None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:32.889746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d0e4e-a1d2-49f2-8632-09c0756d4fef None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:32.890026 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d0e4e-a1d2-49f2-8632-09c0756d4fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:32.941908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-5d1d0e4e-a1d2-49f2-8632-09c0756d4fef None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:32.943163 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5d1d0e4e-a1d2-49f2-8632-09c0756d4fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:32.958128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8641377-9d72-42df-ada2-5f11a0abbef3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:32.965872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8641377-9d72-42df-ada2-5f11a0abbef3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:33.051492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:33.051667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:33.117270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 85/153] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 16:04:33.118558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8641377-9d72-42df-ada2-5f11a0abbef3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:33.141930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 69/154] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:33.142611 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d0e4e-a1d2-49f2-8632-09c0756d4fef None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:33.310757 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8641377-9d72-42df-ada2-5f11a0abbef3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:33.372978 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd027e9-d2d9-42f9-9c03-45f003b8acf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:33.373886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd027e9-d2d9-42f9-9c03-45f003b8acf9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:33.374312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd027e9-d2d9-42f9-9c03-45f003b8acf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:33.374725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd027e9-d2d9-42f9-9c03-45f003b8acf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:33.422333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d0e4e-a1d2-49f2-8632-09c0756d4fef None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:33.428697 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:33.480238 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd027e9-d2d9-42f9-9c03-45f003b8acf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:33.485947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd027e9-d2d9-42f9-9c03-45f003b8acf9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:33.525042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd8355-6be7-4840-b7f2-d40ef2f752e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:33.525951 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd8355-6be7-4840-b7f2-d40ef2f752e3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:33.526236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd8355-6be7-4840-b7f2-d40ef2f752e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:33.526773 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd8355-6be7-4840-b7f2-d40ef2f752e3 None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:33.533146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd8355-6be7-4840-b7f2-d40ef2f752e3 None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:33.534710 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd8355-6be7-4840-b7f2-d40ef2f752e3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:33.537348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 70/155] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:33 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:33.538217 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd8355-6be7-4840-b7f2-d40ef2f752e3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:33.636724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:33.670456 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 86/156] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:33.671628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13c253-b930-4efa-9fa4-78db009b74b5 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:33.671921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13c253-b930-4efa-9fa4-78db009b74b5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:33.672197 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13c253-b930-4efa-9fa4-78db009b74b5 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:33.681940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 87/157] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:33 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:33.682632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13c253-b930-4efa-9fa4-78db009b74b5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:33.747974 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd8355-6be7-4840-b7f2-d40ef2f752e3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:33.770205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:33.848445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54de464-f043-46d3-b0b5-47183bb25da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:33.849958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54de464-f043-46d3-b0b5-47183bb25da2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:33.850562 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54de464-f043-46d3-b0b5-47183bb25da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:33.850985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54de464-f043-46d3-b0b5-47183bb25da2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:33.858217 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13c253-b930-4efa-9fa4-78db009b74b5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:33.881133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54de464-f043-46d3-b0b5-47183bb25da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:33.894993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-b54de464-f043-46d3-b0b5-47183bb25da2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:04:33.894993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:33.894993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:33.894993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:33.894993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:33.894993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:33.894993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:33.894993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:33.894993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:33.894993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:33.894993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:33.894993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:33.894993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:33.894993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:33.894993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:33.894993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:33.896113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:33.896113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:33.896113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:33.896113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:33.896113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:33.896113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:33.896113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:33.896113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:33.896113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:33.896113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:33.896113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:33.896113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:33.896113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:33.896113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:33.896113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:33.896113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:33.897020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:33.897020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:33.897020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:33.897020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:33.897020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:33.897020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:33.897020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:33.897020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:33.897020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:33.897020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:33.897020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:04:33.897020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:33.899233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 71/158] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:04:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:33.900188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54de464-f043-46d3-b0b5-47183bb25da2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:33.941740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4327c92-f285-4961-b798-2337fcdefadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:33.942416 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4327c92-f285-4961-b798-2337fcdefadb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:33.942844 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4327c92-f285-4961-b798-2337fcdefadb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:33.943156 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4327c92-f285-4961-b798-2337fcdefadb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:33.944338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4327c92-f285-4961-b798-2337fcdefadb None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=c386c04bad694a429d89ba0a586c8a45, user.id=39c896452be844fc919b8104a7db12a5) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:33.944657 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4327c92-f285-4961-b798-2337fcdefadb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:33.946421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4327c92-f285-4961-b798-2337fcdefadb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:33.957834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 88/159] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:33 2022] GET /identity/v3/role_assignments?user.id=39c896452be844fc919b8104a7db12a5&scope.project.id=c386c04bad694a429d89ba0a586c8a45&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:33.960345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe0c7f-8610-4351-b04a-9f1b39de0449 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:33.963020 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe0c7f-8610-4351-b04a-9f1b39de0449 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:33.964308 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe0c7f-8610-4351-b04a-9f1b39de0449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:33.995538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3ffe0c7f-8610-4351-b04a-9f1b39de0449 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:33.997127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3ffe0c7f-8610-4351-b04a-9f1b39de0449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:34.122538 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54de464-f043-46d3-b0b5-47183bb25da2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:34.142191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:34.145670 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 89/160] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:34.146777 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe0c7f-8610-4351-b04a-9f1b39de0449 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:34.200286 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21d9b0-bfe3-4fec-bcd4-e01e5f988aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:34.201709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21d9b0-bfe3-4fec-bcd4-e01e5f988aac None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:34.202914 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21d9b0-bfe3-4fec-bcd4-e01e5f988aac None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:34.203959 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21d9b0-bfe3-4fec-bcd4-e01e5f988aac None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:34.207423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21d9b0-bfe3-4fec-bcd4-e01e5f988aac None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:34.209136 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21d9b0-bfe3-4fec-bcd4-e01e5f988aac None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:34.211419 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 72/161] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:33 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:34.213790 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b2c33-fd92-47c2-829b-9574ec75e26c None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:34.218242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b2c33-fd92-47c2-829b-9574ec75e26c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:34.218764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b2c33-fd92-47c2-829b-9574ec75e26c None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:34.226053 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 73/162] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:34 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:34.229058 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b2c33-fd92-47c2-829b-9574ec75e26c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:34.259493 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:34.349359 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe0c7f-8610-4351-b04a-9f1b39de0449 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:34.391003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6918c5-b8e6-452b-b5d3-0b167a9b7544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:34.391705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6918c5-b8e6-452b-b5d3-0b167a9b7544 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:34.391994 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6918c5-b8e6-452b-b5d3-0b167a9b7544 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:34.392287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6918c5-b8e6-452b-b5d3-0b167a9b7544 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:34.393069 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6918c5-b8e6-452b-b5d3-0b167a9b7544 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:34.393375 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6918c5-b8e6-452b-b5d3-0b167a9b7544 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:34.395641 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6918c5-b8e6-452b-b5d3-0b167a9b7544 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:34.406517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 90/163] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:04:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:34.407490 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6918c5-b8e6-452b-b5d3-0b167a9b7544 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:34.445993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b2c33-fd92-47c2-829b-9574ec75e26c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:34.524172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd82cb7-645e-4272-b435-4f65ad408cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:34.525198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd82cb7-645e-4272-b435-4f65ad408cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:34.525482 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd82cb7-645e-4272-b435-4f65ad408cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:34.525749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd82cb7-645e-4272-b435-4f65ad408cb0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:34.549912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd82cb7-645e-4272-b435-4f65ad408cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:34.565068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6918c5-b8e6-452b-b5d3-0b167a9b7544 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:34.568014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-2cd82cb7-645e-4272-b435-4f65ad408cb0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:34.568014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:34.568014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:34.568014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:34.568014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:34.568014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:34.568014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:34.568014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:34.568014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:34.568014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:34.568014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:34.568014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:34.568014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:34.568014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:34.568014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:34.568014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:34.568879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:34.568879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:34.568879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:34.568879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:34.568879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:34.568879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:34.568879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:34.568879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:34.568879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:34.568879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:34.568879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:34.568879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:34.568879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:34.568879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:34.568879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:34.568879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:34.569639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:34.569639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:34.569639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:34.569639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:34.569639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:34.569639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:34.569639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:34.569639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:34.569639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:34.569639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:34.569639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:34.569639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:34.569639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 74/164] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:34.571070 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfa7f0-c91b-49f0-b2b1-320a6ef476be None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:34.571070 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfa7f0-c91b-49f0-b2b1-320a6ef476be None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:34.571313 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfa7f0-c91b-49f0-b2b1-320a6ef476be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:34.591738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:34.609217 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a6bfa7f0-c91b-49f0-b2b1-320a6ef476be None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:34.610401 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a6bfa7f0-c91b-49f0-b2b1-320a6ef476be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:34.631361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c2217-3356-4f09-bd21-00cbd9f1f481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:34.632034 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c2217-3356-4f09-bd21-00cbd9f1f481 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:34.632342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c2217-3356-4f09-bd21-00cbd9f1f481 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:34.632619 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c2217-3356-4f09-bd21-00cbd9f1f481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:34.633452 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c2217-3356-4f09-bd21-00cbd9f1f481 None admin] RBAC: Adding query filter params (role.id=6a0b49157bc649ef99e870c62ee6f4fe, scope.project.id=c386c04bad694a429d89ba0a586c8a45, user.id=a7a1941bc6e143339ac7d433511016f2) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:34.633765 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c2217-3356-4f09-bd21-00cbd9f1f481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:34.635200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c2217-3356-4f09-bd21-00cbd9f1f481 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:34.649454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 91/165] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:34 2022] GET /identity/v3/role_assignments?user.id=a7a1941bc6e143339ac7d433511016f2&scope.project.id=c386c04bad694a429d89ba0a586c8a45&role.id=6a0b49157bc649ef99e870c62ee6f4fe => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:34.650122 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c2217-3356-4f09-bd21-00cbd9f1f481 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:34.676430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:34.775397 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 75/166] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:34.776306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfa7f0-c91b-49f0-b2b1-320a6ef476be None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:34.836572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c2217-3356-4f09-bd21-00cbd9f1f481 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:34.885795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b951c-f1cc-47b2-9900-52a864b2fbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:34.886897 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b951c-f1cc-47b2-9900-52a864b2fbea None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:34.887151 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b951c-f1cc-47b2-9900-52a864b2fbea None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:34.887740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b951c-f1cc-47b2-9900-52a864b2fbea None admin] PATH_INFO: `/v3/users/a7a1941bc6e143339ac7d433511016f2` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:34.889041 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b951c-f1cc-47b2-9900-52a864b2fbea None admin] RBAC: Authorizing `identity:get_user(user_id=a7a1941bc6e143339ac7d433511016f2)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:34.890963 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b951c-f1cc-47b2-9900-52a864b2fbea None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:34.893000 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 92/167] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:34 2022] GET /identity/v3/users/a7a1941bc6e143339ac7d433511016f2 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:34.895130 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03421b6f-eb70-425b-91ce-63171c123d66 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:34.896130 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03421b6f-eb70-425b-91ce-63171c123d66 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:34.896870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03421b6f-eb70-425b-91ce-63171c123d66 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:34.900302 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 93/168] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:34.901299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03421b6f-eb70-425b-91ce-63171c123d66 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:34.970218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfa7f0-c91b-49f0-b2b1-320a6ef476be None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:34.972593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:35.010725 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c3e6a-d07e-46c2-83e9-f25a235b176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:35.011502 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c3e6a-d07e-46c2-83e9-f25a235b176d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:35.011996 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c3e6a-d07e-46c2-83e9-f25a235b176d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:35.012426 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c3e6a-d07e-46c2-83e9-f25a235b176d None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:35.013289 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c3e6a-d07e-46c2-83e9-f25a235b176d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:35.013649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c3e6a-d07e-46c2-83e9-f25a235b176d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:35.016210 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c3e6a-d07e-46c2-83e9-f25a235b176d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:35.027270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 76/169] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:35.028237 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c3e6a-d07e-46c2-83e9-f25a235b176d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:35.040102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03421b6f-eb70-425b-91ce-63171c123d66 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:35.065726 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:35.091762 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08ccf4-86d2-48d1-af4f-ad51f2f43874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:35.092637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08ccf4-86d2-48d1-af4f-ad51f2f43874 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:35.092919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08ccf4-86d2-48d1-af4f-ad51f2f43874 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:35.093198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08ccf4-86d2-48d1-af4f-ad51f2f43874 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:35.107598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08ccf4-86d2-48d1-af4f-ad51f2f43874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:35.116290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-7b08ccf4-86d2-48d1-af4f-ad51f2f43874 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:35.116290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:35.116290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:35.116290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:35.116290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:35.116290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:35.116290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:35.116290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:35.116290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:35.116290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:35.116290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:35.116290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:35.116290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:35.116290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:35.116290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:35.116290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:35.117192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:35.117192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:35.117192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:35.117192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:35.117192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:35.117192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:35.117192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:35.117192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:35.117192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:35.117192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:35.117192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:35.117192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:35.117192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:35.117192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:35.117192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:35.117192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:35.118417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:35.118417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:35.118417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:35.118417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:35.118417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:35.118417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:35.118417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:35.118417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:35.118417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:35.118417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:35.118417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:35.118417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:35.118417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 94/170] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:35.119043 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b78c9-71b7-44ed-9515-370e9bc8143e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:35.119107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b78c9-71b7-44ed-9515-370e9bc8143e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:35.119430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b78c9-71b7-44ed-9515-370e9bc8143e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:35.143536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-309b78c9-71b7-44ed-9515-370e9bc8143e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:35.145324 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-309b78c9-71b7-44ed-9515-370e9bc8143e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:35.157767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c3e6a-d07e-46c2-83e9-f25a235b176d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:35.203291 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc4b13-7b9f-48b5-9c81-5227c0b3ec06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:35.204121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4b13-7b9f-48b5-9c81-5227c0b3ec06 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:35.204545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4b13-7b9f-48b5-9c81-5227c0b3ec06 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:35.204955 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4b13-7b9f-48b5-9c81-5227c0b3ec06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:35.242622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 95/171] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:35.243815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b78c9-71b7-44ed-9515-370e9bc8143e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:35.284037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:35.310856 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc4b13-7b9f-48b5-9c81-5227c0b3ec06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:35.312534 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc4b13-7b9f-48b5-9c81-5227c0b3ec06 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:35.350116 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:35.384828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b78c9-71b7-44ed-9515-370e9bc8143e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:35.430205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29750b-c9b2-4de7-9923-acbdc3347cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:35.431186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29750b-c9b2-4de7-9923-acbdc3347cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:35.431570 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29750b-c9b2-4de7-9923-acbdc3347cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:35.431893 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29750b-c9b2-4de7-9923-acbdc3347cc6 None admin] PATH_INFO: `/v3/users/c914e346883841f097d6af0b1ee22e27` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:35.433145 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29750b-c9b2-4de7-9923-acbdc3347cc6 None admin] RBAC: Authorizing `identity:get_user(user_id=c914e346883841f097d6af0b1ee22e27)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:35.434552 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29750b-c9b2-4de7-9923-acbdc3347cc6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:35.436373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 96/172] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:35 2022] GET /identity/v3/users/c914e346883841f097d6af0b1ee22e27 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:35.441651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 77/173] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:35.442034 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29750b-c9b2-4de7-9923-acbdc3347cc6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:35.442124 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc4b13-7b9f-48b5-9c81-5227c0b3ec06 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:35.538789 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc4b13-7b9f-48b5-9c81-5227c0b3ec06 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:35.540033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29750b-c9b2-4de7-9923-acbdc3347cc6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:35.542331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:35.564631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:35.573371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c2c9a-5477-4dfb-8266-c4deedaa11a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:35.574160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c2c9a-5477-4dfb-8266-c4deedaa11a6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:35.574443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c2c9a-5477-4dfb-8266-c4deedaa11a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:35.574708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c2c9a-5477-4dfb-8266-c4deedaa11a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:35.574954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de57b78-3fe9-406b-a775-30ca4f55d894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:35.575637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de57b78-3fe9-406b-a775-30ca4f55d894 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:35.575922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de57b78-3fe9-406b-a775-30ca4f55d894 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:35.576197 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de57b78-3fe9-406b-a775-30ca4f55d894 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:35.577440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de57b78-3fe9-406b-a775-30ca4f55d894 None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:35.577757 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de57b78-3fe9-406b-a775-30ca4f55d894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:35.579140 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de57b78-3fe9-406b-a775-30ca4f55d894 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:35.585751 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c2c9a-5477-4dfb-8266-c4deedaa11a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:35.588133 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 97/174] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:35.593087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7474079-0c08-4792-a50e-5617c00992d3 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:35.593087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7474079-0c08-4792-a50e-5617c00992d3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:35.593087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7474079-0c08-4792-a50e-5617c00992d3 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:35.593087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 98/175] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:35.593087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7474079-0c08-4792-a50e-5617c00992d3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:35.593738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-aa3c2c9a-5477-4dfb-8266-c4deedaa11a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:35.593738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:35.593738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:35.593738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:35.593738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:35.593738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:35.593738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:35.593738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:35.593738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:35.593738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:35.593738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:35.593738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:35.593738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:35.593738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:35.593738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:35.593738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:35.594552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:35.594552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:35.594552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:35.594552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:35.594552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:35.594552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:35.594552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:35.594552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:35.594552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:35.594552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:35.594552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:35.594552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:35.594552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:35.594552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:35.594552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:35.594552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:35.595827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:35.595827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:35.595827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:35.595827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:35.595827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:35.595827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:35.595827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:35.595827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:35.595827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:35.595827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:35.595827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:35.595827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:35.596624 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 78/176] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:04:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:35.597354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c2c9a-5477-4dfb-8266-c4deedaa11a6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:35.695630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c2c9a-5477-4dfb-8266-c4deedaa11a6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:35.697637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7474079-0c08-4792-a50e-5617c00992d3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:35.729406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197c8fc-cd81-4b53-bfaf-2db2592b2cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:35.730374 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197c8fc-cd81-4b53-bfaf-2db2592b2cfa None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:35.730755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197c8fc-cd81-4b53-bfaf-2db2592b2cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:35.731028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197c8fc-cd81-4b53-bfaf-2db2592b2cfa None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:35.731277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1adebd-3051-4406-8dc6-b5d38a9e88d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:35.732148 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1adebd-3051-4406-8dc6-b5d38a9e88d3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:35.732245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197c8fc-cd81-4b53-bfaf-2db2592b2cfa None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:35.732460 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1adebd-3051-4406-8dc6-b5d38a9e88d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:35.732741 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1adebd-3051-4406-8dc6-b5d38a9e88d3 None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:35.733722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197c8fc-cd81-4b53-bfaf-2db2592b2cfa None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:35.733940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1adebd-3051-4406-8dc6-b5d38a9e88d3 None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:35.735626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1adebd-3051-4406-8dc6-b5d38a9e88d3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:35.735752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 79/177] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:35 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:35.736703 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dbc95-2ad8-4bc0-9af8-d0e342ca5527 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:35.736990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dbc95-2ad8-4bc0-9af8-d0e342ca5527 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:35.737102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 99/178] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:35 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:35.737439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27dbc95-2ad8-4bc0-9af8-d0e342ca5527 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:35.737864 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1adebd-3051-4406-8dc6-b5d38a9e88d3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:35.738803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 80/179] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:35.743657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caadc0-1a61-4d4c-9cc5-d46708006d1c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:35.743946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caadc0-1a61-4d4c-9cc5-d46708006d1c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:35.744221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1caadc0-1a61-4d4c-9cc5-d46708006d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:35.762072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-f1caadc0-1a61-4d4c-9cc5-d46708006d1c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:35.763263 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f1caadc0-1a61-4d4c-9cc5-d46708006d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:35.777571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:35.813736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:35.830893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 81/180] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:35.831528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1caadc0-1a61-4d4c-9cc5-d46708006d1c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:35.853558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1adebd-3051-4406-8dc6-b5d38a9e88d3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:35.889092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0698e7d-a42d-4a0b-aaa3-ea4d32a142c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:35.889986 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0698e7d-a42d-4a0b-aaa3-ea4d32a142c7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:35.890272 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0698e7d-a42d-4a0b-aaa3-ea4d32a142c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:35.890548 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0698e7d-a42d-4a0b-aaa3-ea4d32a142c7 None admin] PATH_INFO: `/v3/users/a7a1941bc6e143339ac7d433511016f2` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:35.891751 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0698e7d-a42d-4a0b-aaa3-ea4d32a142c7 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a1941bc6e143339ac7d433511016f2)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:35.893226 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0698e7d-a42d-4a0b-aaa3-ea4d32a142c7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:35.895530 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 100/181] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:35 2022] GET /identity/v3/users/a7a1941bc6e143339ac7d433511016f2 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:35.896646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137062bd-849b-44b3-8e0b-acd53272d47c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:35.896938 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137062bd-849b-44b3-8e0b-acd53272d47c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:35.897189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137062bd-849b-44b3-8e0b-acd53272d47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:35.915396 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-137062bd-849b-44b3-8e0b-acd53272d47c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:35.916650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-137062bd-849b-44b3-8e0b-acd53272d47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:35.939798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1caadc0-1a61-4d4c-9cc5-d46708006d1c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:35.973488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5e065-14dd-4eb4-8bb6-b47404d13937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:35.974438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5e065-14dd-4eb4-8bb6-b47404d13937 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:35.974732 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5e065-14dd-4eb4-8bb6-b47404d13937 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:35.975010 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5e065-14dd-4eb4-8bb6-b47404d13937 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:35.975755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5e065-14dd-4eb4-8bb6-b47404d13937 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:35.976066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5e065-14dd-4eb4-8bb6-b47404d13937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:35.977581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5e065-14dd-4eb4-8bb6-b47404d13937 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:35.983706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 101/182] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:35.994232 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137062bd-849b-44b3-8e0b-acd53272d47c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:35.996689 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 82/183] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:35.997522 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5e065-14dd-4eb4-8bb6-b47404d13937 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:36.020811 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:36.047153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:36.090825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137062bd-849b-44b3-8e0b-acd53272d47c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:36.099091 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5e065-14dd-4eb4-8bb6-b47404d13937 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:36.125685 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b34f7-0e02-4bea-9f92-8c2d88e7c2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:36.126581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b34f7-0e02-4bea-9f92-8c2d88e7c2e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:36.126868 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b34f7-0e02-4bea-9f92-8c2d88e7c2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:36.127147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b34f7-0e02-4bea-9f92-8c2d88e7c2e6 None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45/users/c914e346883841f097d6af0b1ee22e27/roles/defadc42e7f7403fafbf9c95017e276f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:36.129195 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b34f7-0e02-4bea-9f92-8c2d88e7c2e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c386c04bad694a429d89ba0a586c8a45, user_id=c914e346883841f097d6af0b1ee22e27, role_id=defadc42e7f7403fafbf9c95017e276f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:36.130643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b34f7-0e02-4bea-9f92-8c2d88e7c2e6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:36.133511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bc5f3-2101-420d-8ed9-4ba647fa1dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:36.134168 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bc5f3-2101-420d-8ed9-4ba647fa1dde None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:36.134451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bc5f3-2101-420d-8ed9-4ba647fa1dde None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:36.134723 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bc5f3-2101-420d-8ed9-4ba647fa1dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:36.135794 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bc5f3-2101-420d-8ed9-4ba647fa1dde None admin] RBAC: Adding query filter params (role.id=e4ade3cd570d4865b356cbe822b76fe9, scope.project.id=c386c04bad694a429d89ba0a586c8a45, user.id=a7a1941bc6e143339ac7d433511016f2) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:36.136139 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bc5f3-2101-420d-8ed9-4ba647fa1dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:36.137768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bc5f3-2101-420d-8ed9-4ba647fa1dde None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:36.143628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 102/184] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:04:35 2022] PUT /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45/users/c914e346883841f097d6af0b1ee22e27/roles/defadc42e7f7403fafbf9c95017e276f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:04:36.156333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 83/185] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:35 2022] GET /identity/v3/role_assignments?user.id=a7a1941bc6e143339ac7d433511016f2&scope.project.id=c386c04bad694a429d89ba0a586c8a45&role.id=e4ade3cd570d4865b356cbe822b76fe9 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:36.156333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bc5f3-2101-420d-8ed9-4ba647fa1dde None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:36.157266 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b34f7-0e02-4bea-9f92-8c2d88e7c2e6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:36.303261 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bc5f3-2101-420d-8ed9-4ba647fa1dde None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:36.306957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:36.325325 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b34f7-0e02-4bea-9f92-8c2d88e7c2e6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:36.326678 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:36.355223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8da8c-1f5a-4d33-a0cc-f5872ea237c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:36.356188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8da8c-1f5a-4d33-a0cc-f5872ea237c1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:36.356542 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8da8c-1f5a-4d33-a0cc-f5872ea237c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:36.356910 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8da8c-1f5a-4d33-a0cc-f5872ea237c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:36.365157 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a7cb0-620f-43a9-886f-645a84cd48c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:36.365988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a7cb0-620f-43a9-886f-645a84cd48c9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:36.366274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a7cb0-620f-43a9-886f-645a84cd48c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:36.366848 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a7cb0-620f-43a9-886f-645a84cd48c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:36.382382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a7cb0-620f-43a9-886f-645a84cd48c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:36.392382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c21a7cb0-620f-43a9-886f-645a84cd48c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:04:36.392382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:36.392382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:36.392382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:36.392382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:36.392382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:36.392382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:36.392382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:36.392382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:36.392382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:36.392382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:36.392382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:36.392382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:36.392382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:36.392382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:36.392382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:36.394088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:36.394088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:36.394088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:36.394088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:36.394088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:36.394088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:36.394088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:36.394088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:36.394088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:36.394088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:36.394088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:36.394088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:36.394088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:36.394088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:36.394088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:36.394088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:36.397149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:36.397149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:36.397149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:36.397149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:36.397149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:36.397149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:36.397149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:36.397149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:36.397149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:36.397149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:36.397149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:04:36.397149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:36.397149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 103/186] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:04:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:36.397149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a7cb0-620f-43a9-886f-645a84cd48c9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:36.449376 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8da8c-1f5a-4d33-a0cc-f5872ea237c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:36.450970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8da8c-1f5a-4d33-a0cc-f5872ea237c1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:36.540580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a7cb0-620f-43a9-886f-645a84cd48c9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:36.567300 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 84/187] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:36.568106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8da8c-1f5a-4d33-a0cc-f5872ea237c1 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:36.583860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503d3f9-77ac-4f6e-b8ed-65d0c17f6422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:36.584631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:36.584832 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503d3f9-77ac-4f6e-b8ed-65d0c17f6422 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:36.585069 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503d3f9-77ac-4f6e-b8ed-65d0c17f6422 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:36.585352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503d3f9-77ac-4f6e-b8ed-65d0c17f6422 None admin] PATH_INFO: `/v3/users/ae21c20424254f9faf6bdca3fdf1d49c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:36.600723 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503d3f9-77ac-4f6e-b8ed-65d0c17f6422 None admin] RBAC: Authorizing `identity:get_user(user_id=ae21c20424254f9faf6bdca3fdf1d49c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:36.602194 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503d3f9-77ac-4f6e-b8ed-65d0c17f6422 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:36.603916 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 104/188] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:36 2022] GET /identity/v3/users/ae21c20424254f9faf6bdca3fdf1d49c => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:36.604741 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503d3f9-77ac-4f6e-b8ed-65d0c17f6422 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:36.618314 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:36.683563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8da8c-1f5a-4d33-a0cc-f5872ea237c1 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:36.714338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503d3f9-77ac-4f6e-b8ed-65d0c17f6422 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:36.728232 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240943e-6ce8-4187-b342-f0b3e532b9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:36.729058 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240943e-6ce8-4187-b342-f0b3e532b9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:36.729344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240943e-6ce8-4187-b342-f0b3e532b9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:36.729722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240943e-6ce8-4187-b342-f0b3e532b9e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:36.730956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240943e-6ce8-4187-b342-f0b3e532b9e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:36.732433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240943e-6ce8-4187-b342-f0b3e532b9e5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:36.734059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 85/189] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:36.738892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240943e-6ce8-4187-b342-f0b3e532b9e5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:36.755322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d817895-9e11-459c-b5ea-67925ac7ab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:36.756149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d817895-9e11-459c-b5ea-67925ac7ab75 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:36.756462 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d817895-9e11-459c-b5ea-67925ac7ab75 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:36.757017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d817895-9e11-459c-b5ea-67925ac7ab75 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:36.757766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d817895-9e11-459c-b5ea-67925ac7ab75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:36.758074 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d817895-9e11-459c-b5ea-67925ac7ab75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:36.759836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d817895-9e11-459c-b5ea-67925ac7ab75 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:36.772404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 105/190] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:04:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:36.773257 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d817895-9e11-459c-b5ea-67925ac7ab75 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:36.825998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:36.848416 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240943e-6ce8-4187-b342-f0b3e532b9e5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:36.853711 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:36.889068 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3ac40-8138-4c92-b590-647e7d1e010c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:36.889852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3ac40-8138-4c92-b590-647e7d1e010c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:36.890161 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3ac40-8138-4c92-b590-647e7d1e010c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:36.890434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3ac40-8138-4c92-b590-647e7d1e010c None admin] PATH_INFO: `/v3/projects/43908993317f49c5ab0f64ce116191d7` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:36.891743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3ac40-8138-4c92-b590-647e7d1e010c None admin] RBAC: Authorizing `identity:get_project(project_id=43908993317f49c5ab0f64ce116191d7)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:36.892808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d817895-9e11-459c-b5ea-67925ac7ab75 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:36.893427 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3ac40-8138-4c92-b590-647e7d1e010c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:36.897077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 86/191] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:36 2022] GET /identity/v3/projects/43908993317f49c5ab0f64ce116191d7 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:36.903006 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3ac40-8138-4c92-b590-647e7d1e010c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:36.931292 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08006d80-b892-43f5-9a12-32973811a94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:36.932002 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08006d80-b892-43f5-9a12-32973811a94e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:36.932687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08006d80-b892-43f5-9a12-32973811a94e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:36.932977 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08006d80-b892-43f5-9a12-32973811a94e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:37.004759 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08006d80-b892-43f5-9a12-32973811a94e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:37.006258 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08006d80-b892-43f5-9a12-32973811a94e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:37.007949 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3ac40-8138-4c92-b590-647e7d1e010c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:37.045459 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a755b0-74a5-4230-b771-2aa175e40e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:37.046242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a755b0-74a5-4230-b771-2aa175e40e48 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:37.046526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a755b0-74a5-4230-b771-2aa175e40e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:37.046807 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a755b0-74a5-4230-b771-2aa175e40e48 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:37.047587 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a755b0-74a5-4230-b771-2aa175e40e48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:37.049117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a755b0-74a5-4230-b771-2aa175e40e48 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:37.075748 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 87/192] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:04:36 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:04:37.081305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a755b0-74a5-4230-b771-2aa175e40e48 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:37.088227 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:37.110203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:37.158563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 106/193] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:37.159569 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08006d80-b892-43f5-9a12-32973811a94e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:37.201706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a755b0-74a5-4230-b771-2aa175e40e48 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:37.241336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80797b29-7496-432e-9f69-8b1df86fcd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:37.241945 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80797b29-7496-432e-9f69-8b1df86fcd1a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:37.242227 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80797b29-7496-432e-9f69-8b1df86fcd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:37.242499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80797b29-7496-432e-9f69-8b1df86fcd1a None admin] PATH_INFO: `/v3/users/ae21c20424254f9faf6bdca3fdf1d49c` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:37.243785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80797b29-7496-432e-9f69-8b1df86fcd1a None admin] RBAC: Authorizing `identity:get_user(user_id=ae21c20424254f9faf6bdca3fdf1d49c)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:37.245314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80797b29-7496-432e-9f69-8b1df86fcd1a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:37.247154 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 88/194] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:37 2022] GET /identity/v3/users/ae21c20424254f9faf6bdca3fdf1d49c => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:37.247804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80797b29-7496-432e-9f69-8b1df86fcd1a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:37.310566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08006d80-b892-43f5-9a12-32973811a94e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:37.355578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:37.365871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813c5fd-8805-4ccc-a40b-5eeb974e3ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:37.367221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813c5fd-8805-4ccc-a40b-5eeb974e3ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:37.367601 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813c5fd-8805-4ccc-a40b-5eeb974e3ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:37.367893 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813c5fd-8805-4ccc-a40b-5eeb974e3ac9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:37.368769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813c5fd-8805-4ccc-a40b-5eeb974e3ac9 None admin] RBAC: Adding query filter params (role.id=6a0b49157bc649ef99e870c62ee6f4fe, scope.project.id=43908993317f49c5ab0f64ce116191d7, user.id=a7a1941bc6e143339ac7d433511016f2) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:37.369085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813c5fd-8805-4ccc-a40b-5eeb974e3ac9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:37.371691 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813c5fd-8805-4ccc-a40b-5eeb974e3ac9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:37.379561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 107/195] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:37 2022] GET /identity/v3/role_assignments?user.id=a7a1941bc6e143339ac7d433511016f2&scope.project.id=43908993317f49c5ab0f64ce116191d7&role.id=6a0b49157bc649ef99e870c62ee6f4fe => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:37.380239 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813c5fd-8805-4ccc-a40b-5eeb974e3ac9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:37.395369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80797b29-7496-432e-9f69-8b1df86fcd1a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:37.438537 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:37.456119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31d879-93e4-40d0-83cd-1f882bb647c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:37.457593 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31d879-93e4-40d0-83cd-1f882bb647c9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:37.457880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31d879-93e4-40d0-83cd-1f882bb647c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:37.458499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31d879-93e4-40d0-83cd-1f882bb647c9 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:37.459485 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31d879-93e4-40d0-83cd-1f882bb647c9 None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:37.461015 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31d879-93e4-40d0-83cd-1f882bb647c9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:37.462877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 89/196] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:37 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:37.474752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31d879-93e4-40d0-83cd-1f882bb647c9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:37.520743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813c5fd-8805-4ccc-a40b-5eeb974e3ac9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:37.559933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa2706-0219-49e7-90c0-7954aa5de972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:37.560650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa2706-0219-49e7-90c0-7954aa5de972 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:37.560940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa2706-0219-49e7-90c0-7954aa5de972 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:37.561219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa2706-0219-49e7-90c0-7954aa5de972 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:37.623906 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31d879-93e4-40d0-83cd-1f882bb647c9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:37.642540 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa2706-0219-49e7-90c0-7954aa5de972 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:37.644028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa2706-0219-49e7-90c0-7954aa5de972 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:37.665904 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364c2bc-45dc-41a9-a805-2218e44899ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:37.667072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364c2bc-45dc-41a9-a805-2218e44899ca None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:37.667500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364c2bc-45dc-41a9-a805-2218e44899ca None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:37.667797 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364c2bc-45dc-41a9-a805-2218e44899ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:37.668798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364c2bc-45dc-41a9-a805-2218e44899ca None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0, user.id=ae21c20424254f9faf6bdca3fdf1d49c) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:37.669118 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364c2bc-45dc-41a9-a805-2218e44899ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:37.670846 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364c2bc-45dc-41a9-a805-2218e44899ca None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:37.679512 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 90/197] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:37 2022] GET /identity/v3/role_assignments?user.id=ae21c20424254f9faf6bdca3fdf1d49c&scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:37.690487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:37.768703 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 108/198] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:37.775611 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364c2bc-45dc-41a9-a805-2218e44899ca None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:37.781650 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:37.893896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364c2bc-45dc-41a9-a805-2218e44899ca None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:37.933107 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc945ca-e766-45f5-bd7f-0b6cd53f9e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:37.933992 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc945ca-e766-45f5-bd7f-0b6cd53f9e82 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:37.934279 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc945ca-e766-45f5-bd7f-0b6cd53f9e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:37.934558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc945ca-e766-45f5-bd7f-0b6cd53f9e82 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:37.935772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc945ca-e766-45f5-bd7f-0b6cd53f9e82 None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:37.937273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc945ca-e766-45f5-bd7f-0b6cd53f9e82 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:37.939166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 91/199] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:37 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:37.945981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa2706-0219-49e7-90c0-7954aa5de972 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:38.097378 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa2706-0219-49e7-90c0-7954aa5de972 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:38.134556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d4923-2e5b-4508-a143-5233436db43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:38.135539 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d4923-2e5b-4508-a143-5233436db43a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:38.136004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d4923-2e5b-4508-a143-5233436db43a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:38.136478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d4923-2e5b-4508-a143-5233436db43a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:38.137519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d4923-2e5b-4508-a143-5233436db43a None admin] RBAC: Adding query filter params (role.id=e4ade3cd570d4865b356cbe822b76fe9, scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0, user.id=ae21c20424254f9faf6bdca3fdf1d49c) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:38.138013 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d4923-2e5b-4508-a143-5233436db43a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:38.139642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d4923-2e5b-4508-a143-5233436db43a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:38.144942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:38.146928 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 109/200] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:37 2022] GET /identity/v3/role_assignments?user.id=ae21c20424254f9faf6bdca3fdf1d49c&scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0&role.id=e4ade3cd570d4865b356cbe822b76fe9 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:38.553211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286d15c-9277-44ea-8e55-174c310c9255 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:38.553691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286d15c-9277-44ea-8e55-174c310c9255 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:38.553691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286d15c-9277-44ea-8e55-174c310c9255 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:38.555490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 92/201] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:38.561153 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad825aa-9e1a-4e07-bf8d-fe9bd89788ab None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:38.561542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad825aa-9e1a-4e07-bf8d-fe9bd89788ab None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:38.561901 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad825aa-9e1a-4e07-bf8d-fe9bd89788ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:38.589292 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6ad825aa-9e1a-4e07-bf8d-fe9bd89788ab None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:38.590505 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6ad825aa-9e1a-4e07-bf8d-fe9bd89788ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:38.692680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 110/202] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:38.728072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286d15c-9277-44ea-8e55-174c310c9255 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:38.817973 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:38.849403 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286d15c-9277-44ea-8e55-174c310c9255 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:38.901779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4b821-5bf4-4b46-a50d-982076dc0014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:38.902600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4b821-5bf4-4b46-a50d-982076dc0014 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:38.902925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4b821-5bf4-4b46-a50d-982076dc0014 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:38.903166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4b821-5bf4-4b46-a50d-982076dc0014 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:38.918327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4b821-5bf4-4b46-a50d-982076dc0014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:38.926767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-12e4b821-5bf4-4b46-a50d-982076dc0014 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:38.926767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:38.926767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:38.926767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:38.926767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:38.926767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:38.926767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:38.926767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:38.926767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:38.926767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:38.926767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:38.926767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:38.926767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:38.926767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:38.926767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:38.926767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:38.927633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:38.927633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:38.927633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:38.927633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:38.927633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:38.927633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:38.927633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:38.927633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:38.927633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:38.927633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:38.927633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:38.927633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:38.927633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:38.927633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:38.927633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:38.927633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:38.928443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:38.928443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:38.928443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:38.928443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:38.928443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:38.928443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:38.928443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:38.928443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:38.928443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:38.928443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:38.928443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:38.928443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:38.928443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 93/203] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:38.935107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad825aa-9e1a-4e07-bf8d-fe9bd89788ab None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:39.116295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad825aa-9e1a-4e07-bf8d-fe9bd89788ab None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:39.153238 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:39.161353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3d6f4-55c4-4c5b-9eb0-022b5dfd1b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:39.162259 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3d6f4-55c4-4c5b-9eb0-022b5dfd1b99 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:39.162543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3d6f4-55c4-4c5b-9eb0-022b5dfd1b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:39.162824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3d6f4-55c4-4c5b-9eb0-022b5dfd1b99 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:39.163577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3d6f4-55c4-4c5b-9eb0-022b5dfd1b99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:39.163886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3d6f4-55c4-4c5b-9eb0-022b5dfd1b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:39.165297 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3d6f4-55c4-4c5b-9eb0-022b5dfd1b99 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:39.180406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 111/204] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:39.186017 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4b821-5bf4-4b46-a50d-982076dc0014 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:39.355883 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4b821-5bf4-4b46-a50d-982076dc0014 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:39.393711 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:39.403964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3458c-8ca7-4c2b-bd1d-64006ff8669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:39.404888 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3458c-8ca7-4c2b-bd1d-64006ff8669d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:39.405173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3458c-8ca7-4c2b-bd1d-64006ff8669d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:39.405448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3458c-8ca7-4c2b-bd1d-64006ff8669d None admin] PATH_INFO: `/v3/users/c914e346883841f097d6af0b1ee22e27` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:39.406689 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3458c-8ca7-4c2b-bd1d-64006ff8669d None admin] RBAC: Authorizing `identity:get_user(user_id=c914e346883841f097d6af0b1ee22e27)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:39.408151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3458c-8ca7-4c2b-bd1d-64006ff8669d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:39.410430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 94/205] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:39 2022] GET /identity/v3/users/c914e346883841f097d6af0b1ee22e27 => generated 289 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:39.416236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3d6f4-55c4-4c5b-9eb0-022b5dfd1b99 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:39.631226 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3d6f4-55c4-4c5b-9eb0-022b5dfd1b99 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:39.678947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2534a92-5bc3-4f47-835f-94ec84e550c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:39.679535 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2534a92-5bc3-4f47-835f-94ec84e550c8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:39.679824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2534a92-5bc3-4f47-835f-94ec84e550c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:39.680104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2534a92-5bc3-4f47-835f-94ec84e550c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:39.759165 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:39.760546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec157120-533d-4274-8ccd-e2932484493e None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:39.761615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec157120-533d-4274-8ccd-e2932484493e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:39.761899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec157120-533d-4274-8ccd-e2932484493e None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:39.763409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 95/206] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:04:39.773913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad84f2-4421-4a04-94ff-3ff25cd695a7 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:39.774194 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad84f2-4421-4a04-94ff-3ff25cd695a7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:39.774471 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad84f2-4421-4a04-94ff-3ff25cd695a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:39.777458 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2534a92-5bc3-4f47-835f-94ec84e550c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:39.778946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2534a92-5bc3-4f47-835f-94ec84e550c8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:39.810608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-00ad84f2-4421-4a04-94ff-3ff25cd695a7 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:39.814881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-00ad84f2-4421-4a04-94ff-3ff25cd695a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:39.901260 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 96/207] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:39.924277 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad84f2-4421-4a04-94ff-3ff25cd695a7 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:40.023864 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 112/208] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 16:04:40.030155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2534a92-5bc3-4f47-835f-94ec84e550c8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:40.120078 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad84f2-4421-4a04-94ff-3ff25cd695a7 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:40.142195 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:40.154858 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2534a92-5bc3-4f47-835f-94ec84e550c8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:40.156663 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:40.161400 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6108ed3-0f12-4a41-befd-483868eb18f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:40.163404 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6108ed3-0f12-4a41-befd-483868eb18f1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:40.163923 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6108ed3-0f12-4a41-befd-483868eb18f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:40.164430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6108ed3-0f12-4a41-befd-483868eb18f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:40.175338 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6108ed3-0f12-4a41-befd-483868eb18f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:40.183628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-a6108ed3-0f12-4a41-befd-483868eb18f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:40.183628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:40.183628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:40.183628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:40.183628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:40.183628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:40.183628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:40.183628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:40.183628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:40.183628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:40.183628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:40.183628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:40.183628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:40.183628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:40.183628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:40.183628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:40.184536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:40.184536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:40.184536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:40.184536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:40.184536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:40.184536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:40.184536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:40.184536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:40.184536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:40.184536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:40.184536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:40.184536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:40.184536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:40.184536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:40.184536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:40.184536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:40.185326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:40.185326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:40.185326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:40.185326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:40.185326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:40.185326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:40.185326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:40.185326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:40.185326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:40.185326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:40.185326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:40.185326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:40.188345 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 97/209] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:04:40.190336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489c48e-c0da-4aa7-b5b2-047855dc8464 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:40.190791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acadd23-0a57-4a8b-9b26-ac9a0e249c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:40.191597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489c48e-c0da-4aa7-b5b2-047855dc8464 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:40.192071 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489c48e-c0da-4aa7-b5b2-047855dc8464 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:40.192171 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acadd23-0a57-4a8b-9b26-ac9a0e249c99 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:40.192492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acadd23-0a57-4a8b-9b26-ac9a0e249c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:40.192770 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acadd23-0a57-4a8b-9b26-ac9a0e249c99 None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:40.193982 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acadd23-0a57-4a8b-9b26-ac9a0e249c99 None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:40.194515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 98/210] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:40.199608 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acadd23-0a57-4a8b-9b26-ac9a0e249c99 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:40.199736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489c48e-c0da-4aa7-b5b2-047855dc8464 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:40.199832 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 113/211] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:40 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:40.200981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27538caa-b128-45e4-8886-89e161f2a212 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:40.201274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27538caa-b128-45e4-8886-89e161f2a212 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:40.201556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27538caa-b128-45e4-8886-89e161f2a212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:40.223879 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-27538caa-b128-45e4-8886-89e161f2a212 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:40.227361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-27538caa-b128-45e4-8886-89e161f2a212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:40.324373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 114/212] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:40.324373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27538caa-b128-45e4-8886-89e161f2a212 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:40.334820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489c48e-c0da-4aa7-b5b2-047855dc8464 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:40.389504 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a609ad-54a9-4e06-a158-dedcc9b4c017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:40.390240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a609ad-54a9-4e06-a158-dedcc9b4c017 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:40.390883 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a609ad-54a9-4e06-a158-dedcc9b4c017 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:40.391171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a609ad-54a9-4e06-a158-dedcc9b4c017 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:40.392213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a609ad-54a9-4e06-a158-dedcc9b4c017 None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:40.392554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a609ad-54a9-4e06-a158-dedcc9b4c017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:40.393963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a609ad-54a9-4e06-a158-dedcc9b4c017 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:40.406083 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 99/213] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:40.407590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a609ad-54a9-4e06-a158-dedcc9b4c017 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:40.426184 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:40.438830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27538caa-b128-45e4-8886-89e161f2a212 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:40.475857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:40.479015 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b10a2c-fa8f-4159-8ac0-aca208955e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:40.479717 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b10a2c-fa8f-4159-8ac0-aca208955e73 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:40.480000 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b10a2c-fa8f-4159-8ac0-aca208955e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:40.480456 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b10a2c-fa8f-4159-8ac0-aca208955e73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:40.481301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b10a2c-fa8f-4159-8ac0-aca208955e73 None admin] RBAC: Adding query filter params (role.id=defadc42e7f7403fafbf9c95017e276f, scope.project.id=c386c04bad694a429d89ba0a586c8a45, user.id=c914e346883841f097d6af0b1ee22e27) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:40.481623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b10a2c-fa8f-4159-8ac0-aca208955e73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:40.483075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b10a2c-fa8f-4159-8ac0-aca208955e73 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:40.490106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 115/214] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:40 2022] GET /identity/v3/role_assignments?user.id=c914e346883841f097d6af0b1ee22e27&scope.project.id=c386c04bad694a429d89ba0a586c8a45&role.id=defadc42e7f7403fafbf9c95017e276f => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:40.490739 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b10a2c-fa8f-4159-8ac0-aca208955e73 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:40.547843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a609ad-54a9-4e06-a158-dedcc9b4c017 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:40.598510 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba306c-7970-477f-bf85-1a405b0f8d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:40.599815 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba306c-7970-477f-bf85-1a405b0f8d36 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:40.600245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba306c-7970-477f-bf85-1a405b0f8d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:40.600848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba306c-7970-477f-bf85-1a405b0f8d36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:40.602647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba306c-7970-477f-bf85-1a405b0f8d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:40.604330 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba306c-7970-477f-bf85-1a405b0f8d36 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:40.607243 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 100/215] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:40.608848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512dbb1-6840-4497-b516-011c3be6e0f0 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:40.609273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512dbb1-6840-4497-b516-011c3be6e0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:40.609716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512dbb1-6840-4497-b516-011c3be6e0f0 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:40.616578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 101/216] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:40.617946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512dbb1-6840-4497-b516-011c3be6e0f0 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:40.629583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b10a2c-fa8f-4159-8ac0-aca208955e73 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:40.676100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21adb3e-8045-447c-8d1c-cf9d3d7f677d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:40.677038 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21adb3e-8045-447c-8d1c-cf9d3d7f677d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:40.677319 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21adb3e-8045-447c-8d1c-cf9d3d7f677d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:40.677593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21adb3e-8045-447c-8d1c-cf9d3d7f677d None admin] PATH_INFO: `/v3/users/b2621ba5bca7405eb123c8d83b958db2` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:40.693698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21adb3e-8045-447c-8d1c-cf9d3d7f677d None admin] RBAC: Authorizing `identity:get_user(user_id=b2621ba5bca7405eb123c8d83b958db2)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:40.695321 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21adb3e-8045-447c-8d1c-cf9d3d7f677d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:40.697152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 116/217] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:40 2022] GET /identity/v3/users/b2621ba5bca7405eb123c8d83b958db2 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:40.698463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9beb3-f423-4421-a91b-2dc445b360e6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:40.698753 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9beb3-f423-4421-a91b-2dc445b360e6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:40.699032 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9beb3-f423-4421-a91b-2dc445b360e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:40.718076 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b5c9beb3-f423-4421-a91b-2dc445b360e6 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:40.721198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b5c9beb3-f423-4421-a91b-2dc445b360e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:40.731225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:40.762531 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512dbb1-6840-4497-b516-011c3be6e0f0 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:40.783168 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:40.796085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 117/218] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:40.804479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9beb3-f423-4421-a91b-2dc445b360e6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:40.804597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cd3ab-172b-4b44-9767-58cd00ae3800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:40.804597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cd3ab-172b-4b44-9767-58cd00ae3800 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:40.804597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cd3ab-172b-4b44-9767-58cd00ae3800 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:40.804597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cd3ab-172b-4b44-9767-58cd00ae3800 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:40.804849 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cd3ab-172b-4b44-9767-58cd00ae3800 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:40.804849 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cd3ab-172b-4b44-9767-58cd00ae3800 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:40.824263 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 102/219] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:04:40 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:04:40.825770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db622b7d-57b9-4b08-86dd-236ec600bdd4 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:40.826094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db622b7d-57b9-4b08-86dd-236ec600bdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:40.826375 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db622b7d-57b9-4b08-86dd-236ec600bdd4 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:40.827665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 103/220] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:40.832268 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db622b7d-57b9-4b08-86dd-236ec600bdd4 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:40.912110 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9beb3-f423-4421-a91b-2dc445b360e6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:40.950494 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db622b7d-57b9-4b08-86dd-236ec600bdd4 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:40.951603 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ca59b-590c-4132-a6fa-49862b13f024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:40.952441 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ca59b-590c-4132-a6fa-49862b13f024 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:40.952733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ca59b-590c-4132-a6fa-49862b13f024 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:40.953004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ca59b-590c-4132-a6fa-49862b13f024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:40.968117 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:40.999403 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795e588-9f04-4c47-bd76-d69d283dd80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:40.999836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e588-9f04-4c47-bd76-d69d283dd80a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:41.000124 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e588-9f04-4c47-bd76-d69d283dd80a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:41.000475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e588-9f04-4c47-bd76-d69d283dd80a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:41.015737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795e588-9f04-4c47-bd76-d69d283dd80a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:41.024505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-c795e588-9f04-4c47-bd76-d69d283dd80a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:41.024505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:41.024505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:41.024505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:41.024505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:41.024505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:41.024505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:41.024505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:41.024505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:41.024505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:41.024505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:41.024505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:41.024505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:41.024505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:41.024505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:41.024505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:41.025381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:41.025381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:41.025381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:41.025381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:41.025381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:41.025381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:41.025381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:41.025381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:41.025381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:41.025381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:41.025381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:41.025381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:41.025381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:41.025381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:41.025381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:41.025381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:41.026145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:41.026145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:41.026145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:41.026145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:41.026145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:41.026145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:41.026145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:41.026145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:41.026145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:41.026145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:41.026145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:41.026145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:41.026145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 104/221] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:04:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:41.027506 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcc8ae-d5e7-4b2b-95fb-7df7f34240fc None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:41.027506 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcc8ae-d5e7-4b2b-95fb-7df7f34240fc None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:41.027739 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcc8ae-d5e7-4b2b-95fb-7df7f34240fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:41.042808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ca59b-590c-4132-a6fa-49862b13f024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:41.044301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ca59b-590c-4132-a6fa-49862b13f024 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:41.050760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8cfcc8ae-d5e7-4b2b-95fb-7df7f34240fc None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:41.051956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8cfcc8ae-d5e7-4b2b-95fb-7df7f34240fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:41.086296 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:41.137990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 105/222] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:41.138864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcc8ae-d5e7-4b2b-95fb-7df7f34240fc None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:41.174375 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 118/223] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:41.175164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ca59b-590c-4132-a6fa-49862b13f024 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:41.230960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:41.270544 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcc8ae-d5e7-4b2b-95fb-7df7f34240fc None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:41.298375 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ca59b-590c-4132-a6fa-49862b13f024 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:41.319659 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c2fd0-9494-4a07-90e1-7a7ecd1e4a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:41.320556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c2fd0-9494-4a07-90e1-7a7ecd1e4a7b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:41.321515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c2fd0-9494-4a07-90e1-7a7ecd1e4a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:41.321898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c2fd0-9494-4a07-90e1-7a7ecd1e4a7b None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:41.323035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c2fd0-9494-4a07-90e1-7a7ecd1e4a7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:41.323449 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c2fd0-9494-4a07-90e1-7a7ecd1e4a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:41.325623 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c2fd0-9494-4a07-90e1-7a7ecd1e4a7b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:41.335921 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 106/224] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:41.336962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c2fd0-9494-4a07-90e1-7a7ecd1e4a7b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:41.343562 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d995c-c6c1-4b7a-b319-8abb4be1757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:41.344434 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d995c-c6c1-4b7a-b319-8abb4be1757c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:41.344721 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d995c-c6c1-4b7a-b319-8abb4be1757c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:41.344997 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d995c-c6c1-4b7a-b319-8abb4be1757c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:41.360246 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d995c-c6c1-4b7a-b319-8abb4be1757c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:41.370070 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:41.376881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-423d995c-c6c1-4b7a-b319-8abb4be1757c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:04:41.376881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:41.376881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:41.376881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:41.376881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:41.376881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:41.376881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:41.376881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:41.376881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:41.376881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:41.376881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:41.376881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:41.376881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:41.376881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:41.376881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:41.376881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:41.377772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:41.377772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:41.377772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:41.377772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:41.377772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:41.377772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:41.377772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:41.377772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:41.377772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:41.377772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:41.377772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:41.377772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:41.377772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:41.377772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:41.377772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:41.377772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:41.378700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:41.378700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:41.378700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:41.378700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:41.378700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:41.378700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:41.378700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:41.378700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:41.378700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:41.378700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:41.378700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:04:41.378700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:41.378700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 119/225] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:04:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:41.379326 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d995c-c6c1-4b7a-b319-8abb4be1757c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:41.459527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c2fd0-9494-4a07-90e1-7a7ecd1e4a7b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:41.495814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1830012-d89e-49fa-b6c1-de2cff0350c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:41.496952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1830012-d89e-49fa-b6c1-de2cff0350c0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:41.497375 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1830012-d89e-49fa-b6c1-de2cff0350c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:41.497787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1830012-d89e-49fa-b6c1-de2cff0350c0 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:41.498858 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d995c-c6c1-4b7a-b319-8abb4be1757c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:41.499351 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1830012-d89e-49fa-b6c1-de2cff0350c0 None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:41.501022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1830012-d89e-49fa-b6c1-de2cff0350c0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:41.503242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 107/226] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:41 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:41.504377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1830012-d89e-49fa-b6c1-de2cff0350c0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:41.516617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:41.538349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9ba0e-3e73-46e2-8b7f-0990ee44b127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:41.539422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9ba0e-3e73-46e2-8b7f-0990ee44b127 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:41.539802 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9ba0e-3e73-46e2-8b7f-0990ee44b127 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:41.540176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9ba0e-3e73-46e2-8b7f-0990ee44b127 None admin] PATH_INFO: `/v3/users/ae21c20424254f9faf6bdca3fdf1d49c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:41.541519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9ba0e-3e73-46e2-8b7f-0990ee44b127 None admin] RBAC: Authorizing `identity:get_user(user_id=ae21c20424254f9faf6bdca3fdf1d49c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:41.543370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9ba0e-3e73-46e2-8b7f-0990ee44b127 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:41.545257 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 120/227] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:41 2022] GET /identity/v3/users/ae21c20424254f9faf6bdca3fdf1d49c => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:41.550742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9ba0e-3e73-46e2-8b7f-0990ee44b127 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:41.607051 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:41.614347 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1830012-d89e-49fa-b6c1-de2cff0350c0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:41.653653 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00132ffc-b27a-4392-9547-4374d2a35f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:41.654496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00132ffc-b27a-4392-9547-4374d2a35f3e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:41.654869 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00132ffc-b27a-4392-9547-4374d2a35f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:41.655239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00132ffc-b27a-4392-9547-4374d2a35f3e None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:41.656090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00132ffc-b27a-4392-9547-4374d2a35f3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:41.656760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00132ffc-b27a-4392-9547-4374d2a35f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:41.658339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00132ffc-b27a-4392-9547-4374d2a35f3e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:41.671481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 108/228] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:04:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:41.671481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00132ffc-b27a-4392-9547-4374d2a35f3e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:41.676309 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9ba0e-3e73-46e2-8b7f-0990ee44b127 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:41.715962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab5af0-2b23-42b5-b7d7-cc0296f1efeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:41.716595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab5af0-2b23-42b5-b7d7-cc0296f1efeb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:41.716882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab5af0-2b23-42b5-b7d7-cc0296f1efeb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:41.717161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab5af0-2b23-42b5-b7d7-cc0296f1efeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:41.717999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab5af0-2b23-42b5-b7d7-cc0296f1efeb None admin] RBAC: Adding query filter params (role.id=6a0b49157bc649ef99e870c62ee6f4fe, scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0, user.id=b2621ba5bca7405eb123c8d83b958db2) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:41.718310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab5af0-2b23-42b5-b7d7-cc0296f1efeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:41.720205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab5af0-2b23-42b5-b7d7-cc0296f1efeb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:41.727353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 121/229] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:41 2022] GET /identity/v3/role_assignments?user.id=b2621ba5bca7405eb123c8d83b958db2&scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0&role.id=6a0b49157bc649ef99e870c62ee6f4fe => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:41.728033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab5af0-2b23-42b5-b7d7-cc0296f1efeb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:41.768633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:41.814970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00132ffc-b27a-4392-9547-4374d2a35f3e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:41.857827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781f1a6-9503-46c0-bd4b-365ead173841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:41.859648 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781f1a6-9503-46c0-bd4b-365ead173841 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:41.860167 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781f1a6-9503-46c0-bd4b-365ead173841 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:41.860665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781f1a6-9503-46c0-bd4b-365ead173841 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:41.862273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781f1a6-9503-46c0-bd4b-365ead173841 None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:41.864938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781f1a6-9503-46c0-bd4b-365ead173841 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:41.867343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 109/230] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:41 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:41.873314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781f1a6-9503-46c0-bd4b-365ead173841 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:41.911784 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:41.934284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab5af0-2b23-42b5-b7d7-cc0296f1efeb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:41.997129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781f1a6-9503-46c0-bd4b-365ead173841 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:42.041828 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b45582-b408-44d4-b5b5-7c530675685d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:42.042849 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b45582-b408-44d4-b5b5-7c530675685d None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:42.043209 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b45582-b408-44d4-b5b5-7c530675685d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:42.043557 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b45582-b408-44d4-b5b5-7c530675685d None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0/users/ae21c20424254f9faf6bdca3fdf1d49c/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:42.045812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b45582-b408-44d4-b5b5-7c530675685d None admin] RBAC: Authorizing `identity:create_grant(project_id=fe640fcb276d4bdabd5a537cc3153aa0, user_id=ae21c20424254f9faf6bdca3fdf1d49c, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:42.047529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b45582-b408-44d4-b5b5-7c530675685d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:42.053178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272f99e-2d77-42c0-9afc-6edea8883849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:42.054331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272f99e-2d77-42c0-9afc-6edea8883849 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:42.054809 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272f99e-2d77-42c0-9afc-6edea8883849 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:42.055139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272f99e-2d77-42c0-9afc-6edea8883849 None admin] PATH_INFO: `/v3/users/ae21c20424254f9faf6bdca3fdf1d49c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:42.058837 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272f99e-2d77-42c0-9afc-6edea8883849 None admin] RBAC: Authorizing `identity:get_user(user_id=ae21c20424254f9faf6bdca3fdf1d49c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:42.060606 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272f99e-2d77-42c0-9afc-6edea8883849 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:42.062942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 122/231] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:41 2022] GET /identity/v3/users/ae21c20424254f9faf6bdca3fdf1d49c => generated 283 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:42.065741 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 110/232] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:04:41 2022] PUT /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0/users/ae21c20424254f9faf6bdca3fdf1d49c/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:04:42.070388 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272f99e-2d77-42c0-9afc-6edea8883849 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:42.202979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272f99e-2d77-42c0-9afc-6edea8883849 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:42.204735 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:42.240000 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4400e29-7e75-4d67-abd2-867cfdff4b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:42.240925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4400e29-7e75-4d67-abd2-867cfdff4b8e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:42.241209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4400e29-7e75-4d67-abd2-867cfdff4b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:42.241484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4400e29-7e75-4d67-abd2-867cfdff4b8e None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:42.244286 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4400e29-7e75-4d67-abd2-867cfdff4b8e None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:42.244286 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4400e29-7e75-4d67-abd2-867cfdff4b8e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:42.246293 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 123/233] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:42 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:42.252078 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b45582-b408-44d4-b5b5-7c530675685d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:42.368707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:42.386584 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b45582-b408-44d4-b5b5-7c530675685d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:42.422671 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418ed5b-84f6-46af-8cd3-65b1dd02fed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:42.423575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418ed5b-84f6-46af-8cd3-65b1dd02fed7 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:42.423859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418ed5b-84f6-46af-8cd3-65b1dd02fed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:42.424131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418ed5b-84f6-46af-8cd3-65b1dd02fed7 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0/users/ae21c20424254f9faf6bdca3fdf1d49c/roles/e4ade3cd570d4865b356cbe822b76fe9` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:42.426660 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418ed5b-84f6-46af-8cd3-65b1dd02fed7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe640fcb276d4bdabd5a537cc3153aa0, user_id=ae21c20424254f9faf6bdca3fdf1d49c, role_id=e4ade3cd570d4865b356cbe822b76fe9)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:42.428129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418ed5b-84f6-46af-8cd3-65b1dd02fed7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:42.443961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 111/234] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:04:42 2022] PUT /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0/users/ae21c20424254f9faf6bdca3fdf1d49c/roles/e4ade3cd570d4865b356cbe822b76fe9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:04:43.140088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a6575-4680-4e0d-9dfd-21d4e70952c5 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:43.140483 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a6575-4680-4e0d-9dfd-21d4e70952c5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:43.140697 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a6575-4680-4e0d-9dfd-21d4e70952c5 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:43.142399 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 124/235] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:43.147873 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb29d45-3d15-4668-a0be-1fd13dd18916 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:43.148340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb29d45-3d15-4668-a0be-1fd13dd18916 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:43.148513 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb29d45-3d15-4668-a0be-1fd13dd18916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:43.172306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ecb29d45-3d15-4668-a0be-1fd13dd18916 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:43.173492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ecb29d45-3d15-4668-a0be-1fd13dd18916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:43.270960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 112/236] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:43.314837 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a6575-4680-4e0d-9dfd-21d4e70952c5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:43.467270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a6575-4680-4e0d-9dfd-21d4e70952c5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:43.513666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3827a-e8b5-453b-9602-3ffb59549286 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:43.514073 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3827a-e8b5-453b-9602-3ffb59549286 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:43.514238 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3827a-e8b5-453b-9602-3ffb59549286 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:43.514746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897084d4-a836-47cf-8cf6-40e8c8cf57a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:43.515751 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897084d4-a836-47cf-8cf6-40e8c8cf57a5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:43.515889 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 113/237] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:43.516340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897084d4-a836-47cf-8cf6-40e8c8cf57a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:43.516340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897084d4-a836-47cf-8cf6-40e8c8cf57a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:43.528136 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897084d4-a836-47cf-8cf6-40e8c8cf57a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:43.536382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-897084d4-a836-47cf-8cf6-40e8c8cf57a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:43.536382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:43.536382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:43.536382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:43.536382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:43.536382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:43.536382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:43.536382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:43.536382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:43.536382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:43.536382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:43.536382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:43.536382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:43.536382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:43.536382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:43.536382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:43.537237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:43.537237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:43.537237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:43.537237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:43.537237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:43.537237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:43.537237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:43.537237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:43.537237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:43.537237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:43.537237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:43.537237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:43.537237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:43.537237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:43.537237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:43.537237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:43.538003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:43.538003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:43.538003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:43.538003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:43.538003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:43.538003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:43.538003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:43.538003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:43.538003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:43.538003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:43.538003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:43.538003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:43.538586 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaec29-f521-4919-b7ba-314097cbd1bd None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:43.538665 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 125/238] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:43.538731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaec29-f521-4919-b7ba-314097cbd1bd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:43.538731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaec29-f521-4919-b7ba-314097cbd1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:43.544531 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897084d4-a836-47cf-8cf6-40e8c8cf57a5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:43.567888 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6acaec29-f521-4919-b7ba-314097cbd1bd None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:43.573319 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6acaec29-f521-4919-b7ba-314097cbd1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:43.585029 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:43.664724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 114/239] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:43.688857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaec29-f521-4919-b7ba-314097cbd1bd None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:43.703947 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:43.749062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897084d4-a836-47cf-8cf6-40e8c8cf57a5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:43.799688 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19045e8d-aa68-4624-a230-2993e03c28ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:43.800979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19045e8d-aa68-4624-a230-2993e03c28ee None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:43.801267 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19045e8d-aa68-4624-a230-2993e03c28ee None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:43.801545 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19045e8d-aa68-4624-a230-2993e03c28ee None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:43.802300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19045e8d-aa68-4624-a230-2993e03c28ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:43.802609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19045e8d-aa68-4624-a230-2993e03c28ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:43.804017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19045e8d-aa68-4624-a230-2993e03c28ee None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:43.822933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 126/240] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:43.828676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19045e8d-aa68-4624-a230-2993e03c28ee None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:43.871677 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaec29-f521-4919-b7ba-314097cbd1bd None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:43.924305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116fdf0-0b8f-471b-aeb3-05a25eb35780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:43.925156 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116fdf0-0b8f-471b-aeb3-05a25eb35780 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:43.925469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116fdf0-0b8f-471b-aeb3-05a25eb35780 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:43.925740 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116fdf0-0b8f-471b-aeb3-05a25eb35780 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:43.929417 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116fdf0-0b8f-471b-aeb3-05a25eb35780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:43.930891 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116fdf0-0b8f-471b-aeb3-05a25eb35780 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:43.932567 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 115/241] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:43.939571 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116fdf0-0b8f-471b-aeb3-05a25eb35780 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:44.028939 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:44.044678 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19045e8d-aa68-4624-a230-2993e03c28ee None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:44.113778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116fdf0-0b8f-471b-aeb3-05a25eb35780 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:44.132763 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:44.143659 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e06de-d468-4926-9017-3b14a18a5d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:44.145391 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e06de-d468-4926-9017-3b14a18a5d13 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:44.145812 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e06de-d468-4926-9017-3b14a18a5d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:44.146250 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e06de-d468-4926-9017-3b14a18a5d13 None admin] PATH_INFO: `/v3/users/95481000a67844eeb6f900ae670da719` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:44.152264 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dde7a-798b-46a7-b710-396493bf8afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:44.152947 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dde7a-798b-46a7-b710-396493bf8afb None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:44.153227 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dde7a-798b-46a7-b710-396493bf8afb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:44.153500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dde7a-798b-46a7-b710-396493bf8afb None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:44.154210 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dde7a-798b-46a7-b710-396493bf8afb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:44.156077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dde7a-798b-46a7-b710-396493bf8afb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:44.176682 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e06de-d468-4926-9017-3b14a18a5d13 None admin] RBAC: Authorizing `identity:get_user(user_id=95481000a67844eeb6f900ae670da719)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:44.178460 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e06de-d468-4926-9017-3b14a18a5d13 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:44.180432 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 127/242] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:43 2022] GET /identity/v3/users/95481000a67844eeb6f900ae670da719 => generated 297 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:44.184296 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 116/243] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:04:43 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:04:44.186449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e06de-d468-4926-9017-3b14a18a5d13 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:44.324600 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e06de-d468-4926-9017-3b14a18a5d13 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:44.375866 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ed47d-7cc2-4cfd-b9e8-ffa676e437b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:44.376550 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ed47d-7cc2-4cfd-b9e8-ffa676e437b8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:44.376832 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ed47d-7cc2-4cfd-b9e8-ffa676e437b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:44.377106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ed47d-7cc2-4cfd-b9e8-ffa676e437b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:44.403735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0075f-f373-47d0-92f4-cd708871b85a None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:44.404411 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0075f-f373-47d0-92f4-cd708871b85a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:44.404908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0075f-f373-47d0-92f4-cd708871b85a None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:44.406769 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 117/244] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:04:44.410982 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:44.412784 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf5baf-fa99-4023-8742-af2f117aa561 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:44.413293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf5baf-fa99-4023-8742-af2f117aa561 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:44.413807 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf5baf-fa99-4023-8742-af2f117aa561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:44.435728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ebdf5baf-fa99-4023-8742-af2f117aa561 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:44.437336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ebdf5baf-fa99-4023-8742-af2f117aa561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:44.509240 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ed47d-7cc2-4cfd-b9e8-ffa676e437b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:44.510752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ed47d-7cc2-4cfd-b9e8-ffa676e437b8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:44.522144 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 118/245] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:44.524323 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdd0b9-63cb-49fb-9ccf-7965e70f1561 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:44.524956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdd0b9-63cb-49fb-9ccf-7965e70f1561 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:44.525505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdd0b9-63cb-49fb-9ccf-7965e70f1561 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:44.527709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 119/246] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:44.535166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b623d-b08f-4e43-b29f-712146b19dfb None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:44.535448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b623d-b08f-4e43-b29f-712146b19dfb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:44.535719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b623d-b08f-4e43-b29f-712146b19dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:44.558102 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3f9b623d-b08f-4e43-b29f-712146b19dfb None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:44.559289 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3f9b623d-b08f-4e43-b29f-712146b19dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:44.631588 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:44.635796 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 128/247] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:44.641606 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ed47d-7cc2-4cfd-b9e8-ffa676e437b8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:44.651154 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 120/248] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:44.656191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b623d-b08f-4e43-b29f-712146b19dfb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:44.720448 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:44.783385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b623d-b08f-4e43-b29f-712146b19dfb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:44.789797 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ed47d-7cc2-4cfd-b9e8-ffa676e437b8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:44.823324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20ca92-5841-4d76-8892-645719cfc856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:44.826373 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20ca92-5841-4d76-8892-645719cfc856 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:44.826373 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20ca92-5841-4d76-8892-645719cfc856 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:44.826373 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20ca92-5841-4d76-8892-645719cfc856 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:44.827402 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20ca92-5841-4d76-8892-645719cfc856 None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:44.828874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20ca92-5841-4d76-8892-645719cfc856 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:44.831000 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 121/249] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:44 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:44.831811 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20ca92-5841-4d76-8892-645719cfc856 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:44.836552 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f36fcc-f411-4073-9625-4357666752f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:44.837437 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f36fcc-f411-4073-9625-4357666752f9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:44.837723 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f36fcc-f411-4073-9625-4357666752f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:44.838003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f36fcc-f411-4073-9625-4357666752f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:44.850340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f36fcc-f411-4073-9625-4357666752f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:44.858920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-82f36fcc-f411-4073-9625-4357666752f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:44.858920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:44.858920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:44.858920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:44.858920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:44.858920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:44.858920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:44.858920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:44.858920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:44.858920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:44.858920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:44.858920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:44.858920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:44.858920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:44.858920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:44.858920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:44.859798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:44.859798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:44.859798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:44.859798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:44.859798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:44.859798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:44.859798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:44.859798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:44.859798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:44.859798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:44.859798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:44.859798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:44.859798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:44.859798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:44.859798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:44.859798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:44.860588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:44.860588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:44.860588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:44.860588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:44.860588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:44.860588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:44.860588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:44.860588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:44.860588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:44.860588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:44.860588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:44.860588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:44.861155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 129/250] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:44.861691 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f36fcc-f411-4073-9625-4357666752f9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:44.893145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:44.938964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20ca92-5841-4d76-8892-645719cfc856 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:44.975435 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65eec27-d31c-43a8-8de1-a3a197ea069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:44.976236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eec27-d31c-43a8-8de1-a3a197ea069e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:44.976544 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eec27-d31c-43a8-8de1-a3a197ea069e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:44.976815 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eec27-d31c-43a8-8de1-a3a197ea069e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:44.988576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65eec27-d31c-43a8-8de1-a3a197ea069e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:44.996841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-d65eec27-d31c-43a8-8de1-a3a197ea069e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:44.996841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:44.996841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:44.996841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:44.996841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:44.996841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:44.996841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:44.996841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:44.996841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:44.996841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:44.996841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:44.996841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:44.996841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:44.996841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:44.996841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:44.996841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:44.997727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:44.997727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:44.997727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:44.997727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:44.997727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:44.997727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:44.997727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:44.997727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:44.997727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:44.997727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:44.997727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:44.997727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:44.997727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:44.997727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:44.997727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:44.997727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:44.998497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:44.998497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:44.998497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:44.998497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:44.998497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:44.998497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:44.998497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:44.998497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:44.998497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:44.998497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:44.998497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:04:44.998497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:44.998497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 122/251] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:04:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:44.999708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65eec27-d31c-43a8-8de1-a3a197ea069e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:45.041379 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f36fcc-f411-4073-9625-4357666752f9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:45.066179 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:45.098212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197631b6-bc44-4ed6-b7b0-5f8be149880b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:45.098898 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197631b6-bc44-4ed6-b7b0-5f8be149880b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:45.099287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197631b6-bc44-4ed6-b7b0-5f8be149880b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:45.099572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197631b6-bc44-4ed6-b7b0-5f8be149880b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:45.100565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197631b6-bc44-4ed6-b7b0-5f8be149880b None admin] RBAC: Adding query filter params (role.id=defadc42e7f7403fafbf9c95017e276f, scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0, user.id=95481000a67844eeb6f900ae670da719) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:45.100872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197631b6-bc44-4ed6-b7b0-5f8be149880b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:45.102441 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197631b6-bc44-4ed6-b7b0-5f8be149880b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:45.105617 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65eec27-d31c-43a8-8de1-a3a197ea069e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:45.108842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 130/252] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:44 2022] GET /identity/v3/role_assignments?user.id=95481000a67844eeb6f900ae670da719&scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0&role.id=defadc42e7f7403fafbf9c95017e276f => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:45.110134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197631b6-bc44-4ed6-b7b0-5f8be149880b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:45.125062 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:45.189728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d50c5-3a36-4894-aae7-fc8312b65d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:45.190456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d50c5-3a36-4894-aae7-fc8312b65d53 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:45.190733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d50c5-3a36-4894-aae7-fc8312b65d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:45.191046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d50c5-3a36-4894-aae7-fc8312b65d53 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:45.191817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d50c5-3a36-4894-aae7-fc8312b65d53 None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:45.194931 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d50c5-3a36-4894-aae7-fc8312b65d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:45.194931 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d50c5-3a36-4894-aae7-fc8312b65d53 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:45.216646 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 123/253] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:45.224184 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d50c5-3a36-4894-aae7-fc8312b65d53 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:45.311479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197631b6-bc44-4ed6-b7b0-5f8be149880b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:45.374139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d29e5-d2e9-4e3a-87bc-454f751945b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:45.375496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d29e5-d2e9-4e3a-87bc-454f751945b5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:45.375931 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d29e5-d2e9-4e3a-87bc-454f751945b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:45.376416 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d29e5-d2e9-4e3a-87bc-454f751945b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:45.377424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d29e5-d2e9-4e3a-87bc-454f751945b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:45.377922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d29e5-d2e9-4e3a-87bc-454f751945b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:45.380090 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d29e5-d2e9-4e3a-87bc-454f751945b5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:45.390095 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 131/254] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:45.391886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6e50b-1940-468e-93b4-6a4b684974e0 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:45.392343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6e50b-1940-468e-93b4-6a4b684974e0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:45.398568 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6e50b-1940-468e-93b4-6a4b684974e0 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:45.400445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 132/255] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:45.401346 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6e50b-1940-468e-93b4-6a4b684974e0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:45.415839 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d50c5-3a36-4894-aae7-fc8312b65d53 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:45.482321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff755e-f92c-4053-ab9a-9b1522618fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:45.483778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff755e-f92c-4053-ab9a-9b1522618fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:45.484283 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff755e-f92c-4053-ab9a-9b1522618fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:45.484706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff755e-f92c-4053-ab9a-9b1522618fc3 None admin] PATH_INFO: `/v3/users/b2621ba5bca7405eb123c8d83b958db2` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:45.486301 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff755e-f92c-4053-ab9a-9b1522618fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=b2621ba5bca7405eb123c8d83b958db2)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:45.488607 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:45.489013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff755e-f92c-4053-ab9a-9b1522618fc3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:45.491061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 124/256] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:45 2022] GET /identity/v3/users/b2621ba5bca7405eb123c8d83b958db2 => generated 297 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:45.492798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c5baf-2721-4637-8e98-b54e17aafd8f None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:45.493224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c5baf-2721-4637-8e98-b54e17aafd8f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:45.493560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c5baf-2721-4637-8e98-b54e17aafd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:45.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7f8c5baf-2721-4637-8e98-b54e17aafd8f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:45.517619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7f8c5baf-2721-4637-8e98-b54e17aafd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:45.568749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:45.595869 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 125/257] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:45.596768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c5baf-2721-4637-8e98-b54e17aafd8f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:45.644871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6e50b-1940-468e-93b4-6a4b684974e0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:45.733881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653692e8-2ec1-4361-8523-93c7132e314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:45.735260 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653692e8-2ec1-4361-8523-93c7132e314c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:45.735545 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653692e8-2ec1-4361-8523-93c7132e314c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:45.735819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653692e8-2ec1-4361-8523-93c7132e314c None admin] PATH_INFO: `/v3/users/ae21c20424254f9faf6bdca3fdf1d49c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:45.737178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653692e8-2ec1-4361-8523-93c7132e314c None admin] RBAC: Authorizing `identity:get_user(user_id=ae21c20424254f9faf6bdca3fdf1d49c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:45.740072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c5baf-2721-4637-8e98-b54e17aafd8f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:45.742775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653692e8-2ec1-4361-8523-93c7132e314c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:45.745344 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 133/258] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:45 2022] GET /identity/v3/users/ae21c20424254f9faf6bdca3fdf1d49c => generated 283 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:45.746130 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653692e8-2ec1-4361-8523-93c7132e314c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:45.814317 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff1294-80c5-480b-b25b-6930db0230fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:45.815196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff1294-80c5-480b-b25b-6930db0230fe None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:45.815478 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff1294-80c5-480b-b25b-6930db0230fe None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:45.815804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff1294-80c5-480b-b25b-6930db0230fe None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:45.821131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff1294-80c5-480b-b25b-6930db0230fe None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:45.822603 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff1294-80c5-480b-b25b-6930db0230fe None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:45.824629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 126/259] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:45 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:45.825191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff1294-80c5-480b-b25b-6930db0230fe None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:45.875877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653692e8-2ec1-4361-8523-93c7132e314c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:45.879463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:45.917746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e00929-df9f-4407-93ce-575b3298cb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:45.918573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e00929-df9f-4407-93ce-575b3298cb19 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:45.918862 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e00929-df9f-4407-93ce-575b3298cb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:45.919148 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e00929-df9f-4407-93ce-575b3298cb19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:45.931325 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e00929-df9f-4407-93ce-575b3298cb19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:45.939933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-26e00929-df9f-4407-93ce-575b3298cb19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:04:45.939933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:45.939933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:45.939933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:45.939933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:45.939933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:45.939933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:45.939933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:45.939933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:45.939933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:45.939933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:45.939933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:45.939933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:45.939933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:45.939933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:45.939933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:45.940914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:45.940914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:45.940914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:45.940914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:45.940914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:45.940914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:45.940914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:45.940914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:45.940914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:45.940914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:45.940914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:45.940914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:45.940914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:45.940914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:45.940914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:45.940914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:45.942187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:45.942187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:45.942187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:45.942187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:45.942187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:45.942187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:45.942187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:45.942187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:45.942187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:45.942187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:45.942187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:04:45.942187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:45.942187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 134/260] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:04:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:45.943006 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e00929-df9f-4407-93ce-575b3298cb19 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:45.944192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:46.029756 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff1294-80c5-480b-b25b-6930db0230fe None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:46.109001 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc47213-aa2e-4e38-b59c-6257bd623f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:46.109690 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc47213-aa2e-4e38-b59c-6257bd623f41 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:46.109978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc47213-aa2e-4e38-b59c-6257bd623f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:46.110258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc47213-aa2e-4e38-b59c-6257bd623f41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:46.163413 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e00929-df9f-4407-93ce-575b3298cb19 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:46.235276 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5fec1-8052-4ba6-b1b9-160674ccf9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:46.236197 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fec1-8052-4ba6-b1b9-160674ccf9e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:46.236516 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fec1-8052-4ba6-b1b9-160674ccf9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:46.236799 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fec1-8052-4ba6-b1b9-160674ccf9e0 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0/users/b2621ba5bca7405eb123c8d83b958db2/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:46.239577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5fec1-8052-4ba6-b1b9-160674ccf9e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe640fcb276d4bdabd5a537cc3153aa0, user_id=b2621ba5bca7405eb123c8d83b958db2, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:46.241258 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5fec1-8052-4ba6-b1b9-160674ccf9e0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:46.255196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc47213-aa2e-4e38-b59c-6257bd623f41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:46.257286 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc47213-aa2e-4e38-b59c-6257bd623f41 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:46.267299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 135/261] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:04:45 2022] PUT /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0/users/b2621ba5bca7405eb123c8d83b958db2/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:04:46.268151 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5fec1-8052-4ba6-b1b9-160674ccf9e0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:46.312115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:46.341950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:46.387450 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 127/262] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:46.397028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc47213-aa2e-4e38-b59c-6257bd623f41 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:46.547226 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5fec1-8052-4ba6-b1b9-160674ccf9e0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:46.578411 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc47213-aa2e-4e38-b59c-6257bd623f41 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:46.592045 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a0c50-cc2b-4882-82e2-c3e421674ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:46.593444 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a0c50-cc2b-4882-82e2-c3e421674ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:46.594174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a0c50-cc2b-4882-82e2-c3e421674ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:46.594624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a0c50-cc2b-4882-82e2-c3e421674ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:46.595789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a0c50-cc2b-4882-82e2-c3e421674ad6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:46.597034 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a0c50-cc2b-4882-82e2-c3e421674ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:46.598870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a0c50-cc2b-4882-82e2-c3e421674ad6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:46.609665 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 136/263] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:04:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:46.615981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a0c50-cc2b-4882-82e2-c3e421674ad6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:46.640830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aba109-5da1-468c-92be-798f9806428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:46.642007 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aba109-5da1-468c-92be-798f9806428c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:46.642478 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aba109-5da1-468c-92be-798f9806428c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:46.642936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aba109-5da1-468c-92be-798f9806428c None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:46.649019 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aba109-5da1-468c-92be-798f9806428c None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:46.650552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aba109-5da1-468c-92be-798f9806428c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:46.652654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 128/264] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:46 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:46.668368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aba109-5da1-468c-92be-798f9806428c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:46.706047 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:46.743891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:46.774875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a0c50-cc2b-4882-82e2-c3e421674ad6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:46.838900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e146d-70fb-42d1-89c0-848f678f17af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:46.839746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e146d-70fb-42d1-89c0-848f678f17af None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:46.840027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e146d-70fb-42d1-89c0-848f678f17af None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:46.840326 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e146d-70fb-42d1-89c0-848f678f17af None admin] PATH_INFO: `/v3/users/ae21c20424254f9faf6bdca3fdf1d49c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:46.842557 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e146d-70fb-42d1-89c0-848f678f17af None admin] RBAC: Authorizing `identity:get_user(user_id=ae21c20424254f9faf6bdca3fdf1d49c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:46.844274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e146d-70fb-42d1-89c0-848f678f17af None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:46.846407 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 137/265] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:46 2022] GET /identity/v3/users/ae21c20424254f9faf6bdca3fdf1d49c => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:46.852289 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e146d-70fb-42d1-89c0-848f678f17af None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:46.939907 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aba109-5da1-468c-92be-798f9806428c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:46.997886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb64af-bb36-40d0-a350-da8977d6568c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:46.998567 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb64af-bb36-40d0-a350-da8977d6568c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:46.998856 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb64af-bb36-40d0-a350-da8977d6568c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:46.999137 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb64af-bb36-40d0-a350-da8977d6568c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:46.999975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb64af-bb36-40d0-a350-da8977d6568c None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0, user.id=ae21c20424254f9faf6bdca3fdf1d49c) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:47.000311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb64af-bb36-40d0-a350-da8977d6568c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:47.001766 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb64af-bb36-40d0-a350-da8977d6568c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:47.014980 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 129/266] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:46 2022] GET /identity/v3/role_assignments?user.id=ae21c20424254f9faf6bdca3fdf1d49c&scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 608 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:47.032352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e146d-70fb-42d1-89c0-848f678f17af None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:47.093272 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d97d26-0f2b-46f9-ae01-7b9e8648c56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:47.093887 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d97d26-0f2b-46f9-ae01-7b9e8648c56d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:47.094177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d97d26-0f2b-46f9-ae01-7b9e8648c56d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:47.094460 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d97d26-0f2b-46f9-ae01-7b9e8648c56d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:47.130399 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:47.186509 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d97d26-0f2b-46f9-ae01-7b9e8648c56d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:47.188016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d97d26-0f2b-46f9-ae01-7b9e8648c56d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:47.215646 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5131-66eb-4546-af1c-99568621c822 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:47.215972 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5131-66eb-4546-af1c-99568621c822 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:47.216200 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5131-66eb-4546-af1c-99568621c822 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:47.217853 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 130/267] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:47.223661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426a045-db36-4a39-bbb6-14a1b543f5b0 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:47.223947 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426a045-db36-4a39-bbb6-14a1b543f5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:47.224225 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426a045-db36-4a39-bbb6-14a1b543f5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:47.256481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8426a045-db36-4a39-bbb6-14a1b543f5b0 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:47.259751 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8426a045-db36-4a39-bbb6-14a1b543f5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:47.367950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 138/268] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 16:04:47.369482 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00e4ce-baae-4591-93ed-3ba9a5b8731f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:47.369767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00e4ce-baae-4591-93ed-3ba9a5b8731f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:47.370042 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00e4ce-baae-4591-93ed-3ba9a5b8731f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:47.371534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 139/269] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:47.371895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 131/270] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:47.380956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426a045-db36-4a39-bbb6-14a1b543f5b0 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:47.381359 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7190af-0234-4914-b61c-1360b57fc7f3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:47.381650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7190af-0234-4914-b61c-1360b57fc7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:47.381928 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7190af-0234-4914-b61c-1360b57fc7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:47.400422 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:47.406585 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-af7190af-0234-4914-b61c-1360b57fc7f3 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:47.408594 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-af7190af-0234-4914-b61c-1360b57fc7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:47.469521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:47.496613 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 140/271] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:47.505432 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7190af-0234-4914-b61c-1360b57fc7f3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:47.529207 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426a045-db36-4a39-bbb6-14a1b543f5b0 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:47.574959 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fed60f-013d-474f-b095-3f384614d6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:47.576460 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fed60f-013d-474f-b095-3f384614d6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:47.577053 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fed60f-013d-474f-b095-3f384614d6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:47.577929 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fed60f-013d-474f-b095-3f384614d6f2 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:47.579347 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fed60f-013d-474f-b095-3f384614d6f2 None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:47.582011 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fed60f-013d-474f-b095-3f384614d6f2 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:47.585081 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 132/272] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:47 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:47.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fed60f-013d-474f-b095-3f384614d6f2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:47.645292 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7190af-0234-4914-b61c-1360b57fc7f3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:47.687659 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:47.691663 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384dc1c-3bb3-4fca-89ba-39f590298492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:47.692922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384dc1c-3bb3-4fca-89ba-39f590298492 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:47.693345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384dc1c-3bb3-4fca-89ba-39f590298492 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:47.693937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384dc1c-3bb3-4fca-89ba-39f590298492 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:47.707532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384dc1c-3bb3-4fca-89ba-39f590298492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:47.716398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fed60f-013d-474f-b095-3f384614d6f2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:47.717639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-5384dc1c-3bb3-4fca-89ba-39f590298492 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:47.717639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:47.717639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:47.717639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:47.717639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:47.717639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:47.717639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:47.717639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:47.717639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:47.717639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:47.717639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:47.717639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:47.717639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:47.717639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:47.717639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:47.717639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:47.718629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:47.718629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:47.718629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:47.718629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:47.718629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:47.718629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:47.718629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:47.718629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:47.718629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:47.718629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:47.718629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:47.718629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:47.718629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:47.718629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:47.718629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:47.718629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:47.719408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:47.719408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:47.719408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:47.719408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:47.719408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:47.719408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:47.719408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:47.719408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:47.719408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:47.719408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:47.719408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:47.719408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:47.722683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 141/273] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:47.728245 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384dc1c-3bb3-4fca-89ba-39f590298492 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:47.758757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c0627-95aa-4d74-a2ed-b902671a0414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:47.759570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c0627-95aa-4d74-a2ed-b902671a0414 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:47.759852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c0627-95aa-4d74-a2ed-b902671a0414 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:47.760458 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c0627-95aa-4d74-a2ed-b902671a0414 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:47.761458 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c0627-95aa-4d74-a2ed-b902671a0414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:47.763084 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c0627-95aa-4d74-a2ed-b902671a0414 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:47.765200 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 133/274] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:47.766004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c0627-95aa-4d74-a2ed-b902671a0414 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:47.782793 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:47.854207 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384dc1c-3bb3-4fca-89ba-39f590298492 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:47.894616 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ca7a1-7afa-4461-8649-682a19dfdb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:47.895366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ca7a1-7afa-4461-8649-682a19dfdb2a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:47.895593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ca7a1-7afa-4461-8649-682a19dfdb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:47.895874 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ca7a1-7afa-4461-8649-682a19dfdb2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:47.896769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ca7a1-7afa-4461-8649-682a19dfdb2a None admin] RBAC: Adding query filter params (role.id=e4ade3cd570d4865b356cbe822b76fe9, scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0, user.id=ae21c20424254f9faf6bdca3fdf1d49c) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:47.897085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ca7a1-7afa-4461-8649-682a19dfdb2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:47.898739 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ca7a1-7afa-4461-8649-682a19dfdb2a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:47.906556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 142/275] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:47 2022] GET /identity/v3/role_assignments?user.id=ae21c20424254f9faf6bdca3fdf1d49c&scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0&role.id=e4ade3cd570d4865b356cbe822b76fe9 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:47.908330 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ca7a1-7afa-4461-8649-682a19dfdb2a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:47.920665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c0627-95aa-4d74-a2ed-b902671a0414 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:47.970785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067cfb4-bffb-42b0-80b9-e67808d1da9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:47.971479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067cfb4-bffb-42b0-80b9-e67808d1da9f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:47.971761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067cfb4-bffb-42b0-80b9-e67808d1da9f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:47.972070 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067cfb4-bffb-42b0-80b9-e67808d1da9f None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:47.972872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067cfb4-bffb-42b0-80b9-e67808d1da9f None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:47.973810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067cfb4-bffb-42b0-80b9-e67808d1da9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:47.975381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067cfb4-bffb-42b0-80b9-e67808d1da9f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:47.989210 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 134/276] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:47.996032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067cfb4-bffb-42b0-80b9-e67808d1da9f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:48.008072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:48.102295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ca7a1-7afa-4461-8649-682a19dfdb2a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:48.119071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:48.139917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067cfb4-bffb-42b0-80b9-e67808d1da9f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:48.155450 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796875c-542b-4294-9231-be5399bd345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:48.156058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796875c-542b-4294-9231-be5399bd345e None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:48.156420 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796875c-542b-4294-9231-be5399bd345e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:48.156665 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796875c-542b-4294-9231-be5399bd345e None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:48.157385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796875c-542b-4294-9231-be5399bd345e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:48.158851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796875c-542b-4294-9231-be5399bd345e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:48.183735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b340fa-a2b7-4e7d-af3e-038a8d884f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:48.184842 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b340fa-a2b7-4e7d-af3e-038a8d884f4a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:48.185241 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b340fa-a2b7-4e7d-af3e-038a8d884f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:48.185441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b340fa-a2b7-4e7d-af3e-038a8d884f4a None admin] PATH_INFO: `/v3/users/4e75aa374a314110bb44c7a132db24e9` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:48.196754 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 143/277] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:04:47 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:04:48.199081 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b80c33-9974-449a-a762-9f505f724ed7 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:48.199081 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b80c33-9974-449a-a762-9f505f724ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:48.199314 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b80c33-9974-449a-a762-9f505f724ed7 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:48.200731 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 144/278] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:48.204894 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b340fa-a2b7-4e7d-af3e-038a8d884f4a None admin] RBAC: Authorizing `identity:get_user(user_id=4e75aa374a314110bb44c7a132db24e9)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:48.206896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b340fa-a2b7-4e7d-af3e-038a8d884f4a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:48.207086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8c7c0-5360-4a62-bf80-8be475c2e001 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:48.207384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8c7c0-5360-4a62-bf80-8be475c2e001 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:48.207657 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8c7c0-5360-4a62-bf80-8be475c2e001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:48.209728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 135/279] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:47 2022] GET /identity/v3/users/4e75aa374a314110bb44c7a132db24e9 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:48.217549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b340fa-a2b7-4e7d-af3e-038a8d884f4a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:48.243820 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-46c8c7c0-5360-4a62-bf80-8be475c2e001 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:48.245443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-46c8c7c0-5360-4a62-bf80-8be475c2e001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:48.295143 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:48.339228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b340fa-a2b7-4e7d-af3e-038a8d884f4a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:48.340358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 145/280] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:48.354789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8c7c0-5360-4a62-bf80-8be475c2e001 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:48.378881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52d7ed-45f9-4e01-bf6a-d0a972976f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:48.379300 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52d7ed-45f9-4e01-bf6a-d0a972976f2a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:48.379683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52d7ed-45f9-4e01-bf6a-d0a972976f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:48.379966 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52d7ed-45f9-4e01-bf6a-d0a972976f2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:48.380835 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52d7ed-45f9-4e01-bf6a-d0a972976f2a None admin] RBAC: Adding query filter params (role.id=6a0b49157bc649ef99e870c62ee6f4fe, user.id=4e75aa374a314110bb44c7a132db24e9, scope.system=all) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:48.381144 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52d7ed-45f9-4e01-bf6a-d0a972976f2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:48.382656 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52d7ed-45f9-4e01-bf6a-d0a972976f2a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:48.388102 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 136/281] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Jul 25 16:04:48 2022] GET /identity/v3/role_assignments?user.id=4e75aa374a314110bb44c7a132db24e9&scope.system=all&role.id=6a0b49157bc649ef99e870c62ee6f4fe => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:48.474067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8c7c0-5360-4a62-bf80-8be475c2e001 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:48.477984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:48.520160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a6aae-74f3-40b0-a6d0-23a2d9abc26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:48.521247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a6aae-74f3-40b0-a6d0-23a2d9abc26d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:48.521705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a6aae-74f3-40b0-a6d0-23a2d9abc26d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:48.522146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a6aae-74f3-40b0-a6d0-23a2d9abc26d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:48.535416 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a6aae-74f3-40b0-a6d0-23a2d9abc26d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:48.543737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-1d9a6aae-74f3-40b0-a6d0-23a2d9abc26d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:48.543737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:48.543737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:48.543737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:48.543737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:48.543737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:48.543737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:48.543737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:48.543737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:48.543737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:48.543737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:48.543737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:48.543737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:48.543737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:48.543737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:48.543737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:48.544891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:48.544891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:48.544891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:48.544891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:48.544891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:48.544891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:48.544891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:48.544891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:48.544891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:48.544891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:48.544891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:48.544891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:48.544891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:48.544891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:48.544891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:48.544891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:48.545843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:48.545843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:48.545843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:48.545843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:48.545843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:48.545843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:48.545843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:48.545843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:48.545843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:48.545843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:48.545843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:48.545843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:48.547943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 146/282] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:04:48.554583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52d7ed-45f9-4e01-bf6a-d0a972976f2a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:48.666088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52d7ed-45f9-4e01-bf6a-d0a972976f2a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:48.695592 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:48.705877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f7360-231a-47de-92e0-9b82add8bd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:48.706854 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f7360-231a-47de-92e0-9b82add8bd16 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:48.707307 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f7360-231a-47de-92e0-9b82add8bd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:48.707727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f7360-231a-47de-92e0-9b82add8bd16 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:48.708708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f7360-231a-47de-92e0-9b82add8bd16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:48.709224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f7360-231a-47de-92e0-9b82add8bd16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:48.710772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f7360-231a-47de-92e0-9b82add8bd16 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:48.724427 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 137/283] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:48.726358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a6aae-74f3-40b0-a6d0-23a2d9abc26d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:48.839064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a6aae-74f3-40b0-a6d0-23a2d9abc26d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:48.875343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe57062-5d18-4e6a-ab3c-07aaed6124ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:48.876535 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe57062-5d18-4e6a-ab3c-07aaed6124ec None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:48.876964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe57062-5d18-4e6a-ab3c-07aaed6124ec None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:48.877385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe57062-5d18-4e6a-ab3c-07aaed6124ec None admin] PATH_INFO: `/v3/users/95481000a67844eeb6f900ae670da719` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:48.878826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe57062-5d18-4e6a-ab3c-07aaed6124ec None admin] RBAC: Authorizing `identity:get_user(user_id=95481000a67844eeb6f900ae670da719)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:48.880467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe57062-5d18-4e6a-ab3c-07aaed6124ec None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:48.886792 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 147/284] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:48 2022] GET /identity/v3/users/95481000a67844eeb6f900ae670da719 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:48.888422 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f7360-231a-47de-92e0-9b82add8bd16 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:48.932698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bd776-da67-4d7c-8406-e3434490377c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:48.933215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bd776-da67-4d7c-8406-e3434490377c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:48.933635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bd776-da67-4d7c-8406-e3434490377c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:48.935454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 148/285] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:04:48.941775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc551db5-15c1-4e8d-a180-b09633b243f3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:48.942365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc551db5-15c1-4e8d-a180-b09633b243f3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:48.942787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc551db5-15c1-4e8d-a180-b09633b243f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:48.963250 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bc551db5-15c1-4e8d-a180-b09633b243f3 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:48.964841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bc551db5-15c1-4e8d-a180-b09633b243f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:48.984942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:49.045023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 149/286] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:49.058327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f7360-231a-47de-92e0-9b82add8bd16 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:49.091958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc551db5-15c1-4e8d-a180-b09633b243f3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:49.141640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ae8c1-2eb2-40be-bc8f-098dbb17a581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:49.142797 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ae8c1-2eb2-40be-bc8f-098dbb17a581 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:49.142797 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ae8c1-2eb2-40be-bc8f-098dbb17a581 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:49.143083 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ae8c1-2eb2-40be-bc8f-098dbb17a581 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:49.149107 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ae8c1-2eb2-40be-bc8f-098dbb17a581 None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:49.150618 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ae8c1-2eb2-40be-bc8f-098dbb17a581 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:49.157332 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 138/287] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:48 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:49.159879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ae8c1-2eb2-40be-bc8f-098dbb17a581 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:49.222643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc551db5-15c1-4e8d-a180-b09633b243f3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:49.301633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d69d0f-840c-4937-81b6-3a701608f0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:49.302265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:49.303956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d69d0f-840c-4937-81b6-3a701608f0bf None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:49.305296 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d69d0f-840c-4937-81b6-3a701608f0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:49.306501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d69d0f-840c-4937-81b6-3a701608f0bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:49.326512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d69d0f-840c-4937-81b6-3a701608f0bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:49.336040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e6d69d0f-840c-4937-81b6-3a701608f0bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:49.336040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:49.336040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:49.336040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:49.336040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:49.336040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:49.336040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:49.336040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:49.336040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:49.336040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:49.336040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:49.336040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:49.336040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:49.336040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:49.336040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:49.336040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:49.336956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:49.336956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:49.336956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:49.336956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:49.336956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:49.336956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:49.336956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:49.336956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:49.336956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:49.336956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:49.336956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:49.336956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:49.336956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:49.336956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:49.336956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:49.336956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:49.337727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:49.337727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:49.337727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:49.337727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:49.337727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:49.337727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:49.337727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:49.337727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:49.337727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:49.337727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:49.337727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:49.337727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:49.345299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 150/288] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:04:49.351144 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d69d0f-840c-4937-81b6-3a701608f0bf None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:49.381685 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:49.392690 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ae8c1-2eb2-40be-bc8f-098dbb17a581 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:49.463356 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf722f7-a2ed-423a-9bfb-3aac7b620a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:49.464580 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf722f7-a2ed-423a-9bfb-3aac7b620a64 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:49.466033 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf722f7-a2ed-423a-9bfb-3aac7b620a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:49.466538 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf722f7-a2ed-423a-9bfb-3aac7b620a64 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0/users/95481000a67844eeb6f900ae670da719/roles/defadc42e7f7403fafbf9c95017e276f` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:49.470737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf722f7-a2ed-423a-9bfb-3aac7b620a64 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe640fcb276d4bdabd5a537cc3153aa0, user_id=95481000a67844eeb6f900ae670da719, role_id=defadc42e7f7403fafbf9c95017e276f)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:49.473637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf722f7-a2ed-423a-9bfb-3aac7b620a64 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:49.497210 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 139/289] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:04:49 2022] PUT /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0/users/95481000a67844eeb6f900ae670da719/roles/defadc42e7f7403fafbf9c95017e276f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:04:49.543241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d69d0f-840c-4937-81b6-3a701608f0bf None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:49.587959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb96c5a-b540-4ec2-89ad-fdb75de9f7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:49.588590 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb96c5a-b540-4ec2-89ad-fdb75de9f7be None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:49.588875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb96c5a-b540-4ec2-89ad-fdb75de9f7be None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:49.589151 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb96c5a-b540-4ec2-89ad-fdb75de9f7be None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:49.589909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb96c5a-b540-4ec2-89ad-fdb75de9f7be None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:49.590220 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb96c5a-b540-4ec2-89ad-fdb75de9f7be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:49.591605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb96c5a-b540-4ec2-89ad-fdb75de9f7be None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:49.601280 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 151/290] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:49.607667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf722f7-a2ed-423a-9bfb-3aac7b620a64 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:49.760921 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf722f7-a2ed-423a-9bfb-3aac7b620a64 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:49.787265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:49.808538 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b2cb1-97ec-4e3f-846c-3be8f21248bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:49.809459 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b2cb1-97ec-4e3f-846c-3be8f21248bc None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:49.809742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b2cb1-97ec-4e3f-846c-3be8f21248bc None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:49.810019 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b2cb1-97ec-4e3f-846c-3be8f21248bc None admin] PATH_INFO: `/v3/users/b2621ba5bca7405eb123c8d83b958db2` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:49.812242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b2cb1-97ec-4e3f-846c-3be8f21248bc None admin] RBAC: Authorizing `identity:get_user(user_id=b2621ba5bca7405eb123c8d83b958db2)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:49.813751 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b2cb1-97ec-4e3f-846c-3be8f21248bc None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:49.816358 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 140/291] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:49 2022] GET /identity/v3/users/b2621ba5bca7405eb123c8d83b958db2 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:49.821523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb96c5a-b540-4ec2-89ad-fdb75de9f7be None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:49.904085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:49.943071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb96c5a-b540-4ec2-89ad-fdb75de9f7be None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:49.992925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2174e7-4bf2-4393-bf92-2d55877a9269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:49.993581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2174e7-4bf2-4393-bf92-2d55877a9269 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:49.993863 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2174e7-4bf2-4393-bf92-2d55877a9269 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:49.994139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2174e7-4bf2-4393-bf92-2d55877a9269 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:50.085347 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2174e7-4bf2-4393-bf92-2d55877a9269 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:50.086815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2174e7-4bf2-4393-bf92-2d55877a9269 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:50.186508 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:50.220167 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 152/292] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:50.226181 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b2cb1-97ec-4e3f-846c-3be8f21248bc None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:50.370161 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b2cb1-97ec-4e3f-846c-3be8f21248bc None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:50.405566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cd193-dfea-43a7-b387-ffd9485ad1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:50.406853 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cd193-dfea-43a7-b387-ffd9485ad1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:50.407143 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cd193-dfea-43a7-b387-ffd9485ad1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:50.407469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cd193-dfea-43a7-b387-ffd9485ad1c0 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:50.408769 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cd193-dfea-43a7-b387-ffd9485ad1c0 None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:50.410365 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cd193-dfea-43a7-b387-ffd9485ad1c0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:50.412433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 141/293] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:50 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:50.418148 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2174e7-4bf2-4393-bf92-2d55877a9269 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:50.560652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2174e7-4bf2-4393-bf92-2d55877a9269 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:50.614384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf2d60-738b-4753-b324-2dfbc9118f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:50.615436 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf2d60-738b-4753-b324-2dfbc9118f44 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:50.615944 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf2d60-738b-4753-b324-2dfbc9118f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:50.616441 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf2d60-738b-4753-b324-2dfbc9118f44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:50.617532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf2d60-738b-4753-b324-2dfbc9118f44 None admin] RBAC: Adding query filter params (role.id=6a0b49157bc649ef99e870c62ee6f4fe, scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0, user.id=b2621ba5bca7405eb123c8d83b958db2) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:50.618105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf2d60-738b-4753-b324-2dfbc9118f44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:50.619794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf2d60-738b-4753-b324-2dfbc9118f44 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:50.629422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 153/294] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:50 2022] GET /identity/v3/role_assignments?user.id=b2621ba5bca7405eb123c8d83b958db2&scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0&role.id=6a0b49157bc649ef99e870c62ee6f4fe => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:50.782096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f887326-fa78-4785-9fa1-6335de306fbd None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:50.782429 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f887326-fa78-4785-9fa1-6335de306fbd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:50.782714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f887326-fa78-4785-9fa1-6335de306fbd None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:50.784904 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 142/295] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:50.790566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda34a6a-b956-45fb-8ed8-2ef48e9f42b0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:50.791206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda34a6a-b956-45fb-8ed8-2ef48e9f42b0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:50.791707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda34a6a-b956-45fb-8ed8-2ef48e9f42b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:50.821610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-cda34a6a-b956-45fb-8ed8-2ef48e9f42b0 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:50.823619 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cda34a6a-b956-45fb-8ed8-2ef48e9f42b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:50.861971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:50.908571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 154/296] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:50.932863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f887326-fa78-4785-9fa1-6335de306fbd None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:50.981937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bec7d7-c808-4026-8535-9fa137de536d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:50.982231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bec7d7-c808-4026-8535-9fa137de536d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:50.982506 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bec7d7-c808-4026-8535-9fa137de536d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:50.984036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 155/297] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:50.988971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23cd08-7de4-458d-b81c-4d0389e5cf3d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:50.989267 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23cd08-7de4-458d-b81c-4d0389e5cf3d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:50.989550 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23cd08-7de4-458d-b81c-4d0389e5cf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:51.001977 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:51.017382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4a23cd08-7de4-458d-b81c-4d0389e5cf3d None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:51.018502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4a23cd08-7de4-458d-b81c-4d0389e5cf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:51.063088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f887326-fa78-4785-9fa1-6335de306fbd None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:51.098340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 156/298] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:51.099782 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed52924-6ae1-4192-9b20-7683bdbf061f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:51.100085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed52924-6ae1-4192-9b20-7683bdbf061f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:51.100408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed52924-6ae1-4192-9b20-7683bdbf061f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:51.102010 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 157/299] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:51.103502 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46c2ab-8b7d-41d8-8883-7d3e6727c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:51.104639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46c2ab-8b7d-41d8-8883-7d3e6727c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:51.105145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46c2ab-8b7d-41d8-8883-7d3e6727c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:51.105620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46c2ab-8b7d-41d8-8883-7d3e6727c9a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:51.107992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7198d-2a7c-4690-8144-ffd505146746 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:51.109711 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7198d-2a7c-4690-8144-ffd505146746 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:51.109711 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7198d-2a7c-4690-8144-ffd505146746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:51.123362 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46c2ab-8b7d-41d8-8883-7d3e6727c9a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:51.132455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-5d46c2ab-8b7d-41d8-8883-7d3e6727c9a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:51.132455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:51.132455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:51.132455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:51.132455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:51.132455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:51.132455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:51.132455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:51.132455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:51.132455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:51.132455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:51.132455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:51.132455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:51.132455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:51.132455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:51.132455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:51.133343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:51.133343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:51.133343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:51.133343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:51.133343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:51.133343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:51.133343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:51.133343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:51.133343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:51.133343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:51.133343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:51.133343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:51.133343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:51.133343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:51.133343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:51.133343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:51.134115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:51.134115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:51.134115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:51.134115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:51.134115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:51.134115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:51.134115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:51.134115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:51.134115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:51.134115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:51.134115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:51.134115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:51.134778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b6b7198d-2a7c-4690-8144-ffd505146746 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:51.134778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b6b7198d-2a7c-4690-8144-ffd505146746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:51.137037 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 143/300] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:51.138088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46c2ab-8b7d-41d8-8883-7d3e6727c9a3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:51.215770 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 158/301] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:51.225537 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7198d-2a7c-4690-8144-ffd505146746 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:51.256851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46c2ab-8b7d-41d8-8883-7d3e6727c9a3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:51.269613 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:51.271619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:51.296552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fade7-b82a-4c35-87ff-9442fa711a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:51.297361 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fade7-b82a-4c35-87ff-9442fa711a29 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:51.297639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fade7-b82a-4c35-87ff-9442fa711a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:51.297926 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fade7-b82a-4c35-87ff-9442fa711a29 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:51.309204 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fade7-b82a-4c35-87ff-9442fa711a29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:51.317314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-583fade7-b82a-4c35-87ff-9442fa711a29 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:51.317314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:51.317314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:51.317314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:51.317314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:51.317314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:51.317314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:51.317314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:51.317314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:51.317314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:51.317314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:51.317314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:51.317314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:51.317314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:51.317314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:51.317314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:51.318265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:51.318265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:51.318265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:51.318265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:51.318265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:51.318265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:51.318265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:51.318265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:51.318265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:51.318265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:51.318265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:51.318265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:51.318265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:51.318265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:51.318265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:51.318265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:51.319036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:51.319036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:51.319036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:51.319036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:51.319036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:51.319036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:51.319036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:51.319036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:51.319036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:51.319036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:51.319036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:51.319036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:51.319036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 144/302] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:51.320118 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fade7-b82a-4c35-87ff-9442fa711a29 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:51.353199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7198d-2a7c-4690-8144-ffd505146746 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:51.390333 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb225f-1d1f-4339-96b2-bdde81d886f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:51.391011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb225f-1d1f-4339-96b2-bdde81d886f9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:51.391296 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb225f-1d1f-4339-96b2-bdde81d886f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:51.391569 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb225f-1d1f-4339-96b2-bdde81d886f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:51.392347 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb225f-1d1f-4339-96b2-bdde81d886f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:51.392655 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb225f-1d1f-4339-96b2-bdde81d886f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:51.394145 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb225f-1d1f-4339-96b2-bdde81d886f9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:51.407879 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 159/303] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:51.407879 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb225f-1d1f-4339-96b2-bdde81d886f9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:51.434984 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fade7-b82a-4c35-87ff-9442fa711a29 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:51.474852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981194b-d866-4084-825e-101392d30be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:51.475712 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981194b-d866-4084-825e-101392d30be8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:51.475997 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981194b-d866-4084-825e-101392d30be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:51.476304 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981194b-d866-4084-825e-101392d30be8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:51.477482 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981194b-d866-4084-825e-101392d30be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:51.478956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981194b-d866-4084-825e-101392d30be8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:51.480802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 145/304] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:51.481394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981194b-d866-4084-825e-101392d30be8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:51.507850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:51.518407 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb225f-1d1f-4339-96b2-bdde81d886f9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:51.529893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:51.566109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873ff47-0a04-4a12-880b-3ee5c2363ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:51.566856 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873ff47-0a04-4a12-880b-3ee5c2363ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:51.567140 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873ff47-0a04-4a12-880b-3ee5c2363ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:51.567428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873ff47-0a04-4a12-880b-3ee5c2363ea2 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:51.568215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873ff47-0a04-4a12-880b-3ee5c2363ea2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:51.568558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873ff47-0a04-4a12-880b-3ee5c2363ea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:51.569957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873ff47-0a04-4a12-880b-3ee5c2363ea2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:51.578344 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 160/305] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:51.579143 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873ff47-0a04-4a12-880b-3ee5c2363ea2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:51.611972 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981194b-d866-4084-825e-101392d30be8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:51.650609 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70916bcf-2928-4a7e-926d-b132cf50be86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:51.652168 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70916bcf-2928-4a7e-926d-b132cf50be86 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:51.652474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70916bcf-2928-4a7e-926d-b132cf50be86 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:51.653018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70916bcf-2928-4a7e-926d-b132cf50be86 None admin] PATH_INFO: `/v3/users/4e75aa374a314110bb44c7a132db24e9` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:51.654236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70916bcf-2928-4a7e-926d-b132cf50be86 None admin] RBAC: Authorizing `identity:get_user(user_id=4e75aa374a314110bb44c7a132db24e9)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:51.655956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70916bcf-2928-4a7e-926d-b132cf50be86 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:51.663323 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 146/306] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:51 2022] GET /identity/v3/users/4e75aa374a314110bb44c7a132db24e9 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:51.663323 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70916bcf-2928-4a7e-926d-b132cf50be86 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:51.694473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873ff47-0a04-4a12-880b-3ee5c2363ea2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:51.736087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9089bc-10b7-4ec5-ba98-dd6f7fdef67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:51.736791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9089bc-10b7-4ec5-ba98-dd6f7fdef67c None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:51.737076 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9089bc-10b7-4ec5-ba98-dd6f7fdef67c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:51.737432 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9089bc-10b7-4ec5-ba98-dd6f7fdef67c None admin] PATH_INFO: `/v3/groups` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:51.738157 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9089bc-10b7-4ec5-ba98-dd6f7fdef67c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:51.739584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9089bc-10b7-4ec5-ba98-dd6f7fdef67c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:51.756579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 161/307] 10.222.0.70 () {60 vars in 1134 bytes} [Mon Jul 25 16:04:51 2022] POST /identity/v3/groups => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:04:51.757622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9089bc-10b7-4ec5-ba98-dd6f7fdef67c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:51.774829 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:51.810538 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70916bcf-2928-4a7e-926d-b132cf50be86 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:51.827843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:51.862232 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b352057-5821-4ccc-a6ca-59ee32847ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:51.864523 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b352057-5821-4ccc-a6ca-59ee32847ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:51.865043 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b352057-5821-4ccc-a6ca-59ee32847ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:51.865934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b352057-5821-4ccc-a6ca-59ee32847ff9 None admin] PATH_INFO: `/v3/users/cd55fc17649b4e28abfa0a4e49c92357` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:51.886199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b352057-5821-4ccc-a6ca-59ee32847ff9 None admin] RBAC: Authorizing `identity:get_user(user_id=cd55fc17649b4e28abfa0a4e49c92357)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:51.887712 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b352057-5821-4ccc-a6ca-59ee32847ff9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:51.889542 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 147/308] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:51 2022] GET /identity/v3/users/cd55fc17649b4e28abfa0a4e49c92357 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:51.895661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b352057-5821-4ccc-a6ca-59ee32847ff9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:51.898191 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9089bc-10b7-4ec5-ba98-dd6f7fdef67c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:51.945828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe3450-c9e4-4b95-b394-f66c2ffebde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:51.946142 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe3450-c9e4-4b95-b394-f66c2ffebde4 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:51.946473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe3450-c9e4-4b95-b394-f66c2ffebde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:51.946758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe3450-c9e4-4b95-b394-f66c2ffebde4 None admin] PATH_INFO: `/v3/system/users/4e75aa374a314110bb44c7a132db24e9/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:51.949092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe3450-c9e4-4b95-b394-f66c2ffebde4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4e75aa374a314110bb44c7a132db24e9, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:51.949738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe3450-c9e4-4b95-b394-f66c2ffebde4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:51.962357 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 162/309] 10.222.0.70 () {58 vars in 1334 bytes} [Mon Jul 25 16:04:51 2022] PUT /identity/v3/system/users/4e75aa374a314110bb44c7a132db24e9/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:04:52.028855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b352057-5821-4ccc-a6ca-59ee32847ff9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:52.070684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf2993-2290-4d0a-8b22-4a0d4d97bdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:52.071375 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf2993-2290-4d0a-8b22-4a0d4d97bdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:52.071663 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf2993-2290-4d0a-8b22-4a0d4d97bdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:52.071945 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf2993-2290-4d0a-8b22-4a0d4d97bdd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:52.072828 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf2993-2290-4d0a-8b22-4a0d4d97bdd4 None admin] RBAC: Adding query filter params (role.id=defadc42e7f7403fafbf9c95017e276f, user.id=cd55fc17649b4e28abfa0a4e49c92357, scope.system=all) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:52.073268 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf2993-2290-4d0a-8b22-4a0d4d97bdd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:52.075021 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf2993-2290-4d0a-8b22-4a0d4d97bdd4 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:52.081764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 148/310] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Jul 25 16:04:51 2022] GET /identity/v3/role_assignments?user.id=cd55fc17649b4e28abfa0a4e49c92357&scope.system=all&role.id=defadc42e7f7403fafbf9c95017e276f => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:52.243349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68939531-8e7b-4c2c-9cd8-6ef3bf1cd90b None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:52.243658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68939531-8e7b-4c2c-9cd8-6ef3bf1cd90b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:52.243921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68939531-8e7b-4c2c-9cd8-6ef3bf1cd90b None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:52.245606 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 163/311] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:52.251123 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6c0c2-5816-4552-afee-3db9807ea210 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:52.251412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6c0c2-5816-4552-afee-3db9807ea210 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:52.251692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6c0c2-5816-4552-afee-3db9807ea210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:52.272455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a5f6c0c2-5816-4552-afee-3db9807ea210 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:52.273785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a5f6c0c2-5816-4552-afee-3db9807ea210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:52.306653 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:52.356086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 149/312] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:52.379539 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68939531-8e7b-4c2c-9cd8-6ef3bf1cd90b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:52.465410 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:52.493083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68939531-8e7b-4c2c-9cd8-6ef3bf1cd90b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:52.529974 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9474bf-8fa9-4846-9e68-d7a824858151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:52.530772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9474bf-8fa9-4846-9e68-d7a824858151 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:52.531052 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9474bf-8fa9-4846-9e68-d7a824858151 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:52.531324 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9474bf-8fa9-4846-9e68-d7a824858151 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:52.542452 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9474bf-8fa9-4846-9e68-d7a824858151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:52.550943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-fb9474bf-8fa9-4846-9e68-d7a824858151 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:52.550943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:52.550943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:52.550943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:52.550943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:52.550943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:52.550943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:52.550943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:52.550943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:52.550943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:52.550943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:52.550943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:52.550943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:52.550943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:52.550943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:52.550943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:52.551789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:52.551789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:52.551789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:52.551789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:52.551789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:52.551789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:52.551789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:52.551789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:52.551789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:52.551789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:52.551789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:52.551789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:52.551789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:52.551789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:52.551789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:52.551789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:52.552620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:52.552620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:52.552620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:52.552620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:52.552620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:52.552620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:52.552620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:52.552620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:52.552620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:52.552620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:52.552620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:52.552620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:52.552620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 164/313] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:52.558035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6c0c2-5816-4552-afee-3db9807ea210 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:52.664768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6c0c2-5816-4552-afee-3db9807ea210 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:52.701467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf91df-0ec7-4b25-820d-0fe88bcdeb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:52.702151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf91df-0ec7-4b25-820d-0fe88bcdeb47 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:52.702438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf91df-0ec7-4b25-820d-0fe88bcdeb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:52.702718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf91df-0ec7-4b25-820d-0fe88bcdeb47 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:52.703478 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf91df-0ec7-4b25-820d-0fe88bcdeb47 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:52.703795 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf91df-0ec7-4b25-820d-0fe88bcdeb47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:52.705223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf91df-0ec7-4b25-820d-0fe88bcdeb47 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:52.715129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 150/314] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:52.720648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9474bf-8fa9-4846-9e68-d7a824858151 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:52.832591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9474bf-8fa9-4846-9e68-d7a824858151 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:52.869068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e561f3a-a0b9-4e80-9c20-838b8bf42018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:52.869967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e561f3a-a0b9-4e80-9c20-838b8bf42018 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:52.870253 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e561f3a-a0b9-4e80-9c20-838b8bf42018 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:52.870529 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e561f3a-a0b9-4e80-9c20-838b8bf42018 None admin] PATH_INFO: `/v3/users/95481000a67844eeb6f900ae670da719` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:52.871754 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e561f3a-a0b9-4e80-9c20-838b8bf42018 None admin] RBAC: Authorizing `identity:get_user(user_id=95481000a67844eeb6f900ae670da719)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:52.873257 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e561f3a-a0b9-4e80-9c20-838b8bf42018 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:52.874923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 165/315] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:52 2022] GET /identity/v3/users/95481000a67844eeb6f900ae670da719 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:52.880574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf91df-0ec7-4b25-820d-0fe88bcdeb47 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:52.908893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:52.986534 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf91df-0ec7-4b25-820d-0fe88bcdeb47 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:53.023807 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536d5cb-5035-4ea7-83ec-a5ec1a8bd131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:53.024495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536d5cb-5035-4ea7-83ec-a5ec1a8bd131 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:53.024782 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536d5cb-5035-4ea7-83ec-a5ec1a8bd131 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:53.025066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536d5cb-5035-4ea7-83ec-a5ec1a8bd131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:53.099868 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536d5cb-5035-4ea7-83ec-a5ec1a8bd131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:53.101402 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536d5cb-5035-4ea7-83ec-a5ec1a8bd131 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:53.128680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:53.207602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 151/316] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:53.212952 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e561f3a-a0b9-4e80-9c20-838b8bf42018 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:53.217077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:53.334049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e561f3a-a0b9-4e80-9c20-838b8bf42018 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:53.368845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080f18f-f0a4-4b98-b72e-695044ff6c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:53.369631 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080f18f-f0a4-4b98-b72e-695044ff6c57 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:53.369915 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080f18f-f0a4-4b98-b72e-695044ff6c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:53.370189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080f18f-f0a4-4b98-b72e-695044ff6c57 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:53.371365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080f18f-f0a4-4b98-b72e-695044ff6c57 None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:53.372842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080f18f-f0a4-4b98-b72e-695044ff6c57 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:53.374852 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 166/317] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:53 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:53.380783 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536d5cb-5035-4ea7-83ec-a5ec1a8bd131 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:53.483002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536d5cb-5035-4ea7-83ec-a5ec1a8bd131 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:53.509334 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:53.519752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bca03-275f-40d5-9c38-0c6a22d18191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:53.520580 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bca03-275f-40d5-9c38-0c6a22d18191 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:53.520867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bca03-275f-40d5-9c38-0c6a22d18191 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:53.521147 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bca03-275f-40d5-9c38-0c6a22d18191 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:53.522156 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bca03-275f-40d5-9c38-0c6a22d18191 None admin] RBAC: Adding query filter params (role.id=defadc42e7f7403fafbf9c95017e276f, scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0, user.id=95481000a67844eeb6f900ae670da719) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:53.522473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bca03-275f-40d5-9c38-0c6a22d18191 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:53.524099 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bca03-275f-40d5-9c38-0c6a22d18191 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:53.531297 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 152/318] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:04:53 2022] GET /identity/v3/role_assignments?user.id=95481000a67844eeb6f900ae670da719&scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0&role.id=defadc42e7f7403fafbf9c95017e276f => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:53.930846 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac2068-6b97-4dc6-a89d-d0466629ee1e None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:53.931252 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac2068-6b97-4dc6-a89d-d0466629ee1e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:53.931425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac2068-6b97-4dc6-a89d-d0466629ee1e None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:53.938540 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77e6e3-ed40-47d4-9d0d-97a0dd7f3d2d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:53.939444 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77e6e3-ed40-47d4-9d0d-97a0dd7f3d2d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:53.939916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77e6e3-ed40-47d4-9d0d-97a0dd7f3d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:53.941594 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 167/319] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:53.959143 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ce77e6e3-ed40-47d4-9d0d-97a0dd7f3d2d None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:53.960364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ce77e6e3-ed40-47d4-9d0d-97a0dd7f3d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:54.035850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 153/320] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:54.058832 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac2068-6b97-4dc6-a89d-d0466629ee1e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:54.141559 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:54.175653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac2068-6b97-4dc6-a89d-d0466629ee1e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:54.193266 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65a981-dd4c-4366-afbd-f01d9b18854b None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:54.193559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65a981-dd4c-4366-afbd-f01d9b18854b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:54.193747 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65a981-dd4c-4366-afbd-f01d9b18854b None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:54.195307 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 154/321] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:04:54.200294 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c60b58-be6d-434b-bb37-c3ebca716b4f None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:54.200587 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c60b58-be6d-434b-bb37-c3ebca716b4f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:54.200864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c60b58-be6d-434b-bb37-c3ebca716b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:54.211514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6646d-fab3-4156-b19d-846b3ce6e095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:54.216224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6646d-fab3-4156-b19d-846b3ce6e095 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:54.216224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6646d-fab3-4156-b19d-846b3ce6e095 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:54.216224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6646d-fab3-4156-b19d-846b3ce6e095 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:54.216224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6646d-fab3-4156-b19d-846b3ce6e095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:54.216224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6646d-fab3-4156-b19d-846b3ce6e095 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:54.217557 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 168/322] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:04:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:54.223710 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-27c60b58-be6d-434b-bb37-c3ebca716b4f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:54.224532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9867e0-669a-4c9d-b57f-630d09efab53 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:54.224832 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9867e0-669a-4c9d-b57f-630d09efab53 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:54.224964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-27c60b58-be6d-434b-bb37-c3ebca716b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:54.225116 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9867e0-669a-4c9d-b57f-630d09efab53 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:54.227237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 169/323] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:54.227601 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9867e0-669a-4c9d-b57f-630d09efab53 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:54.310050 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 155/324] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:54.311348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503c047-4a1e-4b4b-9b78-207d4a8271d3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:54.311622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503c047-4a1e-4b4b-9b78-207d4a8271d3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:54.311898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503c047-4a1e-4b4b-9b78-207d4a8271d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:54.330087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2503c047-4a1e-4b4b-9b78-207d4a8271d3 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:54.331276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2503c047-4a1e-4b4b-9b78-207d4a8271d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:54.339152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9867e0-669a-4c9d-b57f-630d09efab53 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:54.373357 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adb140-cebd-4805-be08-4ee8491350cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:54.374031 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adb140-cebd-4805-be08-4ee8491350cc None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:54.374312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adb140-cebd-4805-be08-4ee8491350cc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:54.374591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adb140-cebd-4805-be08-4ee8491350cc None admin] PATH_INFO: `/v3/groups` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:54.374985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:54.375272 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adb140-cebd-4805-be08-4ee8491350cc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:54.376760 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adb140-cebd-4805-be08-4ee8491350cc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:54.389080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:54.401466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 170/325] 10.222.0.70 () {60 vars in 1134 bytes} [Mon Jul 25 16:04:54 2022] POST /identity/v3/groups => generated 226 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:04:54.401466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adb140-cebd-4805-be08-4ee8491350cc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:54.416299 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 156/326] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:54.436613 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503c047-4a1e-4b4b-9b78-207d4a8271d3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:54.515956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adb140-cebd-4805-be08-4ee8491350cc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:54.548088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503c047-4a1e-4b4b-9b78-207d4a8271d3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:54.557379 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ce8aa-3e1b-45bf-9482-47d90d875151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:54.558193 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ce8aa-3e1b-45bf-9482-47d90d875151 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:54.558475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ce8aa-3e1b-45bf-9482-47d90d875151 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:54.558749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ce8aa-3e1b-45bf-9482-47d90d875151 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:54.571157 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ce8aa-3e1b-45bf-9482-47d90d875151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:54.579924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-199ce8aa-3e1b-45bf-9482-47d90d875151 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:54.579924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:54.579924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:54.579924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:54.579924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:54.579924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:54.579924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:54.579924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:54.579924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:54.579924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:54.579924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:54.579924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:54.579924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:54.579924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:54.579924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:54.579924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:54.580954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:54.580954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:54.580954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:54.580954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:54.580954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:54.580954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:54.580954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:54.580954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:54.580954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:54.580954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:54.580954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:54.580954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:54.580954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:54.580954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:54.580954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:54.580954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:54.581896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:54.581896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:54.581896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:54.581896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:54.581896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:54.581896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:54.581896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:54.581896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:54.581896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:54.581896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:54.581896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:54.581896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:54.581896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 171/327] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:54.587175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ce8aa-3e1b-45bf-9482-47d90d875151 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:54.589269 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c5a6f-5fc7-4e9c-abd0-1124d1f520d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:54.590071 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c5a6f-5fc7-4e9c-abd0-1124d1f520d7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:54.590348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c5a6f-5fc7-4e9c-abd0-1124d1f520d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:54.590617 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c5a6f-5fc7-4e9c-abd0-1124d1f520d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:54.604834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c5a6f-5fc7-4e9c-abd0-1124d1f520d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:54.614153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-7b5c5a6f-5fc7-4e9c-abd0-1124d1f520d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:54.614153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:54.614153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:54.614153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:54.614153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:54.614153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:54.614153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:54.614153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:54.614153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:54.614153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:54.614153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:54.614153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:54.614153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:54.614153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:54.614153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:54.614153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:54.615182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:54.615182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:54.615182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:54.615182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:54.615182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:54.615182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:54.615182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:54.615182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:54.615182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:54.615182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:54.615182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:54.615182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:54.615182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:54.615182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:54.615182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:54.615182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:54.615933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:54.615933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:54.615933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:54.615933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:54.615933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:54.615933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:54.615933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:54.615933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:54.615933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:54.615933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:54.615933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:54.615933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:54.615933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 157/328] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:04:54.621524 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c5a6f-5fc7-4e9c-abd0-1124d1f520d7 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:54.663085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:54.680061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:54.725145 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ce8aa-3e1b-45bf-9482-47d90d875151 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:54.752278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c5a6f-5fc7-4e9c-abd0-1124d1f520d7 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:54.768221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a74bb-1510-49a3-897d-5eea1c0718aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:54.769814 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a74bb-1510-49a3-897d-5eea1c0718aa None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:54.770334 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a74bb-1510-49a3-897d-5eea1c0718aa None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:54.770802 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a74bb-1510-49a3-897d-5eea1c0718aa None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:54.772336 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a74bb-1510-49a3-897d-5eea1c0718aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:54.772336 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a74bb-1510-49a3-897d-5eea1c0718aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:54.773440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a74bb-1510-49a3-897d-5eea1c0718aa None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:54.784557 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 172/329] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:54.790529 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a74bb-1510-49a3-897d-5eea1c0718aa None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:54.799643 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab4e95-6ec9-4156-81c2-9a03be775139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:54.801123 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab4e95-6ec9-4156-81c2-9a03be775139 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:54.801647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab4e95-6ec9-4156-81c2-9a03be775139 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:54.801934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab4e95-6ec9-4156-81c2-9a03be775139 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:54.802692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab4e95-6ec9-4156-81c2-9a03be775139 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:54.803004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab4e95-6ec9-4156-81c2-9a03be775139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:54.805149 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab4e95-6ec9-4156-81c2-9a03be775139 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:54.814210 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 158/330] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:54.821687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab4e95-6ec9-4156-81c2-9a03be775139 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:54.912747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a74bb-1510-49a3-897d-5eea1c0718aa None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:54.949191 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2d93e-9ced-464f-8362-eed82bc0fa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:54.950101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2d93e-9ced-464f-8362-eed82bc0fa81 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:54.950385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2d93e-9ced-464f-8362-eed82bc0fa81 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:54.950662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2d93e-9ced-464f-8362-eed82bc0fa81 None admin] PATH_INFO: `/v3/users/4e75aa374a314110bb44c7a132db24e9` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:54.952732 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2d93e-9ced-464f-8362-eed82bc0fa81 None admin] RBAC: Authorizing `identity:get_user(user_id=4e75aa374a314110bb44c7a132db24e9)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:54.954204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2d93e-9ced-464f-8362-eed82bc0fa81 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:54.954960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:54.959065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 173/331] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:54 2022] GET /identity/v3/users/4e75aa374a314110bb44c7a132db24e9 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:54.959065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:54.960437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab4e95-6ec9-4156-81c2-9a03be775139 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:54.963490 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2d93e-9ced-464f-8362-eed82bc0fa81 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:55.019199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d4f73-689e-464a-99dc-141da1864255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:55.020471 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d4f73-689e-464a-99dc-141da1864255 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:55.020975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d4f73-689e-464a-99dc-141da1864255 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:55.021449 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d4f73-689e-464a-99dc-141da1864255 None admin] PATH_INFO: `/v3/users/cd55fc17649b4e28abfa0a4e49c92357` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:55.022892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d4f73-689e-464a-99dc-141da1864255 None admin] RBAC: Authorizing `identity:get_user(user_id=cd55fc17649b4e28abfa0a4e49c92357)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:55.024640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d4f73-689e-464a-99dc-141da1864255 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:55.027152 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 159/332] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:54 2022] GET /identity/v3/users/cd55fc17649b4e28abfa0a4e49c92357 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:55.032324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d4f73-689e-464a-99dc-141da1864255 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:55.115429 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2d93e-9ced-464f-8362-eed82bc0fa81 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:55.173628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992f6da-fc02-4613-816b-2d73e45f4adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:55.174307 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992f6da-fc02-4613-816b-2d73e45f4adc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:55.174596 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992f6da-fc02-4613-816b-2d73e45f4adc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:55.174944 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992f6da-fc02-4613-816b-2d73e45f4adc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:55.176106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992f6da-fc02-4613-816b-2d73e45f4adc None admin] RBAC: Adding query filter params (role.id=6a0b49157bc649ef99e870c62ee6f4fe, user.id=4e75aa374a314110bb44c7a132db24e9, scope.system=all) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:55.176656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992f6da-fc02-4613-816b-2d73e45f4adc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:55.179198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992f6da-fc02-4613-816b-2d73e45f4adc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:55.181222 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d4f73-689e-464a-99dc-141da1864255 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:55.196854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 174/333] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Jul 25 16:04:54 2022] GET /identity/v3/role_assignments?user.id=4e75aa374a314110bb44c7a132db24e9&scope.system=all&role.id=6a0b49157bc649ef99e870c62ee6f4fe => generated 510 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:55.232294 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9de0d6-0267-4bbf-892a-3c27d6111244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:55.233605 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9de0d6-0267-4bbf-892a-3c27d6111244 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:55.234106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9de0d6-0267-4bbf-892a-3c27d6111244 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:55.234673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9de0d6-0267-4bbf-892a-3c27d6111244 None admin] PATH_INFO: `/v3/system/users/cd55fc17649b4e28abfa0a4e49c92357/roles/defadc42e7f7403fafbf9c95017e276f` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:55.236577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9de0d6-0267-4bbf-892a-3c27d6111244 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cd55fc17649b4e28abfa0a4e49c92357, role_id=defadc42e7f7403fafbf9c95017e276f)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:55.238268 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9de0d6-0267-4bbf-892a-3c27d6111244 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:55.249740 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 160/334] 10.222.0.70 () {58 vars in 1334 bytes} [Mon Jul 25 16:04:55 2022] PUT /identity/v3/system/users/cd55fc17649b4e28abfa0a4e49c92357/roles/defadc42e7f7403fafbf9c95017e276f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:04:56.682125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8c54-5fc1-473e-971e-a03bb28f1d84 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:56.682624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8c54-5fc1-473e-971e-a03bb28f1d84 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:56.682698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e8c54-5fc1-473e-971e-a03bb28f1d84 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:56.684356 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 175/335] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:56.689968 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30a14e-0ad3-4344-a8e2-d70ce2d3cb92 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:56.690944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30a14e-0ad3-4344-a8e2-d70ce2d3cb92 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:56.691118 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30a14e-0ad3-4344-a8e2-d70ce2d3cb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:56.713922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-dc30a14e-0ad3-4344-a8e2-d70ce2d3cb92 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:56.715135 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-dc30a14e-0ad3-4344-a8e2-d70ce2d3cb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:56.749363 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:56.814909 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 161/336] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:04:56.862790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e8c54-5fc1-473e-971e-a03bb28f1d84 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:56.925857 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:56.989226 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e8c54-5fc1-473e-971e-a03bb28f1d84 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:57.045843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bf5f1-95b0-48cd-9113-6e0aec0b9be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:57.046651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf5f1-95b0-48cd-9113-6e0aec0b9be4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:57.046932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf5f1-95b0-48cd-9113-6e0aec0b9be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:57.047214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf5f1-95b0-48cd-9113-6e0aec0b9be4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:57.062306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bf5f1-95b0-48cd-9113-6e0aec0b9be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:57.070312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-642bf5f1-95b0-48cd-9113-6e0aec0b9be4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:57.070312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:57.070312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:57.070312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:57.070312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:57.070312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:57.070312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:57.070312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:57.070312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:57.070312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:57.070312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:57.070312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:57.070312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:57.070312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:57.070312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:57.070312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:57.071173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:57.071173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:57.071173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:57.071173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:57.071173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:57.071173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:57.071173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:57.071173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:57.071173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:57.071173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:57.071173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:57.071173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:57.071173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:57.071173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:57.071173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:57.071173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:57.072454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:57.072454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:57.072454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:57.072454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:57.072454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:57.072454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:57.072454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:57.072454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:57.072454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:57.072454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:57.072454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:57.072454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:57.072454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 176/337] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:57.077490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30a14e-0ad3-4344-a8e2-d70ce2d3cb92 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:57.232782 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30a14e-0ad3-4344-a8e2-d70ce2d3cb92 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:57.267799 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465458b2-598c-4e8f-a85b-05b6cd91df53 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:57.268027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465458b2-598c-4e8f-a85b-05b6cd91df53 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:57.268293 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465458b2-598c-4e8f-a85b-05b6cd91df53 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:57.269787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 177/338] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:57.283437 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caae339-106f-4ed5-8bd7-449c252e0592 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:57.284656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caae339-106f-4ed5-8bd7-449c252e0592 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:57.284910 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12351215-fadb-4ab8-93c6-a9d0c04237e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:57.285070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caae339-106f-4ed5-8bd7-449c252e0592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:57.285557 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351215-fadb-4ab8-93c6-a9d0c04237e8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:57.285807 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351215-fadb-4ab8-93c6-a9d0c04237e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:57.286087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351215-fadb-4ab8-93c6-a9d0c04237e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:57.286844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12351215-fadb-4ab8-93c6-a9d0c04237e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:57.287154 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12351215-fadb-4ab8-93c6-a9d0c04237e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:57.288758 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12351215-fadb-4ab8-93c6-a9d0c04237e8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:57.298186 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 162/339] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:57.304355 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12351215-fadb-4ab8-93c6-a9d0c04237e8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:57.320307 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0caae339-106f-4ed5-8bd7-449c252e0592 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:57.321566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0caae339-106f-4ed5-8bd7-449c252e0592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:57.353647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:57.454035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 178/340] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:57.486023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12351215-fadb-4ab8-93c6-a9d0c04237e8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:57.504205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caae339-106f-4ed5-8bd7-449c252e0592 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:57.563333 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:57.570559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1eda69-a923-468b-848f-cfcd3fa92fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:57.571037 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eda69-a923-468b-848f-cfcd3fa92fca None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:57.571365 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eda69-a923-468b-848f-cfcd3fa92fca None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:57.571648 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1eda69-a923-468b-848f-cfcd3fa92fca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:57.684447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caae339-106f-4ed5-8bd7-449c252e0592 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:57.708993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1eda69-a923-468b-848f-cfcd3fa92fca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:57.710473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1eda69-a923-468b-848f-cfcd3fa92fca None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:57.756370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:57.757298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf2711-7599-47c0-afdc-b6b60953c49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:57.757984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf2711-7599-47c0-afdc-b6b60953c49a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:57.758276 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf2711-7599-47c0-afdc-b6b60953c49a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:57.758564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf2711-7599-47c0-afdc-b6b60953c49a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:57.778451 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf2711-7599-47c0-afdc-b6b60953c49a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:57.786911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-9ccf2711-7599-47c0-afdc-b6b60953c49a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:04:57.786911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:57.786911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:57.786911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:57.786911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:57.786911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:57.786911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:57.786911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:57.786911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:57.786911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:57.786911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:57.786911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:57.786911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:57.786911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:57.786911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:57.786911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:57.787850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:57.787850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:57.787850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:57.787850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:57.787850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:57.787850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:57.787850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:57.787850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:57.787850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:57.787850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:57.787850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:57.787850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:57.787850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:57.787850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:57.787850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:57.787850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:57.788707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:57.788707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:57.788707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:57.788707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:57.788707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:57.788707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:57.788707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:57.788707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:57.788707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:57.788707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:57.788707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:04:57.788707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:57.792550 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 179/341] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:04:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:04:57.794216 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf2711-7599-47c0-afdc-b6b60953c49a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:57.897235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 163/342] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 16:04:57.904553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1eda69-a923-468b-848f-cfcd3fa92fca None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:57.956655 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf2711-7599-47c0-afdc-b6b60953c49a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:57.968617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:58.005580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d51966-e162-4b05-aca9-52c327551ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:58.006528 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d51966-e162-4b05-aca9-52c327551ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:58.006817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d51966-e162-4b05-aca9-52c327551ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:58.007100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d51966-e162-4b05-aca9-52c327551ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:58.008834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d51966-e162-4b05-aca9-52c327551ba4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:58.009160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d51966-e162-4b05-aca9-52c327551ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:58.010575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d51966-e162-4b05-aca9-52c327551ba4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:58.034702 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 180/343] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:04:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:58.036081 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e0493-9938-4174-a4fa-3a61b9a8b1b0 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:58.036403 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e0493-9938-4174-a4fa-3a61b9a8b1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:58.036683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e0493-9938-4174-a4fa-3a61b9a8b1b0 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:58.040634 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 181/344] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:58.041369 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e0493-9938-4174-a4fa-3a61b9a8b1b0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:58.066722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1eda69-a923-468b-848f-cfcd3fa92fca None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:58.114409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:58.137137 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54024d91-dac8-4c40-b96d-d3ce48ea6856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:58.138021 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54024d91-dac8-4c40-b96d-d3ce48ea6856 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:58.138306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54024d91-dac8-4c40-b96d-d3ce48ea6856 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:58.138584 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54024d91-dac8-4c40-b96d-d3ce48ea6856 None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:58.139950 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54024d91-dac8-4c40-b96d-d3ce48ea6856 None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:58.141466 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54024d91-dac8-4c40-b96d-d3ce48ea6856 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:58.144724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 164/345] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:57 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:04:58.146064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e362d-b915-4d1f-b6e0-0adbbf524f8b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:58.146357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e362d-b915-4d1f-b6e0-0adbbf524f8b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:58.146634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e362d-b915-4d1f-b6e0-0adbbf524f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:58.187327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-909e362d-b915-4d1f-b6e0-0adbbf524f8b None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:58.188581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-909e362d-b915-4d1f-b6e0-0adbbf524f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:58.274666 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e0493-9938-4174-a4fa-3a61b9a8b1b0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:58.326492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 165/346] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:58.330832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e362d-b915-4d1f-b6e0-0adbbf524f8b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:58.359155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e871a-cfbf-4541-bb44-d23b8018a04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:58.359923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e871a-cfbf-4541-bb44-d23b8018a04f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:58.360203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e871a-cfbf-4541-bb44-d23b8018a04f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:58.360505 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e871a-cfbf-4541-bb44-d23b8018a04f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:58.403330 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:58.456684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e871a-cfbf-4541-bb44-d23b8018a04f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:58.458246 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e871a-cfbf-4541-bb44-d23b8018a04f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:58.464317 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e362d-b915-4d1f-b6e0-0adbbf524f8b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:58.494298 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:58.514875 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b85e2-a325-43b5-b505-c09b82ad4ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:58.516001 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b85e2-a325-43b5-b505-c09b82ad4ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:58.517316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b85e2-a325-43b5-b505-c09b82ad4ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:58.517621 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b85e2-a325-43b5-b505-c09b82ad4ce4 None admin] PATH_INFO: `/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:58.526071 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b85e2-a325-43b5-b505-c09b82ad4ce4 None admin] RBAC: Authorizing `identity:get_group(group_id=6d982d9dde5e48c3a29c41b2f3351bf0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:58.528698 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b85e2-a325-43b5-b505-c09b82ad4ce4 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:58.530393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 166/347] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 25 16:04:58 2022] GET /identity/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:58.531633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575e680-8376-475e-9cea-838d7547fb34 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:58.531919 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575e680-8376-475e-9cea-838d7547fb34 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:58.532197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575e680-8376-475e-9cea-838d7547fb34 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:58.534354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 167/348] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:58.535395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575e680-8376-475e-9cea-838d7547fb34 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:58.579415 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 182/349] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:58.581806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bb1db-9b08-45f3-b386-be95577cbb61 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:58.582192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bb1db-9b08-45f3-b386-be95577cbb61 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:58.582620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bb1db-9b08-45f3-b386-be95577cbb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:58.602567 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0c6bb1db-9b08-45f3-b386-be95577cbb61 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:58.604011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0c6bb1db-9b08-45f3-b386-be95577cbb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:58.669392 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575e680-8376-475e-9cea-838d7547fb34 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:58.680645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:58.684684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 183/350] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:58.686443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bb1db-9b08-45f3-b386-be95577cbb61 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:58.713173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ab069-2ec9-4f45-866e-38eba736b05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:58.715234 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ab069-2ec9-4f45-866e-38eba736b05f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:58.715969 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ab069-2ec9-4f45-866e-38eba736b05f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:58.716296 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ab069-2ec9-4f45-866e-38eba736b05f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:58.734649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ab069-2ec9-4f45-866e-38eba736b05f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:58.751441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-191ab069-2ec9-4f45-866e-38eba736b05f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:58.751441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:58.751441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:58.751441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:58.751441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:58.751441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:58.751441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:58.751441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:58.751441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:58.751441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:58.751441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:58.751441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:58.751441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:58.751441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:58.751441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:58.751441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:58.752438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:58.752438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:58.752438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:58.752438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:58.752438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:58.752438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:58.752438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:58.752438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:58.752438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:58.752438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:58.752438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:58.752438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:58.752438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:58.752438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:58.752438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:58.752438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:58.753814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:58.753814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:58.753814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:58.753814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:58.753814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:58.753814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:58.753814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:58.753814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:58.753814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:58.753814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:58.753814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:04:58.753814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:04:58.755182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 168/351] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:58.755678 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ab069-2ec9-4f45-866e-38eba736b05f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:58.828012 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bb1db-9b08-45f3-b386-be95577cbb61 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:58.833191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:58.878401 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fb167-b551-432f-adf0-7642f320baca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:58.879077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fb167-b551-432f-adf0-7642f320baca None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:58.879362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fb167-b551-432f-adf0-7642f320baca None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:58.879629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fb167-b551-432f-adf0-7642f320baca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:58.880567 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fb167-b551-432f-adf0-7642f320baca None admin] RBAC: Adding query filter params (group.id=6d982d9dde5e48c3a29c41b2f3351bf0, role.id=6a0b49157bc649ef99e870c62ee6f4fe, scope.project.id=c386c04bad694a429d89ba0a586c8a45) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:58.880882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fb167-b551-432f-adf0-7642f320baca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:58.882365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fb167-b551-432f-adf0-7642f320baca None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:58.889027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 184/352] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 25 16:04:58 2022] GET /identity/v3/role_assignments?group.id=6d982d9dde5e48c3a29c41b2f3351bf0&scope.project.id=c386c04bad694a429d89ba0a586c8a45&role.id=6a0b49157bc649ef99e870c62ee6f4fe => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:58.892288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fb167-b551-432f-adf0-7642f320baca None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:58.912474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ab069-2ec9-4f45-866e-38eba736b05f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:58.967700 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e81a24-e0db-4c34-80a2-c02d1786575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:58.969362 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e81a24-e0db-4c34-80a2-c02d1786575f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:58.969912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e81a24-e0db-4c34-80a2-c02d1786575f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:58.970028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:58.970525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e81a24-e0db-4c34-80a2-c02d1786575f None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:58.973575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e81a24-e0db-4c34-80a2-c02d1786575f None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:58.975659 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e81a24-e0db-4c34-80a2-c02d1786575f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:58.978463 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 169/353] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:04:58 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:58.980547 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e81a24-e0db-4c34-80a2-c02d1786575f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:59.032913 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fb167-b551-432f-adf0-7642f320baca None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:59.076768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245f73e-0967-42f8-a820-078123d4062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:59.077987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245f73e-0967-42f8-a820-078123d4062c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:59.078501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245f73e-0967-42f8-a820-078123d4062c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:59.078918 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245f73e-0967-42f8-a820-078123d4062c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:59.091787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245f73e-0967-42f8-a820-078123d4062c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:04:59.101566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-1245f73e-0967-42f8-a820-078123d4062c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:59.101566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:04:59.101566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:04:59.101566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:04:59.101566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:04:59.101566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:04:59.101566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:04:59.101566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:04:59.101566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:04:59.101566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:04:59.101566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:04:59.101566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:04:59.101566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:04:59.101566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:04:59.101566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:04:59.101566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:04:59.103237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:04:59.103237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:04:59.103237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:04:59.103237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:04:59.103237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:04:59.103237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:04:59.103237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:04:59.103237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:04:59.103237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:04:59.103237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:04:59.103237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:04:59.103237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:04:59.103237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:04:59.103237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:04:59.103237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:04:59.103237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:04:59.104784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:04:59.104784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:04:59.104784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:04:59.104784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:04:59.104784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:04:59.104784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:04:59.104784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:04:59.104784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:04:59.104784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:04:59.104784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:04:59.104784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 16:04:59.104784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:04:59.107168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 185/354] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:04:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:04:59.108290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98140658-afe5-4e3b-89ab-e17b226ef5f9 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:59.108290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98140658-afe5-4e3b-89ab-e17b226ef5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:59.113194 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98140658-afe5-4e3b-89ab-e17b226ef5f9 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:59.115129 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 186/355] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:59.116047 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98140658-afe5-4e3b-89ab-e17b226ef5f9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:59.134126 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e81a24-e0db-4c34-80a2-c02d1786575f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:59.160382 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:59.200676 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfda56-bc42-4c77-bd9b-a604ffe0da4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:59.201680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfda56-bc42-4c77-bd9b-a604ffe0da4a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:59.201965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfda56-bc42-4c77-bd9b-a604ffe0da4a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:59.202678 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfda56-bc42-4c77-bd9b-a604ffe0da4a None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:59.203440 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfda56-bc42-4c77-bd9b-a604ffe0da4a None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:59.203880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfda56-bc42-4c77-bd9b-a604ffe0da4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:59.206858 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfda56-bc42-4c77-bd9b-a604ffe0da4a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:59.223848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 170/356] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:59.225208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfda56-bc42-4c77-bd9b-a604ffe0da4a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:59.261047 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98140658-afe5-4e3b-89ab-e17b226ef5f9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:59.285477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:59.316813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730b4df-b3bb-4a85-9b4d-6cb5ddf03d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:59.317824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730b4df-b3bb-4a85-9b4d-6cb5ddf03d5e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:59.318114 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730b4df-b3bb-4a85-9b4d-6cb5ddf03d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:59.318445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730b4df-b3bb-4a85-9b4d-6cb5ddf03d5e None admin] PATH_INFO: `/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:59.320021 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730b4df-b3bb-4a85-9b4d-6cb5ddf03d5e None admin] RBAC: Authorizing `identity:get_group(group_id=6d982d9dde5e48c3a29c41b2f3351bf0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:59.321899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730b4df-b3bb-4a85-9b4d-6cb5ddf03d5e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:59.323622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 187/357] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 25 16:04:59 2022] GET /identity/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:59.324925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea85ae6-17de-4e4d-90ab-8375561f15d0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:59.325219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea85ae6-17de-4e4d-90ab-8375561f15d0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:59.325501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea85ae6-17de-4e4d-90ab-8375561f15d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:59.347599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8ea85ae6-17de-4e4d-90ab-8375561f15d0 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:04:59.348982 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8ea85ae6-17de-4e4d-90ab-8375561f15d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:04:59.369034 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfda56-bc42-4c77-bd9b-a604ffe0da4a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:59.416358 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa02a60-06b0-4311-8d49-02dd31218265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:59.416959 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02a60-06b0-4311-8d49-02dd31218265 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:59.417248 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02a60-06b0-4311-8d49-02dd31218265 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:59.417577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa02a60-06b0-4311-8d49-02dd31218265 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:59.418339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa02a60-06b0-4311-8d49-02dd31218265 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:59.418649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa02a60-06b0-4311-8d49-02dd31218265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:59.420552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa02a60-06b0-4311-8d49-02dd31218265 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:59.434336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 171/358] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:04:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:59.435142 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa02a60-06b0-4311-8d49-02dd31218265 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:59.453067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 188/359] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:04:59.453835 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea85ae6-17de-4e4d-90ab-8375561f15d0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:59.486922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:59.579412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa02a60-06b0-4311-8d49-02dd31218265 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:59.597074 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea85ae6-17de-4e4d-90ab-8375561f15d0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:59.618497 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:59.625366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c2aa8-cb14-46bd-8012-c425134d9d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:59.626030 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c2aa8-cb14-46bd-8012-c425134d9d53 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:59.626318 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c2aa8-cb14-46bd-8012-c425134d9d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:59.626599 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c2aa8-cb14-46bd-8012-c425134d9d53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:59.649427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62efc0-b9c7-4879-96d2-9d6447ecd2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:59.649948 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62efc0-b9c7-4879-96d2-9d6447ecd2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:59.650236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62efc0-b9c7-4879-96d2-9d6447ecd2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:59.650514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62efc0-b9c7-4879-96d2-9d6447ecd2f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:59.651355 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62efc0-b9c7-4879-96d2-9d6447ecd2f5 None admin] RBAC: Adding query filter params (group.id=6d982d9dde5e48c3a29c41b2f3351bf0, role.id=e4ade3cd570d4865b356cbe822b76fe9, scope.project.id=c386c04bad694a429d89ba0a586c8a45) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:04:59.651941 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62efc0-b9c7-4879-96d2-9d6447ecd2f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:59.653428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62efc0-b9c7-4879-96d2-9d6447ecd2f5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:59.660077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 189/360] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 25 16:04:59 2022] GET /identity/v3/role_assignments?group.id=6d982d9dde5e48c3a29c41b2f3351bf0&scope.project.id=c386c04bad694a429d89ba0a586c8a45&role.id=e4ade3cd570d4865b356cbe822b76fe9 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:59.661093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62efc0-b9c7-4879-96d2-9d6447ecd2f5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:59.717432 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c2aa8-cb14-46bd-8012-c425134d9d53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:59.719072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c2aa8-cb14-46bd-8012-c425134d9d53 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:59.775673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:59.800462 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62efc0-b9c7-4879-96d2-9d6447ecd2f5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:59.851098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68f910-d68e-4ec8-a82d-6c20582191d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:04:59.851868 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68f910-d68e-4ec8-a82d-6c20582191d4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:59.852160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68f910-d68e-4ec8-a82d-6c20582191d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:59.853621 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68f910-d68e-4ec8-a82d-6c20582191d4 None admin] PATH_INFO: `/v3/users/cd55fc17649b4e28abfa0a4e49c92357` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:59.854479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68f910-d68e-4ec8-a82d-6c20582191d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cd55fc17649b4e28abfa0a4e49c92357)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:04:59.856132 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68f910-d68e-4ec8-a82d-6c20582191d4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:04:59.858794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 190/361] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:04:59 2022] GET /identity/v3/users/cd55fc17649b4e28abfa0a4e49c92357 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:04:59.859715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fe647-4be5-421b-9681-19babb3612c1 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:04:59.860006 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fe647-4be5-421b-9681-19babb3612c1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:04:59.860320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fe647-4be5-421b-9681-19babb3612c1 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:04:59.862999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 191/362] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:04:59.864021 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fe647-4be5-421b-9681-19babb3612c1 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:59.866597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 172/363] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:04:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:04:59.867891 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c2aa8-cb14-46bd-8012-c425134d9d53 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:04:59.928809 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:04:59.990224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fe647-4be5-421b-9681-19babb3612c1 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:04:59.997810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c2aa8-cb14-46bd-8012-c425134d9d53 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:00.040517 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59eecb7-eb80-4fac-9607-714e2b468f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:00.041609 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eecb7-eb80-4fac-9607-714e2b468f03 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:00.042106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eecb7-eb80-4fac-9607-714e2b468f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:00.042582 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eecb7-eb80-4fac-9607-714e2b468f03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:00.043615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eecb7-eb80-4fac-9607-714e2b468f03 None admin] RBAC: Adding query filter params (role.id=defadc42e7f7403fafbf9c95017e276f, user.id=cd55fc17649b4e28abfa0a4e49c92357, scope.system=all) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:00.044133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eecb7-eb80-4fac-9607-714e2b468f03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:00.044996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19635dfc-e253-4c56-b785-d537f3303107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:00.045837 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19635dfc-e253-4c56-b785-d537f3303107 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:00.046125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19635dfc-e253-4c56-b785-d537f3303107 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:00.046233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eecb7-eb80-4fac-9607-714e2b468f03 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:00.046398 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19635dfc-e253-4c56-b785-d537f3303107 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:00.052535 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:00.061588 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 173/364] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Jul 25 16:04:59 2022] GET /identity/v3/role_assignments?user.id=cd55fc17649b4e28abfa0a4e49c92357&scope.system=all&role.id=defadc42e7f7403fafbf9c95017e276f => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:00.062729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19635dfc-e253-4c56-b785-d537f3303107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:00.063434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af404e76-0497-4a8a-bbc6-9ac7199e26c6 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:00.064850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af404e76-0497-4a8a-bbc6-9ac7199e26c6 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:00.065564 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af404e76-0497-4a8a-bbc6-9ac7199e26c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:00.081565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-19635dfc-e253-4c56-b785-d537f3303107 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:05:00.081565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:00.081565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:00.081565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:00.081565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:00.081565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:00.081565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:00.081565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:00.081565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:00.081565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:00.081565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:00.081565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:00.081565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:00.081565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:00.081565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:00.081565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:00.082517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:00.082517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:00.082517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:00.082517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:00.082517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:00.082517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:00.082517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:00.082517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:00.082517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:00.082517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:00.082517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:00.082517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:00.082517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:00.082517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:00.082517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:00.082517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:00.083299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:00.083299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:00.083299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:00.083299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:00.083299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:00.083299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:00.083299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:00.083299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:00.083299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:00.083299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:00.083299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:05:00.083299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:00.083299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 192/365] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:04:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:00.083987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19635dfc-e253-4c56-b785-d537f3303107 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:00.093568 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-af404e76-0497-4a8a-bbc6-9ac7199e26c6 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:00.094819 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-af404e76-0497-4a8a-bbc6-9ac7199e26c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:00.215968 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 174/366] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:00.218190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af404e76-0497-4a8a-bbc6-9ac7199e26c6 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:00.259956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19635dfc-e253-4c56-b785-d537f3303107 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:00.265455 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:00.325193 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f63e9-cc22-44db-adac-613e9001c50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:00.327770 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f63e9-cc22-44db-adac-613e9001c50a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:00.327770 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f63e9-cc22-44db-adac-613e9001c50a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:00.327770 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f63e9-cc22-44db-adac-613e9001c50a None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:00.327770 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f63e9-cc22-44db-adac-613e9001c50a None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:00.329221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f63e9-cc22-44db-adac-613e9001c50a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:00.332032 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 193/367] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:05:00 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:00.333462 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f63e9-cc22-44db-adac-613e9001c50a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:00.378707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af404e76-0497-4a8a-bbc6-9ac7199e26c6 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:00.413864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:00.429122 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe84e8-1b3a-488a-93de-4c1c5f798ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:00.430280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe84e8-1b3a-488a-93de-4c1c5f798ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:00.430840 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe84e8-1b3a-488a-93de-4c1c5f798ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:00.431117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe84e8-1b3a-488a-93de-4c1c5f798ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:00.431881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe84e8-1b3a-488a-93de-4c1c5f798ac6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:00.432190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe84e8-1b3a-488a-93de-4c1c5f798ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:00.434389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe84e8-1b3a-488a-93de-4c1c5f798ac6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:00.445491 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 175/368] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:00.446496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe84e8-1b3a-488a-93de-4c1c5f798ac6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:00.487587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f63e9-cc22-44db-adac-613e9001c50a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:00.527949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c008b-9d7f-4c9f-82ce-937e1b39e99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:00.528836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c008b-9d7f-4c9f-82ce-937e1b39e99e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:00.529136 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c008b-9d7f-4c9f-82ce-937e1b39e99e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:00.529417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c008b-9d7f-4c9f-82ce-937e1b39e99e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:00.541553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c008b-9d7f-4c9f-82ce-937e1b39e99e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:00.549350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a64c008b-9d7f-4c9f-82ce-937e1b39e99e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:00.549350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:00.549350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:00.549350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:00.549350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:00.549350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:00.549350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:00.549350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:00.549350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:00.549350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:00.549350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:00.549350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:00.549350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:00.549350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:00.549350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:00.549350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:00.550288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:00.550288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:00.550288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:00.550288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:00.550288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:00.550288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:00.550288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:00.550288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:00.550288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:00.550288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:00.550288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:00.550288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:00.550288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:00.550288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:00.550288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:00.550288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:00.551071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:00.551071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:00.551071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:00.551071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:00.551071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:00.551071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:00.551071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:00.551071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:00.551071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:00.551071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:00.551071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:00.551071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:00.551071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 194/369] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:05:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:00.552453 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c008b-9d7f-4c9f-82ce-937e1b39e99e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:00.581239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe84e8-1b3a-488a-93de-4c1c5f798ac6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:00.585232 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:00.629460 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44ed65-e721-4e8d-ae08-908c14f4014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:00.630517 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44ed65-e721-4e8d-ae08-908c14f4014c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:00.630804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44ed65-e721-4e8d-ae08-908c14f4014c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:00.631082 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44ed65-e721-4e8d-ae08-908c14f4014c None admin] PATH_INFO: `/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:00.633185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44ed65-e721-4e8d-ae08-908c14f4014c None admin] RBAC: Authorizing `identity:get_group(group_id=6d982d9dde5e48c3a29c41b2f3351bf0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:00.634646 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44ed65-e721-4e8d-ae08-908c14f4014c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:00.636327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 176/370] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 25 16:05:00 2022] GET /identity/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:00.637116 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44ed65-e721-4e8d-ae08-908c14f4014c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:00.687539 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c008b-9d7f-4c9f-82ce-937e1b39e99e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:00.717256 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:00.731680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45e91b-5e34-4f6e-901f-5349360c5e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:00.732889 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45e91b-5e34-4f6e-901f-5349360c5e1e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:00.733372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45e91b-5e34-4f6e-901f-5349360c5e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:00.733980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45e91b-5e34-4f6e-901f-5349360c5e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:00.781081 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44ed65-e721-4e8d-ae08-908c14f4014c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:00.827178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45e91b-5e34-4f6e-901f-5349360c5e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:00.828136 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504df7a-6a5b-45ad-a5a4-db17e948c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:00.829023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504df7a-6a5b-45ad-a5a4-db17e948c101 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:00.829477 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504df7a-6a5b-45ad-a5a4-db17e948c101 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:00.829917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504df7a-6a5b-45ad-a5a4-db17e948c101 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:00.831497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504df7a-6a5b-45ad-a5a4-db17e948c101 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:00.831599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45e91b-5e34-4f6e-901f-5349360c5e1e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:00.832084 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504df7a-6a5b-45ad-a5a4-db17e948c101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:00.833764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504df7a-6a5b-45ad-a5a4-db17e948c101 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:00.843970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 177/371] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:00.845111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504df7a-6a5b-45ad-a5a4-db17e948c101 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:00.864719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:00.946573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 195/372] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:00.947428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45e91b-5e34-4f6e-901f-5349360c5e1e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:00.959688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504df7a-6a5b-45ad-a5a4-db17e948c101 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:00.978982 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:00.998855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c5dce-1d6b-4306-8293-1ab38c9c5ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:00.999907 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5dce-1d6b-4306-8293-1ab38c9c5ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:01.000419 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5dce-1d6b-4306-8293-1ab38c9c5ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:01.000863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c5dce-1d6b-4306-8293-1ab38c9c5ad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:01.001992 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c5dce-1d6b-4306-8293-1ab38c9c5ad3 None admin] RBAC: Adding query filter params (group.id=6d982d9dde5e48c3a29c41b2f3351bf0, role.id=6a0b49157bc649ef99e870c62ee6f4fe, scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:01.002528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c5dce-1d6b-4306-8293-1ab38c9c5ad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:01.004712 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c5dce-1d6b-4306-8293-1ab38c9c5ad3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:01.011392 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 178/373] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 25 16:05:00 2022] GET /identity/v3/role_assignments?group.id=6d982d9dde5e48c3a29c41b2f3351bf0&scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0&role.id=6a0b49157bc649ef99e870c62ee6f4fe => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:01.012582 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c5dce-1d6b-4306-8293-1ab38c9c5ad3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:01.059185 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45e91b-5e34-4f6e-901f-5349360c5e1e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:01.094399 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:01.101512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48cbac-e2a2-44fc-a0c5-bb966820dc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:01.102199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48cbac-e2a2-44fc-a0c5-bb966820dc2c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:01.102488 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48cbac-e2a2-44fc-a0c5-bb966820dc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:01.102767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48cbac-e2a2-44fc-a0c5-bb966820dc2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:01.132811 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c5dce-1d6b-4306-8293-1ab38c9c5ad3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:01.171855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d9307-3431-4b53-870e-44f4fae09fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:01.173308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d9307-3431-4b53-870e-44f4fae09fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:01.173834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d9307-3431-4b53-870e-44f4fae09fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:01.174325 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d9307-3431-4b53-870e-44f4fae09fd4 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:01.176097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d9307-3431-4b53-870e-44f4fae09fd4 None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:01.177985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d9307-3431-4b53-870e-44f4fae09fd4 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:01.180214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 179/374] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:05:01 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:01.186386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d9307-3431-4b53-870e-44f4fae09fd4 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:01.186614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48cbac-e2a2-44fc-a0c5-bb966820dc2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:01.187946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48cbac-e2a2-44fc-a0c5-bb966820dc2c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:01.251110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:01.310075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 196/375] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:01.314065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d9307-3431-4b53-870e-44f4fae09fd4 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:01.315921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48cbac-e2a2-44fc-a0c5-bb966820dc2c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:01.357094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2959256-776e-4a2d-ba12-1a1d3b298a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:01.360963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2959256-776e-4a2d-ba12-1a1d3b298a80 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:01.361446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2959256-776e-4a2d-ba12-1a1d3b298a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:01.361936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2959256-776e-4a2d-ba12-1a1d3b298a80 None admin] PATH_INFO: `/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:01.364185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2959256-776e-4a2d-ba12-1a1d3b298a80 None admin] RBAC: Authorizing `identity:get_group(group_id=6d982d9dde5e48c3a29c41b2f3351bf0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:01.367224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2959256-776e-4a2d-ba12-1a1d3b298a80 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:01.370462 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 180/376] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 25 16:05:01 2022] GET /identity/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:01.375919 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2959256-776e-4a2d-ba12-1a1d3b298a80 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:01.377017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:01.482633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48cbac-e2a2-44fc-a0c5-bb966820dc2c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:01.508398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2959256-776e-4a2d-ba12-1a1d3b298a80 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:01.528221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:01.534371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e3b9f-a888-4d2b-8d78-469a589dbe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:01.535766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e3b9f-a888-4d2b-8d78-469a589dbe0b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:01.536230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e3b9f-a888-4d2b-8d78-469a589dbe0b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:01.536672 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e3b9f-a888-4d2b-8d78-469a589dbe0b None admin] PATH_INFO: `/v3/projects/b95a5c35a0f44e44aca71af300d042a5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:01.538396 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e3b9f-a888-4d2b-8d78-469a589dbe0b None admin] RBAC: Authorizing `identity:get_project(project_id=b95a5c35a0f44e44aca71af300d042a5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:01.540834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e3b9f-a888-4d2b-8d78-469a589dbe0b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:01.545245 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 197/377] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:05:01 2022] GET /identity/v3/projects/b95a5c35a0f44e44aca71af300d042a5 => generated 344 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:01.551265 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e3b9f-a888-4d2b-8d78-469a589dbe0b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:01.564035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80636615-a678-4e28-bf5e-cb6b4e8098d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:01.566071 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80636615-a678-4e28-bf5e-cb6b4e8098d3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:01.566540 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80636615-a678-4e28-bf5e-cb6b4e8098d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:01.567255 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80636615-a678-4e28-bf5e-cb6b4e8098d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:01.568308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80636615-a678-4e28-bf5e-cb6b4e8098d3 None admin] RBAC: Adding query filter params (group.id=6d982d9dde5e48c3a29c41b2f3351bf0, role.id=e4ade3cd570d4865b356cbe822b76fe9, scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:01.568782 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80636615-a678-4e28-bf5e-cb6b4e8098d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:01.571468 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80636615-a678-4e28-bf5e-cb6b4e8098d3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:01.590398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 181/378] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 25 16:05:01 2022] GET /identity/v3/role_assignments?group.id=6d982d9dde5e48c3a29c41b2f3351bf0&scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0&role.id=e4ade3cd570d4865b356cbe822b76fe9 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:01.597640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d1f6c-5aa4-4650-835a-e30b4759d1e7 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:01.597972 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d1f6c-5aa4-4650-835a-e30b4759d1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:01.598211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d1f6c-5aa4-4650-835a-e30b4759d1e7 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:01.600116 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 182/379] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:01.605674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9981c0e-7647-4d62-bff5-d519f565d7e6 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:01.605973 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9981c0e-7647-4d62-bff5-d519f565d7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:01.606235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9981c0e-7647-4d62-bff5-d519f565d7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:01.638408 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d9981c0e-7647-4d62-bff5-d519f565d7e6 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:01.639569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d9981c0e-7647-4d62-bff5-d519f565d7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:01.737978 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:01.742424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e3b9f-a888-4d2b-8d78-469a589dbe0b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:01.794385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde3df5-dde7-4f4c-9930-fc49f74de2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:01.795818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde3df5-dde7-4f4c-9930-fc49f74de2ce None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:01.796103 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde3df5-dde7-4f4c-9930-fc49f74de2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:01.796419 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde3df5-dde7-4f4c-9930-fc49f74de2ce None admin] PATH_INFO: `/v3/groups/a34f880f989c472ea0331b30e33d1776` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:01.804099 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 183/380] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:05:01.813921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde3df5-dde7-4f4c-9930-fc49f74de2ce None admin] RBAC: Authorizing `identity:get_group(group_id=a34f880f989c472ea0331b30e33d1776)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:01.815935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde3df5-dde7-4f4c-9930-fc49f74de2ce None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:01.817805 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 198/381] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 25 16:05:01 2022] GET /identity/v3/groups/a34f880f989c472ea0331b30e33d1776 => generated 229 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:01.824141 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9981c0e-7647-4d62-bff5-d519f565d7e6 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:01.838902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde3df5-dde7-4f4c-9930-fc49f74de2ce None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:01.967318 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde3df5-dde7-4f4c-9930-fc49f74de2ce None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:02.011521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714ab71-4390-4112-b9c0-9d226334e96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:02.012642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714ab71-4390-4112-b9c0-9d226334e96c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:02.012933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714ab71-4390-4112-b9c0-9d226334e96c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:02.013235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714ab71-4390-4112-b9c0-9d226334e96c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:02.029603 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714ab71-4390-4112-b9c0-9d226334e96c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:02.038775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6714ab71-4390-4112-b9c0-9d226334e96c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:05:02.038775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:02.038775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:02.038775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:02.038775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:02.038775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:02.038775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:02.038775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:02.038775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:02.038775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:02.038775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:02.038775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:02.038775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:02.038775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:02.038775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:02.038775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:02.039698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:02.039698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:02.039698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:02.039698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:02.039698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:02.039698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:02.039698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:02.039698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:02.039698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:02.039698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:02.039698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:02.039698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:02.039698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:02.039698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:02.039698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:02.039698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:02.040993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:02.040993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:02.040993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:02.040993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:02.040993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:02.040993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:02.040993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:02.040993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:02.040993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:02.040993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:02.040993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:05:02.040993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:02.040993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 199/382] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:02.047463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714ab71-4390-4112-b9c0-9d226334e96c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:02.067340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9981c0e-7647-4d62-bff5-d519f565d7e6 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:02.084679 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:02.100184 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:02.114276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1d449-b057-48b5-9698-54ff40cf41eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:02.115114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1d449-b057-48b5-9698-54ff40cf41eb None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:02.115410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1d449-b057-48b5-9698-54ff40cf41eb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:02.115805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1d449-b057-48b5-9698-54ff40cf41eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:02.116687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1d449-b057-48b5-9698-54ff40cf41eb None admin] RBAC: Adding query filter params (group.id=a34f880f989c472ea0331b30e33d1776, role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=b95a5c35a0f44e44aca71af300d042a5) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:02.117003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1d449-b057-48b5-9698-54ff40cf41eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:02.120565 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1d449-b057-48b5-9698-54ff40cf41eb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:02.126821 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 184/383] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 25 16:05:01 2022] GET /identity/v3/role_assignments?group.id=a34f880f989c472ea0331b30e33d1776&scope.project.id=b95a5c35a0f44e44aca71af300d042a5&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 260 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:02.205520 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714ab71-4390-4112-b9c0-9d226334e96c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:02.252063 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787b8c1-eaa1-42b3-a663-b562dffa98c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:02.252899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787b8c1-eaa1-42b3-a663-b562dffa98c4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:02.253188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787b8c1-eaa1-42b3-a663-b562dffa98c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:02.253466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787b8c1-eaa1-42b3-a663-b562dffa98c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:02.254243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787b8c1-eaa1-42b3-a663-b562dffa98c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:02.254554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787b8c1-eaa1-42b3-a663-b562dffa98c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:02.255988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787b8c1-eaa1-42b3-a663-b562dffa98c4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:02.272950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 200/384] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:05:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:02.281450 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1d449-b057-48b5-9698-54ff40cf41eb None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:02.416234 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1d449-b057-48b5-9698-54ff40cf41eb None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:02.454532 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fa3a2-c898-42fd-8191-92b133b228fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:02.455413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fa3a2-c898-42fd-8191-92b133b228fd None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:02.455742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fa3a2-c898-42fd-8191-92b133b228fd None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:02.456004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fa3a2-c898-42fd-8191-92b133b228fd None admin] PATH_INFO: `/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:02.457265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fa3a2-c898-42fd-8191-92b133b228fd None admin] RBAC: Authorizing `identity:get_group(group_id=6d982d9dde5e48c3a29c41b2f3351bf0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:02.458750 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fa3a2-c898-42fd-8191-92b133b228fd None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:02.460786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 185/385] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 25 16:05:02 2022] GET /identity/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:02.466132 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787b8c1-eaa1-42b3-a663-b562dffa98c4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:02.473446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87ffb0-1773-40a6-9f67-7fc6b146313c None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:02.473738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87ffb0-1773-40a6-9f67-7fc6b146313c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:02.474019 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87ffb0-1773-40a6-9f67-7fc6b146313c None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:02.475404 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 186/386] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:05:02.480900 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd2e3f-4fa9-481c-9b0f-2e30e34f7434 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:02.481160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd2e3f-4fa9-481c-9b0f-2e30e34f7434 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:02.481399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd2e3f-4fa9-481c-9b0f-2e30e34f7434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:02.501384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-9edd2e3f-4fa9-481c-9b0f-2e30e34f7434 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:02.505115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9edd2e3f-4fa9-481c-9b0f-2e30e34f7434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:02.550881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:02.580306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 187/387] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:05:02.619655 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787b8c1-eaa1-42b3-a663-b562dffa98c4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:02.630307 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd2e3f-4fa9-481c-9b0f-2e30e34f7434 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:02.644715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:02.698640 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa02d2-428a-47fe-8059-02aae7e9cb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:02.699536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa02d2-428a-47fe-8059-02aae7e9cb47 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:02.699826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa02d2-428a-47fe-8059-02aae7e9cb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:02.700107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa02d2-428a-47fe-8059-02aae7e9cb47 None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:02.701475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa02d2-428a-47fe-8059-02aae7e9cb47 None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:02.702958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa02d2-428a-47fe-8059-02aae7e9cb47 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:02.705065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 201/388] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:05:02 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:02.710849 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa02d2-428a-47fe-8059-02aae7e9cb47 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:02.826679 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd2e3f-4fa9-481c-9b0f-2e30e34f7434 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:02.841038 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa02d2-428a-47fe-8059-02aae7e9cb47 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:02.869811 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e54051-e97a-4588-87e2-c2e0cc770e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:02.870655 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e54051-e97a-4588-87e2-c2e0cc770e0f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:02.870936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e54051-e97a-4588-87e2-c2e0cc770e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:02.871207 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e54051-e97a-4588-87e2-c2e0cc770e0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:02.888731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e54051-e97a-4588-87e2-c2e0cc770e0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:02.895519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b88411-ffc4-4f74-abd7-b77544e36f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:02.896537 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b88411-ffc4-4f74-abd7-b77544e36f61 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:02.896826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b88411-ffc4-4f74-abd7-b77544e36f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:02.897102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b88411-ffc4-4f74-abd7-b77544e36f61 None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45/groups/6d982d9dde5e48c3a29c41b2f3351bf0/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:02.897744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-49e54051-e97a-4588-87e2-c2e0cc770e0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:05:02.897744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:02.897744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:02.897744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:02.897744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:02.897744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:02.897744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:02.897744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:02.897744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:02.897744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:02.897744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:02.897744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:02.897744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:02.897744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:02.897744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:02.897744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:02.898575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:02.898575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:02.898575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:02.898575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:02.898575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:02.898575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:02.898575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:02.898575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:02.898575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:02.898575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:02.898575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:02.898575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:02.898575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:02.898575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:02.898575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:02.898575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:02.899331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:02.899331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:02.899331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:02.899331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:02.899331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:02.899331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:02.899331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:02.899331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:02.899331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:02.899331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:02.899331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:05:02.899331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:02.899331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 188/389] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:05:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:05:02.905521 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e54051-e97a-4588-87e2-c2e0cc770e0f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:02.911599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b88411-ffc4-4f74-abd7-b77544e36f61 None admin] RBAC: Authorizing `identity:create_grant(project_id=c386c04bad694a429d89ba0a586c8a45, group_id=6d982d9dde5e48c3a29c41b2f3351bf0, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:02.913178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b88411-ffc4-4f74-abd7-b77544e36f61 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:02.943424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 202/390] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Jul 25 16:05:02 2022] PUT /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45/groups/6d982d9dde5e48c3a29c41b2f3351bf0/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:05:02.968616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:03.048187 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e54051-e97a-4588-87e2-c2e0cc770e0f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:03.091510 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5f319-2c58-49bd-b77f-893b8e1d6775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:03.092127 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5f319-2c58-49bd-b77f-893b8e1d6775 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:03.092433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5f319-2c58-49bd-b77f-893b8e1d6775 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:03.092710 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5f319-2c58-49bd-b77f-893b8e1d6775 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:03.093466 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5f319-2c58-49bd-b77f-893b8e1d6775 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:03.093773 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5f319-2c58-49bd-b77f-893b8e1d6775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:03.095174 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5f319-2c58-49bd-b77f-893b8e1d6775 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:03.105338 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 189/391] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:03.111449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b88411-ffc4-4f74-abd7-b77544e36f61 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:03.146947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:03.260233 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b88411-ffc4-4f74-abd7-b77544e36f61 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:03.297137 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa9f7f-a501-4643-b1a8-667034825e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:03.298021 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa9f7f-a501-4643-b1a8-667034825e0a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:03.298299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa9f7f-a501-4643-b1a8-667034825e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:03.298577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa9f7f-a501-4643-b1a8-667034825e0a None admin] PATH_INFO: `/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:03.299828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa9f7f-a501-4643-b1a8-667034825e0a None admin] RBAC: Authorizing `identity:get_group(group_id=6d982d9dde5e48c3a29c41b2f3351bf0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:03.301308 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa9f7f-a501-4643-b1a8-667034825e0a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:03.303328 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 203/392] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 25 16:05:03 2022] GET /identity/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:03.308833 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5f319-2c58-49bd-b77f-893b8e1d6775 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:03.420168 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:03.427794 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5f319-2c58-49bd-b77f-893b8e1d6775 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:03.469976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cca74-cf2c-4321-b6d8-59fad6ebaf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:03.470858 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cca74-cf2c-4321-b6d8-59fad6ebaf47 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:03.471145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cca74-cf2c-4321-b6d8-59fad6ebaf47 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:03.471474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cca74-cf2c-4321-b6d8-59fad6ebaf47 None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:03.472739 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cca74-cf2c-4321-b6d8-59fad6ebaf47 None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:03.474199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cca74-cf2c-4321-b6d8-59fad6ebaf47 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:03.476115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 190/393] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:05:03 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:03.481781 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa9f7f-a501-4643-b1a8-667034825e0a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:03.588728 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:03.613140 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa9f7f-a501-4643-b1a8-667034825e0a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:03.656122 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570bce9-b967-4b21-a8b9-e09bda92b81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:03.657051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570bce9-b967-4b21-a8b9-e09bda92b81e None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:03.657336 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570bce9-b967-4b21-a8b9-e09bda92b81e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:03.657607 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570bce9-b967-4b21-a8b9-e09bda92b81e None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45/groups/6d982d9dde5e48c3a29c41b2f3351bf0/roles/e4ade3cd570d4865b356cbe822b76fe9` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:03.660546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570bce9-b967-4b21-a8b9-e09bda92b81e None admin] RBAC: Authorizing `identity:create_grant(project_id=c386c04bad694a429d89ba0a586c8a45, group_id=6d982d9dde5e48c3a29c41b2f3351bf0, role_id=e4ade3cd570d4865b356cbe822b76fe9)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:03.662002 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570bce9-b967-4b21-a8b9-e09bda92b81e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:03.682072 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 204/394] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Jul 25 16:05:03 2022] PUT /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45/groups/6d982d9dde5e48c3a29c41b2f3351bf0/roles/e4ade3cd570d4865b356cbe822b76fe9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:05:04.157484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065406bc-56d2-4cb4-b16c-5c00ff491dd9 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:04.157979 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065406bc-56d2-4cb4-b16c-5c00ff491dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:04.157979 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065406bc-56d2-4cb4-b16c-5c00ff491dd9 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:04.160210 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 191/395] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:04.166055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10573ca2-25de-4f9e-8b17-cbc7dd75cd6f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:04.166507 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10573ca2-25de-4f9e-8b17-cbc7dd75cd6f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:04.166605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10573ca2-25de-4f9e-8b17-cbc7dd75cd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:04.190906 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-10573ca2-25de-4f9e-8b17-cbc7dd75cd6f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:04.192108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-10573ca2-25de-4f9e-8b17-cbc7dd75cd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:04.302908 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 205/396] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:04.343841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c621b1-83c9-48f0-a930-fee148c20735 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:04.344172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c621b1-83c9-48f0-a930-fee148c20735 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:04.344429 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c621b1-83c9-48f0-a930-fee148c20735 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:04.345931 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 192/397] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:04.347211 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10573ca2-25de-4f9e-8b17-cbc7dd75cd6f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:04.351342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c44bf-4c9a-49f6-8eb5-4643785e5882 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:04.351506 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c44bf-4c9a-49f6-8eb5-4643785e5882 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:04.351698 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c44bf-4c9a-49f6-8eb5-4643785e5882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:04.389761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-761c44bf-4c9a-49f6-8eb5-4643785e5882 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:04.391099 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-761c44bf-4c9a-49f6-8eb5-4643785e5882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:04.429030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:04.463206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10573ca2-25de-4f9e-8b17-cbc7dd75cd6f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:04.513875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd70e8-227b-43d5-8493-f953580e45f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:04.515055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd70e8-227b-43d5-8493-f953580e45f6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:04.515338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd70e8-227b-43d5-8493-f953580e45f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:04.515616 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd70e8-227b-43d5-8493-f953580e45f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:04.524428 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 193/398] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:04.543441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c44bf-4c9a-49f6-8eb5-4643785e5882 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:04.546607 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd70e8-227b-43d5-8493-f953580e45f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:04.558106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a0fd70e8-227b-43d5-8493-f953580e45f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:05:04.558106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:04.558106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:04.558106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:04.558106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:04.558106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:04.558106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:04.558106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:04.558106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:04.558106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:04.558106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:04.558106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:04.558106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:04.558106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:04.558106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:04.558106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:04.559146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:04.559146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:04.559146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:04.559146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:04.559146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:04.559146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:04.559146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:04.559146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:04.559146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:04.559146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:04.559146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:04.559146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:04.559146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:04.559146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:04.559146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:04.559146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:04.559909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:04.559909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:04.559909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:04.559909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:04.559909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:04.559909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:04.559909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:04.559909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:04.559909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:04.559909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:04.559909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:05:04.559909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:04.565446 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 206/399] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:04.568986 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd70e8-227b-43d5-8493-f953580e45f6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:04.690049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd70e8-227b-43d5-8493-f953580e45f6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:04.720511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:04.727602 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa6826-bfdb-4dcf-8bb3-a6372a53bc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:04.728579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa6826-bfdb-4dcf-8bb3-a6372a53bc1a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:04.729086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa6826-bfdb-4dcf-8bb3-a6372a53bc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:04.729587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa6826-bfdb-4dcf-8bb3-a6372a53bc1a None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:04.730524 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa6826-bfdb-4dcf-8bb3-a6372a53bc1a None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:04.731029 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa6826-bfdb-4dcf-8bb3-a6372a53bc1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:04.732830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa6826-bfdb-4dcf-8bb3-a6372a53bc1a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:04.742046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 207/400] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:05:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:04.747946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa6826-bfdb-4dcf-8bb3-a6372a53bc1a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:04.770258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:04.784820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c44bf-4c9a-49f6-8eb5-4643785e5882 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:04.846230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c320b4-2b22-463a-9a40-73519661a247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:04.848617 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c320b4-2b22-463a-9a40-73519661a247 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:04.849106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c320b4-2b22-463a-9a40-73519661a247 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:04.849824 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c320b4-2b22-463a-9a40-73519661a247 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:04.864741 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c320b4-2b22-463a-9a40-73519661a247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:04.876852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-c0c320b4-2b22-463a-9a40-73519661a247 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:05:04.876852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:04.876852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:04.876852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:04.876852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:04.876852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:04.876852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:04.876852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:04.876852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:04.876852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:04.876852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:04.876852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:04.876852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:04.876852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:04.876852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:04.876852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:04.878278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:04.878278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:04.878278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:04.878278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:04.878278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:04.878278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:04.878278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:04.878278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:04.878278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:04.878278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:04.878278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:04.878278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:04.878278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:04.878278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:04.878278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:04.878278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:04.879061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:04.879061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:04.879061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:04.879061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:04.879061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:04.879061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:04.879061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:04.879061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:04.879061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:04.879061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:04.879061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:05:04.879061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:04.886500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 194/401] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:05:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:05:04.886500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfcd9a-2eb1-4fbb-981a-5e772664ae1e None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:04.886500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfcd9a-2eb1-4fbb-981a-5e772664ae1e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:04.886500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfcd9a-2eb1-4fbb-981a-5e772664ae1e None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:04.888346 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 195/402] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:04.889377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfcd9a-2eb1-4fbb-981a-5e772664ae1e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:04.903867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa6826-bfdb-4dcf-8bb3-a6372a53bc1a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:04.951141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287b9d0-c67f-4b10-abf3-ce6bb623a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:04.952462 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287b9d0-c67f-4b10-abf3-ce6bb623a236 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:04.952758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287b9d0-c67f-4b10-abf3-ce6bb623a236 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:04.953041 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287b9d0-c67f-4b10-abf3-ce6bb623a236 None admin] PATH_INFO: `/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:04.954532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287b9d0-c67f-4b10-abf3-ce6bb623a236 None admin] RBAC: Authorizing `identity:get_group(group_id=6d982d9dde5e48c3a29c41b2f3351bf0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:04.956869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287b9d0-c67f-4b10-abf3-ce6bb623a236 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:04.959558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 208/403] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 25 16:05:04 2022] GET /identity/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:04.962001 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04484de0-d653-4d29-b56a-40fc90012ea9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:04.962596 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04484de0-d653-4d29-b56a-40fc90012ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:04.963104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04484de0-d653-4d29-b56a-40fc90012ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:04.997203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-04484de0-d653-4d29-b56a-40fc90012ea9 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:04.998409 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-04484de0-d653-4d29-b56a-40fc90012ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:05.031267 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfcd9a-2eb1-4fbb-981a-5e772664ae1e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:05.071507 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:05.077626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27de8c-02d7-4a43-a073-e22a25415ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:05.079291 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27de8c-02d7-4a43-a073-e22a25415ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:05.079750 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27de8c-02d7-4a43-a073-e22a25415ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:05.080427 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27de8c-02d7-4a43-a073-e22a25415ad5 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:05.081969 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27de8c-02d7-4a43-a073-e22a25415ad5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:05.082405 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27de8c-02d7-4a43-a073-e22a25415ad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:05.083929 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27de8c-02d7-4a43-a073-e22a25415ad5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:05.084952 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 209/404] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:05.085961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04484de0-d653-4d29-b56a-40fc90012ea9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:05.100310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 196/405] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:05.101820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27de8c-02d7-4a43-a073-e22a25415ad5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:05.123854 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:05.217567 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27de8c-02d7-4a43-a073-e22a25415ad5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:05.229668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04484de0-d653-4d29-b56a-40fc90012ea9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:05.262430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c63eef-fd29-46bd-a00d-e573f15fa379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:05.264221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c63eef-fd29-46bd-a00d-e573f15fa379 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:05.264956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c63eef-fd29-46bd-a00d-e573f15fa379 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:05.265623 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c63eef-fd29-46bd-a00d-e573f15fa379 None admin] PATH_INFO: `/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:05.267635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c63eef-fd29-46bd-a00d-e573f15fa379 None admin] RBAC: Authorizing `identity:get_group(group_id=6d982d9dde5e48c3a29c41b2f3351bf0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:05.271177 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c63eef-fd29-46bd-a00d-e573f15fa379 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:05.273070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464c2c3-c543-4b89-b50a-cd10fb37ccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:05.273941 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464c2c3-c543-4b89-b50a-cd10fb37ccfc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:05.274220 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464c2c3-c543-4b89-b50a-cd10fb37ccfc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:05.274493 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464c2c3-c543-4b89-b50a-cd10fb37ccfc None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:05.275854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464c2c3-c543-4b89-b50a-cd10fb37ccfc None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:05.276142 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 197/406] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 25 16:05:05 2022] GET /identity/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:05.277907 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c63eef-fd29-46bd-a00d-e573f15fa379 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:05.282137 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464c2c3-c543-4b89-b50a-cd10fb37ccfc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:05.285387 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 210/407] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:05:05 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:05.287992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464c2c3-c543-4b89-b50a-cd10fb37ccfc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:05.409464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:05.436452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:05.465935 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c63eef-fd29-46bd-a00d-e573f15fa379 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:05.479111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464c2c3-c543-4b89-b50a-cd10fb37ccfc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:05.525097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba572c9-e9cf-4653-934f-c77f5aac1181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:05.526375 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba572c9-e9cf-4653-934f-c77f5aac1181 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:05.527105 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba572c9-e9cf-4653-934f-c77f5aac1181 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:05.527582 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba572c9-e9cf-4653-934f-c77f5aac1181 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:05.538003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810da60-48bc-47c6-82a2-2f42f70b72ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:05.539777 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810da60-48bc-47c6-82a2-2f42f70b72ca None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:05.540532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810da60-48bc-47c6-82a2-2f42f70b72ca None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:05.541255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810da60-48bc-47c6-82a2-2f42f70b72ca None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:05.543410 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810da60-48bc-47c6-82a2-2f42f70b72ca None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:05.545277 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba572c9-e9cf-4653-934f-c77f5aac1181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:05.546554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810da60-48bc-47c6-82a2-2f42f70b72ca None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:05.556279 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 211/408] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:05:05 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:05.557889 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810da60-48bc-47c6-82a2-2f42f70b72ca None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:05.560166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-0ba572c9-e9cf-4653-934f-c77f5aac1181 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:05.560166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:05.560166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:05.560166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:05.560166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:05.560166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:05.560166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:05.560166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:05.560166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:05.560166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:05.560166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:05.560166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:05.560166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:05.560166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:05.560166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:05.560166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:05.561834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:05.561834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:05.561834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:05.561834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:05.561834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:05.561834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:05.561834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:05.561834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:05.561834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:05.561834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:05.561834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:05.561834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:05.561834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:05.561834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:05.561834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:05.561834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:05.562897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:05.562897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:05.562897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:05.562897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:05.562897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:05.562897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:05.562897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:05.562897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:05.562897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:05.562897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:05.562897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:05.562897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:05.562897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 198/409] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:05:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:05.569058 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba572c9-e9cf-4653-934f-c77f5aac1181 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:05.671713 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810da60-48bc-47c6-82a2-2f42f70b72ca None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:05.684048 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba572c9-e9cf-4653-934f-c77f5aac1181 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:05.700763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:05.710177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a7de6-80d1-4acb-9472-b491eef1d708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:05.711485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a7de6-80d1-4acb-9472-b491eef1d708 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:05.711970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a7de6-80d1-4acb-9472-b491eef1d708 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:05.712492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a7de6-80d1-4acb-9472-b491eef1d708 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0/groups/6d982d9dde5e48c3a29c41b2f3351bf0/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:05.714650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a7de6-80d1-4acb-9472-b491eef1d708 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe640fcb276d4bdabd5a537cc3153aa0, group_id=6d982d9dde5e48c3a29c41b2f3351bf0, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:05.716308 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a7de6-80d1-4acb-9472-b491eef1d708 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:05.725317 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e4790-e3d0-4f4a-bb48-1a1b3de422c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:05.726294 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e4790-e3d0-4f4a-bb48-1a1b3de422c9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:05.726583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e4790-e3d0-4f4a-bb48-1a1b3de422c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:05.726908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e4790-e3d0-4f4a-bb48-1a1b3de422c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:05.728023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e4790-e3d0-4f4a-bb48-1a1b3de422c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:05.728385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e4790-e3d0-4f4a-bb48-1a1b3de422c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:05.730629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e4790-e3d0-4f4a-bb48-1a1b3de422c9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:05.733771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 212/410] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Jul 25 16:05:05 2022] PUT /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0/groups/6d982d9dde5e48c3a29c41b2f3351bf0/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:05:05.734929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a7de6-80d1-4acb-9472-b491eef1d708 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:05.754774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 199/411] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:05.760514 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e4790-e3d0-4f4a-bb48-1a1b3de422c9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:05.777448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:05.918862 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e4790-e3d0-4f4a-bb48-1a1b3de422c9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:05.932886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a7de6-80d1-4acb-9472-b491eef1d708 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:05.960815 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8aa99-2203-4b5c-b602-12e0d05965fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:05.961690 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8aa99-2203-4b5c-b602-12e0d05965fe None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:05.961971 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8aa99-2203-4b5c-b602-12e0d05965fe None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:05.962268 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8aa99-2203-4b5c-b602-12e0d05965fe None admin] PATH_INFO: `/v3/groups/a34f880f989c472ea0331b30e33d1776` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:05.963418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8aa99-2203-4b5c-b602-12e0d05965fe None admin] RBAC: Authorizing `identity:get_group(group_id=a34f880f989c472ea0331b30e33d1776)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:05.970640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8aa99-2203-4b5c-b602-12e0d05965fe None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:05.970640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 200/412] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 25 16:05:05 2022] GET /identity/v3/groups/a34f880f989c472ea0331b30e33d1776 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:05.970640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c2149-1732-45f5-80b4-de4e5c4e2f3c None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:05.970640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c2149-1732-45f5-80b4-de4e5c4e2f3c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:05.970640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c2149-1732-45f5-80b4-de4e5c4e2f3c None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:05.970640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 201/413] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:05.974799 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15275e62-dca6-4888-ac05-f52c33e660f3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:05.975122 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15275e62-dca6-4888-ac05-f52c33e660f3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:05.975365 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15275e62-dca6-4888-ac05-f52c33e660f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:05.985195 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a9123-7bbd-49aa-95a2-25c144bb6598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:05.986107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a9123-7bbd-49aa-95a2-25c144bb6598 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:05.986467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a9123-7bbd-49aa-95a2-25c144bb6598 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:05.986817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a9123-7bbd-49aa-95a2-25c144bb6598 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0/groups/6d982d9dde5e48c3a29c41b2f3351bf0/roles/e4ade3cd570d4865b356cbe822b76fe9` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:05.990397 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a9123-7bbd-49aa-95a2-25c144bb6598 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe640fcb276d4bdabd5a537cc3153aa0, group_id=6d982d9dde5e48c3a29c41b2f3351bf0, role_id=e4ade3cd570d4865b356cbe822b76fe9)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:05.992150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a9123-7bbd-49aa-95a2-25c144bb6598 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:05.994606 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-15275e62-dca6-4888-ac05-f52c33e660f3 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:05.995878 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-15275e62-dca6-4888-ac05-f52c33e660f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:06.014560 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 213/414] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Jul 25 16:05:05 2022] PUT /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0/groups/6d982d9dde5e48c3a29c41b2f3351bf0/roles/e4ade3cd570d4865b356cbe822b76fe9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:05:06.016555 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a9123-7bbd-49aa-95a2-25c144bb6598 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:06.125268 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 202/415] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:06.132781 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:06.152842 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15275e62-dca6-4888-ac05-f52c33e660f3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:06.156180 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:06.248528 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a9123-7bbd-49aa-95a2-25c144bb6598 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:06.295642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feca50-61eb-49de-a90a-c08d5116997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:06.296978 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feca50-61eb-49de-a90a-c08d5116997a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:06.297303 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feca50-61eb-49de-a90a-c08d5116997a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:06.297578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feca50-61eb-49de-a90a-c08d5116997a None admin] PATH_INFO: `/v3/projects/b95a5c35a0f44e44aca71af300d042a5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:06.298832 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feca50-61eb-49de-a90a-c08d5116997a None admin] RBAC: Authorizing `identity:get_project(project_id=b95a5c35a0f44e44aca71af300d042a5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:06.300952 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feca50-61eb-49de-a90a-c08d5116997a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:06.303474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 214/416] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:05:06 2022] GET /identity/v3/projects/b95a5c35a0f44e44aca71af300d042a5 => generated 344 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:06.309418 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feca50-61eb-49de-a90a-c08d5116997a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:06.318401 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15275e62-dca6-4888-ac05-f52c33e660f3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:06.370627 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7cc45-d56f-44fa-b926-ce1f865292bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:06.371611 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7cc45-d56f-44fa-b926-ce1f865292bf None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:06.372009 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7cc45-d56f-44fa-b926-ce1f865292bf None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:06.372304 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7cc45-d56f-44fa-b926-ce1f865292bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:06.387629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7cc45-d56f-44fa-b926-ce1f865292bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:06.397901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-14a7cc45-d56f-44fa-b926-ce1f865292bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:05:06.397901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:06.397901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:06.397901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:06.397901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:06.397901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:06.397901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:06.397901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:06.397901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:06.397901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:06.397901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:06.397901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:06.397901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:06.397901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:06.397901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:06.397901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:06.400046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:06.400046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:06.400046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:06.400046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:06.400046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:06.400046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:06.400046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:06.400046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:06.400046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:06.400046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:06.400046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:06.400046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:06.400046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:06.400046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:06.400046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:06.400046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:06.402368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:06.402368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:06.402368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:06.402368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:06.402368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:06.402368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:06.402368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:06.402368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:06.402368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:06.402368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:06.402368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:05:06.402368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:06.402368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 203/417] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:06.406351 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fe16b-b746-486d-b3a4-53eea091e15b None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:06.406642 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fe16b-b746-486d-b3a4-53eea091e15b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:06.406919 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fe16b-b746-486d-b3a4-53eea091e15b None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:06.408397 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 204/418] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:06.410859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fe16b-b746-486d-b3a4-53eea091e15b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:06.430668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feca50-61eb-49de-a90a-c08d5116997a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:06.447911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:06.468613 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63593ede-29c3-4378-bee8-b3d90fa623de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:06.469633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63593ede-29c3-4378-bee8-b3d90fa623de None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:06.469917 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63593ede-29c3-4378-bee8-b3d90fa623de None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:06.470194 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63593ede-29c3-4378-bee8-b3d90fa623de None admin] PATH_INFO: `/v3/projects/b95a5c35a0f44e44aca71af300d042a5/groups/a34f880f989c472ea0331b30e33d1776/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:06.472971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63593ede-29c3-4378-bee8-b3d90fa623de None admin] RBAC: Authorizing `identity:create_grant(project_id=b95a5c35a0f44e44aca71af300d042a5, group_id=a34f880f989c472ea0331b30e33d1776, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:06.474571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63593ede-29c3-4378-bee8-b3d90fa623de None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:06.491073 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 215/419] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Jul 25 16:05:06 2022] PUT /identity/v3/projects/b95a5c35a0f44e44aca71af300d042a5/groups/a34f880f989c472ea0331b30e33d1776/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:05:06.492734 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8e8bc-07c1-4887-bffd-e10226ed60b3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:06.493032 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8e8bc-07c1-4887-bffd-e10226ed60b3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:06.493313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8e8bc-07c1-4887-bffd-e10226ed60b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:06.494275 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:06.516863 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a0e8e8bc-07c1-4887-bffd-e10226ed60b3 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:06.517955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a0e8e8bc-07c1-4887-bffd-e10226ed60b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:06.542321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fe16b-b746-486d-b3a4-53eea091e15b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:06.581261 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c43d4-232d-45c4-8141-e42bd7a90aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:06.582360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c43d4-232d-45c4-8141-e42bd7a90aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:06.582848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c43d4-232d-45c4-8141-e42bd7a90aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:06.583321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c43d4-232d-45c4-8141-e42bd7a90aa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:06.584345 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c43d4-232d-45c4-8141-e42bd7a90aa9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:06.584900 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c43d4-232d-45c4-8141-e42bd7a90aa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:06.586570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c43d4-232d-45c4-8141-e42bd7a90aa9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:06.597166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 205/420] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:05:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:06.603104 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c43d4-232d-45c4-8141-e42bd7a90aa9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:06.603363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 216/421] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:06.629793 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8e8bc-07c1-4887-bffd-e10226ed60b3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:06.721730 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c43d4-232d-45c4-8141-e42bd7a90aa9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:06.749946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:06.760385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543d1e2-c0fd-4306-b88e-d770bc17b1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:06.761399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543d1e2-c0fd-4306-b88e-d770bc17b1fd None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:06.761909 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543d1e2-c0fd-4306-b88e-d770bc17b1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:06.762414 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543d1e2-c0fd-4306-b88e-d770bc17b1fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:06.763908 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8e8bc-07c1-4887-bffd-e10226ed60b3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:06.772992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:06.805520 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f38cfe-039d-4b57-9ebb-db5eb8b51c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:06.806433 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f38cfe-039d-4b57-9ebb-db5eb8b51c47 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:06.806719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f38cfe-039d-4b57-9ebb-db5eb8b51c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:06.806996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f38cfe-039d-4b57-9ebb-db5eb8b51c47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:06.818680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f38cfe-039d-4b57-9ebb-db5eb8b51c47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:06.828882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d0f38cfe-039d-4b57-9ebb-db5eb8b51c47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:05:06.828882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:06.828882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:06.828882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:06.828882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:06.828882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:06.828882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:06.828882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:06.828882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:06.828882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:06.828882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:06.828882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:06.828882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:06.828882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:06.828882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:06.828882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:06.829818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:06.829818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:06.829818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:06.829818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:06.829818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:06.829818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:06.829818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:06.829818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:06.829818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:06.829818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:06.829818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:06.829818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:06.829818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:06.829818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:06.829818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:06.829818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:06.831150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:06.831150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:06.831150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:06.831150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:06.831150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:06.831150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:06.831150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:06.831150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:06.831150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:06.831150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:06.831150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:05:06.831150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:06.831150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 217/422] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:05:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:06.837035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f38cfe-039d-4b57-9ebb-db5eb8b51c47 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:06.843715 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543d1e2-c0fd-4306-b88e-d770bc17b1fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:06.845481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543d1e2-c0fd-4306-b88e-d770bc17b1fd None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:06.950763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f38cfe-039d-4b57-9ebb-db5eb8b51c47 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:06.953740 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 206/423] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 16:05:06.959848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543d1e2-c0fd-4306-b88e-d770bc17b1fd None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:06.988910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed1fa0-81a8-49ce-aa21-1d2dc9c88f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:06.989604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed1fa0-81a8-49ce-aa21-1d2dc9c88f52 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:06.989892 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed1fa0-81a8-49ce-aa21-1d2dc9c88f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:06.990170 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed1fa0-81a8-49ce-aa21-1d2dc9c88f52 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:06.990873 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:06.991719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed1fa0-81a8-49ce-aa21-1d2dc9c88f52 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:06.992033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed1fa0-81a8-49ce-aa21-1d2dc9c88f52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:06.993975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed1fa0-81a8-49ce-aa21-1d2dc9c88f52 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:07.006026 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 218/424] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:07.015545 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed1fa0-81a8-49ce-aa21-1d2dc9c88f52 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:07.057084 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:07.087625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543d1e2-c0fd-4306-b88e-d770bc17b1fd None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:07.148374 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311aabc1-d6d6-4d89-bc99-18b9baeaa637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:07.149656 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aabc1-d6d6-4d89-bc99-18b9baeaa637 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:07.150197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aabc1-d6d6-4d89-bc99-18b9baeaa637 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:07.150685 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aabc1-d6d6-4d89-bc99-18b9baeaa637 None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:07.152592 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311aabc1-d6d6-4d89-bc99-18b9baeaa637 None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:07.155345 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311aabc1-d6d6-4d89-bc99-18b9baeaa637 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:07.157747 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 207/425] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:05:06 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:07.167951 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311aabc1-d6d6-4d89-bc99-18b9baeaa637 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:07.199192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed1fa0-81a8-49ce-aa21-1d2dc9c88f52 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:07.255291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a344b13-72b0-4d71-94f5-310f61b7de6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:07.257128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344b13-72b0-4d71-94f5-310f61b7de6f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:07.257676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344b13-72b0-4d71-94f5-310f61b7de6f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:07.258231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344b13-72b0-4d71-94f5-310f61b7de6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:07.341634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:07.350322 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311aabc1-d6d6-4d89-bc99-18b9baeaa637 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:07.389239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae51db-c37b-45f0-b869-949224e7a969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:07.390607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae51db-c37b-45f0-b869-949224e7a969 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:07.391188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae51db-c37b-45f0-b869-949224e7a969 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:07.391676 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae51db-c37b-45f0-b869-949224e7a969 None admin] PATH_INFO: `/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:07.392531 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a344b13-72b0-4d71-94f5-310f61b7de6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:07.394173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae51db-c37b-45f0-b869-949224e7a969 None admin] RBAC: Authorizing `identity:get_group(group_id=6d982d9dde5e48c3a29c41b2f3351bf0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:07.394938 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a344b13-72b0-4d71-94f5-310f61b7de6f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:07.396236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae51db-c37b-45f0-b869-949224e7a969 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:07.398723 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 208/426] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 25 16:05:07 2022] GET /identity/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:07.405282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae51db-c37b-45f0-b869-949224e7a969 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:07.457581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:07.521131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae51db-c37b-45f0-b869-949224e7a969 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:07.558849 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66bf1d-d153-4ff1-b909-66a0b8f51ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:07.559867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66bf1d-d153-4ff1-b909-66a0b8f51ecf None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:07.560386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66bf1d-d153-4ff1-b909-66a0b8f51ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:07.560867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66bf1d-d153-4ff1-b909-66a0b8f51ecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:07.561909 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66bf1d-d153-4ff1-b909-66a0b8f51ecf None admin] RBAC: Adding query filter params (group.id=6d982d9dde5e48c3a29c41b2f3351bf0, role.id=6a0b49157bc649ef99e870c62ee6f4fe, scope.project.id=c386c04bad694a429d89ba0a586c8a45) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:07.562468 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66bf1d-d153-4ff1-b909-66a0b8f51ecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:07.564131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66bf1d-d153-4ff1-b909-66a0b8f51ecf None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:07.571043 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 209/427] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 25 16:05:07 2022] GET /identity/v3/role_assignments?group.id=6d982d9dde5e48c3a29c41b2f3351bf0&scope.project.id=c386c04bad694a429d89ba0a586c8a45&role.id=6a0b49157bc649ef99e870c62ee6f4fe => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:07.618248 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 219/428] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:07.623922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66bf1d-d153-4ff1-b909-66a0b8f51ecf None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:07.657018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:07.743296 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66bf1d-d153-4ff1-b909-66a0b8f51ecf None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:07.781700 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57995899-fe40-49be-bdbb-91150d7c7833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:07.782991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57995899-fe40-49be-bdbb-91150d7c7833 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:07.783515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57995899-fe40-49be-bdbb-91150d7c7833 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:07.784580 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57995899-fe40-49be-bdbb-91150d7c7833 None admin] PATH_INFO: `/v3/projects/c386c04bad694a429d89ba0a586c8a45` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:07.786071 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57995899-fe40-49be-bdbb-91150d7c7833 None admin] RBAC: Authorizing `identity:get_project(project_id=c386c04bad694a429d89ba0a586c8a45)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:07.787738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57995899-fe40-49be-bdbb-91150d7c7833 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:07.790061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 210/429] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:05:07 2022] GET /identity/v3/projects/c386c04bad694a429d89ba0a586c8a45 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:07.795567 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a344b13-72b0-4d71-94f5-310f61b7de6f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:07.974134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a344b13-72b0-4d71-94f5-310f61b7de6f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:08.006551 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:08.018880 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5315c-4757-495f-b76e-dcf3fc23edc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:08.019881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5315c-4757-495f-b76e-dcf3fc23edc5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:08.020166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5315c-4757-495f-b76e-dcf3fc23edc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:08.020487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5315c-4757-495f-b76e-dcf3fc23edc5 None admin] PATH_INFO: `/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:08.021741 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5315c-4757-495f-b76e-dcf3fc23edc5 None admin] RBAC: Authorizing `identity:get_group(group_id=6d982d9dde5e48c3a29c41b2f3351bf0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:08.023293 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5315c-4757-495f-b76e-dcf3fc23edc5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:08.025427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 220/430] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 25 16:05:07 2022] GET /identity/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:08.031173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57995899-fe40-49be-bdbb-91150d7c7833 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:08.147310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:08.154856 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57995899-fe40-49be-bdbb-91150d7c7833 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:08.199770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343c6db-f1c3-4a3c-8fc2-86f4a476fc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:08.200834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343c6db-f1c3-4a3c-8fc2-86f4a476fc6b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:08.201324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343c6db-f1c3-4a3c-8fc2-86f4a476fc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:08.201804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343c6db-f1c3-4a3c-8fc2-86f4a476fc6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:08.202864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343c6db-f1c3-4a3c-8fc2-86f4a476fc6b None admin] RBAC: Adding query filter params (group.id=6d982d9dde5e48c3a29c41b2f3351bf0, role.id=e4ade3cd570d4865b356cbe822b76fe9, scope.project.id=c386c04bad694a429d89ba0a586c8a45) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:08.203379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343c6db-f1c3-4a3c-8fc2-86f4a476fc6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:08.205064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343c6db-f1c3-4a3c-8fc2-86f4a476fc6b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:08.212727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 211/431] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 25 16:05:08 2022] GET /identity/v3/role_assignments?group.id=6d982d9dde5e48c3a29c41b2f3351bf0&scope.project.id=c386c04bad694a429d89ba0a586c8a45&role.id=e4ade3cd570d4865b356cbe822b76fe9 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:08.368705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824091b-f437-401e-8779-89ca7b794f43 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:08.369222 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824091b-f437-401e-8779-89ca7b794f43 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:08.369294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824091b-f437-401e-8779-89ca7b794f43 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:08.370760 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 221/432] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:08.376767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185a47f-f7ba-4b09-b3fe-cc7c551b3296 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:08.379692 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d52d85-849d-4255-8f01-2b1234129acd None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:08.380055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d52d85-849d-4255-8f01-2b1234129acd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:08.380428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d52d85-849d-4255-8f01-2b1234129acd None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:08.382047 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 222/433] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:05:08.382170 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185a47f-f7ba-4b09-b3fe-cc7c551b3296 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:08.382398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185a47f-f7ba-4b09-b3fe-cc7c551b3296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:08.387729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a77df-32c4-4ccd-804f-bf1cbb7095d6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:08.388036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a77df-32c4-4ccd-804f-bf1cbb7095d6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:08.388342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a77df-32c4-4ccd-804f-bf1cbb7095d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:08.407962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-5185a47f-f7ba-4b09-b3fe-cc7c551b3296 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:08.408900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a08a77df-32c4-4ccd-804f-bf1cbb7095d6 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:08.409331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5185a47f-f7ba-4b09-b3fe-cc7c551b3296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:08.410501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a08a77df-32c4-4ccd-804f-bf1cbb7095d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:08.498877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 212/434] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:08.513927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 223/435] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:05:08.524417 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185a47f-f7ba-4b09-b3fe-cc7c551b3296 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:08.536817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a77df-32c4-4ccd-804f-bf1cbb7095d6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:08.642528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:08.644459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a77df-32c4-4ccd-804f-bf1cbb7095d6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:08.660301 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185a47f-f7ba-4b09-b3fe-cc7c551b3296 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:08.678819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:08.696180 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f9cae-7247-4b3c-8a90-7c0f7ce624ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:08.697210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f9cae-7247-4b3c-8a90-7c0f7ce624ee None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:08.697608 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f9cae-7247-4b3c-8a90-7c0f7ce624ee None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:08.698000 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f9cae-7247-4b3c-8a90-7c0f7ce624ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:08.704304 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397ec19-af8f-43b4-ac41-4b0b14ce3a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:08.705333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397ec19-af8f-43b4-ac41-4b0b14ce3a03 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:08.705921 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397ec19-af8f-43b4-ac41-4b0b14ce3a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:08.706340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397ec19-af8f-43b4-ac41-4b0b14ce3a03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:08.710492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f9cae-7247-4b3c-8a90-7c0f7ce624ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:08.718431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6f5f9cae-7247-4b3c-8a90-7c0f7ce624ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:05:08.718431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:08.718431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:08.718431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:08.718431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:08.718431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:08.718431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:08.718431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:08.718431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:08.718431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:08.718431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:08.718431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:08.718431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:08.718431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:08.718431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:08.718431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:08.719439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:08.719439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:08.719439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:08.719439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:08.719439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:08.719439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:08.719439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:08.719439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:08.719439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:08.719439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:08.719439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:08.719439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:08.719439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:08.719439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:08.719439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:08.719439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:08.720230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:08.720230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:08.720230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:08.720230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:08.720230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:08.720230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:08.720230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:08.720230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:08.720230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:08.720230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:08.720230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 16:05:08.720230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:08.720971 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397ec19-af8f-43b4-ac41-4b0b14ce3a03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:08.721043 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 224/436] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:08.726345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f9cae-7247-4b3c-8a90-7c0f7ce624ee None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:08.733003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-0397ec19-af8f-43b4-ac41-4b0b14ce3a03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:05:08.733003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:08.733003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:08.733003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:08.733003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:08.733003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:08.733003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:08.733003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:08.733003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:08.733003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:08.733003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:08.733003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:08.733003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:08.733003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:08.733003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:08.733003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:08.733956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:08.733956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:08.733956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:08.733956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:08.733956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:08.733956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:08.733956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:08.733956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:08.733956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:08.733956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:08.733956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:08.733956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:08.733956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:08.733956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:08.733956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:08.733956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:08.734779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:08.734779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:08.734779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:08.734779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:08.734779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:08.734779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:08.734779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:08.734779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:08.734779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:08.734779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:08.734779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:05:08.734779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:08.734779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 213/437] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:05:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:08.735486 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397ec19-af8f-43b4-ac41-4b0b14ce3a03 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:08.885259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397ec19-af8f-43b4-ac41-4b0b14ce3a03 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:08.885438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f9cae-7247-4b3c-8a90-7c0f7ce624ee None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:08.931474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10577146-a5ed-423c-a820-164f189fcfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:08.931679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b089ef-4258-4d5e-92de-2671e4704749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:08.932199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10577146-a5ed-423c-a820-164f189fcfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:08.932391 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b089ef-4258-4d5e-92de-2671e4704749 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:08.932562 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10577146-a5ed-423c-a820-164f189fcfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:08.932671 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b089ef-4258-4d5e-92de-2671e4704749 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:08.932817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10577146-a5ed-423c-a820-164f189fcfc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:08.932960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b089ef-4258-4d5e-92de-2671e4704749 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:08.933541 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10577146-a5ed-423c-a820-164f189fcfc9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:08.933694 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b089ef-4258-4d5e-92de-2671e4704749 None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:08.933849 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10577146-a5ed-423c-a820-164f189fcfc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:08.933991 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b089ef-4258-4d5e-92de-2671e4704749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:08.935247 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10577146-a5ed-423c-a820-164f189fcfc9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:08.935341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b089ef-4258-4d5e-92de-2671e4704749 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:08.944401 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 214/438] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:08.944967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 225/439] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:05:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:08.949789 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10577146-a5ed-423c-a820-164f189fcfc9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:08.950885 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b089ef-4258-4d5e-92de-2671e4704749 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:08.964476 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:09.010687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:09.070066 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b089ef-4258-4d5e-92de-2671e4704749 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:09.077207 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10577146-a5ed-423c-a820-164f189fcfc9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:09.112322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fdd6e-9b81-48d3-bacc-3089721399fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:09.113223 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fdd6e-9b81-48d3-bacc-3089721399fb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:09.113704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fdd6e-9b81-48d3-bacc-3089721399fb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:09.114172 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fdd6e-9b81-48d3-bacc-3089721399fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:09.125761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58ed6b-d97e-4033-ada4-aae68756bc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:09.127135 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58ed6b-d97e-4033-ada4-aae68756bc1b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:09.127821 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58ed6b-d97e-4033-ada4-aae68756bc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:09.128559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58ed6b-d97e-4033-ada4-aae68756bc1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:09.213989 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58ed6b-d97e-4033-ada4-aae68756bc1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:09.215454 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58ed6b-d97e-4033-ada4-aae68756bc1b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:09.219341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fdd6e-9b81-48d3-bacc-3089721399fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:09.222167 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fdd6e-9b81-48d3-bacc-3089721399fb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:09.229569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:09.277344 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:09.326275 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 215/440] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:09.327688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c019c04-e3ee-4e7e-83fc-340460d9edfc None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:09.327980 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c019c04-e3ee-4e7e-83fc-340460d9edfc None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:09.328281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c019c04-e3ee-4e7e-83fc-340460d9edfc None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:09.329554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 216/441] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:09.330413 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 226/442] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:09.332621 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c019c04-e3ee-4e7e-83fc-340460d9edfc None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:09.336644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a993ad-e0a7-4e37-91be-fb1d2b6d2f03 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:09.336644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a993ad-e0a7-4e37-91be-fb1d2b6d2f03 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:09.336644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a993ad-e0a7-4e37-91be-fb1d2b6d2f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:09.353825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-95a993ad-e0a7-4e37-91be-fb1d2b6d2f03 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:09.355020 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-95a993ad-e0a7-4e37-91be-fb1d2b6d2f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:09.422362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 227/443] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:05:09.423034 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a993ad-e0a7-4e37-91be-fb1d2b6d2f03 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:09.438183 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c019c04-e3ee-4e7e-83fc-340460d9edfc None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:09.451227 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:09.476082 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecefb8f-ece0-4c41-9ee3-aca066b738c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:09.476907 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecefb8f-ece0-4c41-9ee3-aca066b738c3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:09.477190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecefb8f-ece0-4c41-9ee3-aca066b738c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:09.477465 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecefb8f-ece0-4c41-9ee3-aca066b738c3 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:09.478647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecefb8f-ece0-4c41-9ee3-aca066b738c3 None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:09.480088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecefb8f-ece0-4c41-9ee3-aca066b738c3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:09.481851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 217/444] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:05:09 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:09.482679 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecefb8f-ece0-4c41-9ee3-aca066b738c3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:09.509265 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:09.531963 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a993ad-e0a7-4e37-91be-fb1d2b6d2f03 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:09.565487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c79d79-ac6b-43eb-925d-3d48a49bbfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:09.566350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79d79-ac6b-43eb-925d-3d48a49bbfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:09.566635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79d79-ac6b-43eb-925d-3d48a49bbfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:09.566912 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79d79-ac6b-43eb-925d-3d48a49bbfd0 None admin] PATH_INFO: `/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:09.568157 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c79d79-ac6b-43eb-925d-3d48a49bbfd0 None admin] RBAC: Authorizing `identity:get_project(project_id=fe640fcb276d4bdabd5a537cc3153aa0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:09.569654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c79d79-ac6b-43eb-925d-3d48a49bbfd0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:09.571541 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 228/445] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:05:09 2022] GET /identity/v3/projects/fe640fcb276d4bdabd5a537cc3153aa0 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:09.572129 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c79d79-ac6b-43eb-925d-3d48a49bbfd0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:09.583932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecefb8f-ece0-4c41-9ee3-aca066b738c3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:09.618711 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca9f8a-f299-47a4-a8d0-c282835842e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:09.619615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca9f8a-f299-47a4-a8d0-c282835842e6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:09.619898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca9f8a-f299-47a4-a8d0-c282835842e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:09.620172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca9f8a-f299-47a4-a8d0-c282835842e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:09.632658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca9f8a-f299-47a4-a8d0-c282835842e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:09.640316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-37ca9f8a-f299-47a4-a8d0-c282835842e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:09.640316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:09.640316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:09.640316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:09.640316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:09.640316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:09.640316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:09.640316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:09.640316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:09.640316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:09.640316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:09.640316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:09.640316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:09.640316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:09.640316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:09.640316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:09.641212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:09.641212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:09.641212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:09.641212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:09.641212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:09.641212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:09.641212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:09.641212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:09.641212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:09.641212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:09.641212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:09.641212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:09.641212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:09.641212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:09.641212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:09.641212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:09.641981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:09.641981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:09.641981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:09.641981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:09.641981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:09.641981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:09.641981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:09.641981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:09.641981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:09.641981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:09.641981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:09.641981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:09.641981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 218/446] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:05:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:09.642655 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca9f8a-f299-47a4-a8d0-c282835842e6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:09.678775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c79d79-ac6b-43eb-925d-3d48a49bbfd0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:09.681861 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:09.713645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c39abb-91d4-4a89-92d6-982dfc90d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:09.714496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c39abb-91d4-4a89-92d6-982dfc90d78f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:09.714774 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c39abb-91d4-4a89-92d6-982dfc90d78f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:09.715038 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c39abb-91d4-4a89-92d6-982dfc90d78f None admin] PATH_INFO: `/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:09.716204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c39abb-91d4-4a89-92d6-982dfc90d78f None admin] RBAC: Authorizing `identity:get_group(group_id=6d982d9dde5e48c3a29c41b2f3351bf0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:09.717645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c39abb-91d4-4a89-92d6-982dfc90d78f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:09.719295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 229/447] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 25 16:05:09 2022] GET /identity/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:09.720055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c39abb-91d4-4a89-92d6-982dfc90d78f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:09.739100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:09.747124 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca9f8a-f299-47a4-a8d0-c282835842e6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:09.781017 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c44511-26ef-4086-9736-626332286088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:09.781925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c44511-26ef-4086-9736-626332286088 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:09.782207 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c44511-26ef-4086-9736-626332286088 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:09.782594 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c44511-26ef-4086-9736-626332286088 None admin] PATH_INFO: `/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:09.784412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c44511-26ef-4086-9736-626332286088 None admin] RBAC: Authorizing `identity:get_group(group_id=6d982d9dde5e48c3a29c41b2f3351bf0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:09.786031 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c44511-26ef-4086-9736-626332286088 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:09.787738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 219/448] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 25 16:05:09 2022] GET /identity/v3/groups/6d982d9dde5e48c3a29c41b2f3351bf0 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:09.788536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c44511-26ef-4086-9736-626332286088 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:09.835264 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c39abb-91d4-4a89-92d6-982dfc90d78f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:09.869419 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3a431-1e00-496d-9a61-e8848d15d1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:09.870091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3a431-1e00-496d-9a61-e8848d15d1ea None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:09.870373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3a431-1e00-496d-9a61-e8848d15d1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:09.870647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3a431-1e00-496d-9a61-e8848d15d1ea None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:09.871382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3a431-1e00-496d-9a61-e8848d15d1ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:09.871691 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3a431-1e00-496d-9a61-e8848d15d1ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:09.873072 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3a431-1e00-496d-9a61-e8848d15d1ea None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:09.881377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 230/449] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:09.882188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3a431-1e00-496d-9a61-e8848d15d1ea None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:09.902034 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c44511-26ef-4086-9736-626332286088 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:09.910892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:09.938534 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a25df5-5345-4a9a-9164-5596c16fa603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:09.939194 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a25df5-5345-4a9a-9164-5596c16fa603 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:09.939469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a25df5-5345-4a9a-9164-5596c16fa603 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:09.939741 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a25df5-5345-4a9a-9164-5596c16fa603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:09.941208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a25df5-5345-4a9a-9164-5596c16fa603 None admin] RBAC: Adding query filter params (group.id=6d982d9dde5e48c3a29c41b2f3351bf0, role.id=e4ade3cd570d4865b356cbe822b76fe9, scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:09.941516 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a25df5-5345-4a9a-9164-5596c16fa603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:09.942983 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a25df5-5345-4a9a-9164-5596c16fa603 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:09.949563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 220/450] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 25 16:05:09 2022] GET /identity/v3/role_assignments?group.id=6d982d9dde5e48c3a29c41b2f3351bf0&scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0&role.id=e4ade3cd570d4865b356cbe822b76fe9 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:09.950718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a25df5-5345-4a9a-9164-5596c16fa603 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:09.970932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:09.998011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3a431-1e00-496d-9a61-e8848d15d1ea None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:10.049122 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a86082-7030-41be-9525-92261e394c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:10.049821 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a86082-7030-41be-9525-92261e394c79 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:10.050109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a86082-7030-41be-9525-92261e394c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:10.050389 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a86082-7030-41be-9525-92261e394c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:10.051242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a86082-7030-41be-9525-92261e394c79 None admin] RBAC: Adding query filter params (group.id=6d982d9dde5e48c3a29c41b2f3351bf0, role.id=6a0b49157bc649ef99e870c62ee6f4fe, scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:10.051554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a86082-7030-41be-9525-92261e394c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:10.053074 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a86082-7030-41be-9525-92261e394c79 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:10.060915 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 231/451] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 25 16:05:09 2022] GET /identity/v3/role_assignments?group.id=6d982d9dde5e48c3a29c41b2f3351bf0&scope.project.id=fe640fcb276d4bdabd5a537cc3153aa0&role.id=6a0b49157bc649ef99e870c62ee6f4fe => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:10.086625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a25df5-5345-4a9a-9164-5596c16fa603 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:10.134562 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22796d2-6e6f-412b-ba6c-bd0a498f3d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:10.135880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22796d2-6e6f-412b-ba6c-bd0a498f3d10 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:10.136164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22796d2-6e6f-412b-ba6c-bd0a498f3d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:10.136485 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22796d2-6e6f-412b-ba6c-bd0a498f3d10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:10.192058 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:10.235493 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22796d2-6e6f-412b-ba6c-bd0a498f3d10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:10.237598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22796d2-6e6f-412b-ba6c-bd0a498f3d10 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:10.346170 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 221/452] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:10.353104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a86082-7030-41be-9525-92261e394c79 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:10.469167 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a86082-7030-41be-9525-92261e394c79 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:10.506886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a1b59-05a8-46f5-a688-3a8d883a511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:10.507776 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a1b59-05a8-46f5-a688-3a8d883a511b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:10.508062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a1b59-05a8-46f5-a688-3a8d883a511b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:10.508369 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a1b59-05a8-46f5-a688-3a8d883a511b None admin] PATH_INFO: `/v3/projects/b95a5c35a0f44e44aca71af300d042a5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:10.509615 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a1b59-05a8-46f5-a688-3a8d883a511b None admin] RBAC: Authorizing `identity:get_project(project_id=b95a5c35a0f44e44aca71af300d042a5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:10.511063 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a1b59-05a8-46f5-a688-3a8d883a511b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:10.512848 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 232/453] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:05:10 2022] GET /identity/v3/projects/b95a5c35a0f44e44aca71af300d042a5 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:10.519552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22796d2-6e6f-412b-ba6c-bd0a498f3d10 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:10.601776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:10.636923 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22796d2-6e6f-412b-ba6c-bd0a498f3d10 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:10.672134 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4072ad5-7690-47cd-8d27-fa47ffc732bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:10.673019 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4072ad5-7690-47cd-8d27-fa47ffc732bd None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:10.673298 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4072ad5-7690-47cd-8d27-fa47ffc732bd None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:10.673568 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4072ad5-7690-47cd-8d27-fa47ffc732bd None admin] PATH_INFO: `/v3/groups/a34f880f989c472ea0331b30e33d1776` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:10.674817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4072ad5-7690-47cd-8d27-fa47ffc732bd None admin] RBAC: Authorizing `identity:get_group(group_id=a34f880f989c472ea0331b30e33d1776)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:10.676311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4072ad5-7690-47cd-8d27-fa47ffc732bd None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:10.677975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 222/454] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Jul 25 16:05:10 2022] GET /identity/v3/groups/a34f880f989c472ea0331b30e33d1776 => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:10.683961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a1b59-05a8-46f5-a688-3a8d883a511b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:10.696511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:10.787707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a1b59-05a8-46f5-a688-3a8d883a511b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:10.822653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727007a-1541-43ca-8191-d70071cb5ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:10.823313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727007a-1541-43ca-8191-d70071cb5ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:10.823597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727007a-1541-43ca-8191-d70071cb5ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:10.823874 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727007a-1541-43ca-8191-d70071cb5ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:10.824722 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727007a-1541-43ca-8191-d70071cb5ae9 None admin] RBAC: Adding query filter params (group.id=a34f880f989c472ea0331b30e33d1776, role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=b95a5c35a0f44e44aca71af300d042a5) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:10.825035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727007a-1541-43ca-8191-d70071cb5ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:10.826460 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727007a-1541-43ca-8191-d70071cb5ae9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:10.832816 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 233/455] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Jul 25 16:05:10 2022] GET /identity/v3/role_assignments?group.id=a34f880f989c472ea0331b30e33d1776&scope.project.id=b95a5c35a0f44e44aca71af300d042a5&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:13.384591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c1129-be3b-419d-b07b-cdd0eb35795c None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:13.385129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c1129-be3b-419d-b07b-cdd0eb35795c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:13.385129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c1129-be3b-419d-b07b-cdd0eb35795c None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:13.386785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 223/456] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:13.392641 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e3280-8aab-4435-8b65-6b27e8defab7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:13.393659 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e3280-8aab-4435-8b65-6b27e8defab7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:13.393758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e3280-8aab-4435-8b65-6b27e8defab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:13.421875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-fe4e3280-8aab-4435-8b65-6b27e8defab7 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:13.423092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fe4e3280-8aab-4435-8b65-6b27e8defab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:13.530307 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 234/457] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:13.566700 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c1129-be3b-419d-b07b-cdd0eb35795c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:13.587387 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491154ea-95f5-4bb5-b3b1-008568defca8 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:13.588312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491154ea-95f5-4bb5-b3b1-008568defca8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:13.588944 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491154ea-95f5-4bb5-b3b1-008568defca8 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:13.590990 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 235/458] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:13.598076 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f229a-7869-4383-8d85-ad1ae2c43d7f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:13.598318 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f229a-7869-4383-8d85-ad1ae2c43d7f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:13.598563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f229a-7869-4383-8d85-ad1ae2c43d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:13.608362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:13.628798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-190f229a-7869-4383-8d85-ad1ae2c43d7f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:13.629989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-190f229a-7869-4383-8d85-ad1ae2c43d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:13.723832 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 236/459] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:13.747777 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c1129-be3b-419d-b07b-cdd0eb35795c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:13.768457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f229a-7869-4383-8d85-ad1ae2c43d7f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:13.811287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b932f-1a05-4ec2-b224-7c6836c7c323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:13.812477 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b932f-1a05-4ec2-b224-7c6836c7c323 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:13.812985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b932f-1a05-4ec2-b224-7c6836c7c323 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:13.813460 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b932f-1a05-4ec2-b224-7c6836c7c323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:13.820805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:13.827310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b932f-1a05-4ec2-b224-7c6836c7c323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:13.829254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b932f-1a05-4ec2-b224-7c6836c7c323 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:13.851832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-cc2b932f-1a05-4ec2-b224-7c6836c7c323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:13.851832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:13.851832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:13.851832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:13.851832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:13.851832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:13.851832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:13.851832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:13.851832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:13.851832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:13.851832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:13.851832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:13.851832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:13.851832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:13.851832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:13.852793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:13.853620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:13.853620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:13.853620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:13.853620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:13.856104 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 224/460] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:13.858172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f618c-e17b-4f51-a5d8-4b84406cc667 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:13.858708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f618c-e17b-4f51-a5d8-4b84406cc667 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:13.859206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f618c-e17b-4f51-a5d8-4b84406cc667 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:13.865000 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 225/461] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:13.866261 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f618c-e17b-4f51-a5d8-4b84406cc667 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:13.900609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f229a-7869-4383-8d85-ad1ae2c43d7f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:13.940784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:13.947341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c17a58-3d2d-4f54-82dd-5a111a7e61c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:13.948242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c17a58-3d2d-4f54-82dd-5a111a7e61c0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:13.948614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c17a58-3d2d-4f54-82dd-5a111a7e61c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:13.949633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c17a58-3d2d-4f54-82dd-5a111a7e61c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:13.963052 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c17a58-3d2d-4f54-82dd-5a111a7e61c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:13.965408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c17a58-3d2d-4f54-82dd-5a111a7e61c0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:13.992054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e3c17a58-3d2d-4f54-82dd-5a111a7e61c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:13.992054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:13.992054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:13.992054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:13.992054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:13.992054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:13.992054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:13.992054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:13.992054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:13.992054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:13.992054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:13.992054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:13.992054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:13.992054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:13.992054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:13.993208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:13.994229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:13.994229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:13.994229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:13.994229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:13.996448 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 237/462] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:05:13.999327 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67d477-fb73-4de2-a25d-febba3f6c799 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:13.999767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67d477-fb73-4de2-a25d-febba3f6c799 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:14.000166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67d477-fb73-4de2-a25d-febba3f6c799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:14.000595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f618c-e17b-4f51-a5d8-4b84406cc667 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:14.023223 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7b67d477-fb73-4de2-a25d-febba3f6c799 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:14.024715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7b67d477-fb73-4de2-a25d-febba3f6c799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:14.044512 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bb78f-4272-493f-96c0-c6e64d8399f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:14.045470 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bb78f-4272-493f-96c0-c6e64d8399f8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:14.045784 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bb78f-4272-493f-96c0-c6e64d8399f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:14.046023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bb78f-4272-493f-96c0-c6e64d8399f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:14.046741 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bb78f-4272-493f-96c0-c6e64d8399f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:14.047050 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bb78f-4272-493f-96c0-c6e64d8399f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:14.048446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bb78f-4272-493f-96c0-c6e64d8399f8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:14.061408 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 226/463] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:14.065739 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bb78f-4272-493f-96c0-c6e64d8399f8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:14.101446 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 238/464] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:14.110293 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd493dc-4fc3-40e1-9d0d-6b9b02a8481d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:14.110695 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd493dc-4fc3-40e1-9d0d-6b9b02a8481d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:14.111668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd493dc-4fc3-40e1-9d0d-6b9b02a8481d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:14.116622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 239/465] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:14 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:14.117766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd493dc-4fc3-40e1-9d0d-6b9b02a8481d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:14.127595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:14.183129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bb78f-4272-493f-96c0-c6e64d8399f8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:14.218913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0d66e-a6cd-47a3-9805-650052840a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:14.219571 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0d66e-a6cd-47a3-9805-650052840a02 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:14.219865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0d66e-a6cd-47a3-9805-650052840a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:14.220106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0d66e-a6cd-47a3-9805-650052840a02 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:14.220851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0d66e-a6cd-47a3-9805-650052840a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:14.221718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0d66e-a6cd-47a3-9805-650052840a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:14.223100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0d66e-a6cd-47a3-9805-650052840a02 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:14.240266 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd493dc-4fc3-40e1-9d0d-6b9b02a8481d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:14.240479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 227/466] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:14.240479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bad87d-cfe5-4844-aac4-89ac2cbb5b68 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:14.240479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bad87d-cfe5-4844-aac4-89ac2cbb5b68 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:14.240479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bad87d-cfe5-4844-aac4-89ac2cbb5b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:14.253978 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:14.258767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e8bad87d-cfe5-4844-aac4-89ac2cbb5b68 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:14.259965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e8bad87d-cfe5-4844-aac4-89ac2cbb5b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:14.278402 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fe0dc-7f40-4924-831b-26cef73af69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:14.279092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fe0dc-7f40-4924-831b-26cef73af69b None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:14.279368 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fe0dc-7f40-4924-831b-26cef73af69b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:14.279655 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fe0dc-7f40-4924-831b-26cef73af69b None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:14.280372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fe0dc-7f40-4924-831b-26cef73af69b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:14.281823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fe0dc-7f40-4924-831b-26cef73af69b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:14.309505 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 240/467] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:05:14 2022] POST /identity/v3/users => generated 246 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:05:14.312692 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fe0dc-7f40-4924-831b-26cef73af69b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:14.361822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 228/468] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:14.362790 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bad87d-cfe5-4844-aac4-89ac2cbb5b68 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:14.429553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:14.466708 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fe0dc-7f40-4924-831b-26cef73af69b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:14.529818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c445c74-dad7-4245-abf5-301a18991bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:14.530640 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c445c74-dad7-4245-abf5-301a18991bea None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:14.530919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c445c74-dad7-4245-abf5-301a18991bea None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:14.531194 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c445c74-dad7-4245-abf5-301a18991bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:14.544791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c445c74-dad7-4245-abf5-301a18991bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:14.545270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bad87d-cfe5-4844-aac4-89ac2cbb5b68 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:14.546841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c445c74-dad7-4245-abf5-301a18991bea None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:14.568780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6c445c74-dad7-4245-abf5-301a18991bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:14.568780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:14.568780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:14.568780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:14.568780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:14.568780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:14.568780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:14.568780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:14.568780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:14.568780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:14.568780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:14.568780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:14.568780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:14.568780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:14.568780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:14.569648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:14.570479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:14.570479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:14.570479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:14.570479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:14.572614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 241/469] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:14.573665 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c445c74-dad7-4245-abf5-301a18991bea None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:14.597233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662ebe3-0c23-4629-a033-dd57155e5a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:14.597933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662ebe3-0c23-4629-a033-dd57155e5a9d None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:14.598220 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662ebe3-0c23-4629-a033-dd57155e5a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:14.598490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662ebe3-0c23-4629-a033-dd57155e5a9d None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:14.600034 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662ebe3-0c23-4629-a033-dd57155e5a9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:14.602258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662ebe3-0c23-4629-a033-dd57155e5a9d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:14.617395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:14.636333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 229/470] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:05:14 2022] POST /identity/v3/users => generated 248 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:05:14.637801 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662ebe3-0c23-4629-a033-dd57155e5a9d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:14.775630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c445c74-dad7-4245-abf5-301a18991bea None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:14.788080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:14.806506 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662ebe3-0c23-4629-a033-dd57155e5a9d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:14.864096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aba70a-6021-4707-a1c1-90e465566337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:14.865493 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aba70a-6021-4707-a1c1-90e465566337 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:14.865985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aba70a-6021-4707-a1c1-90e465566337 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:14.866581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aba70a-6021-4707-a1c1-90e465566337 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:14.867641 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aba70a-6021-4707-a1c1-90e465566337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:14.868276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aba70a-6021-4707-a1c1-90e465566337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:14.869940 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aba70a-6021-4707-a1c1-90e465566337 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:14.875892 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702da76-dab4-4bb1-a614-bc185a6813fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:14.878345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702da76-dab4-4bb1-a614-bc185a6813fe None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:14.878345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702da76-dab4-4bb1-a614-bc185a6813fe None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:14.878558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702da76-dab4-4bb1-a614-bc185a6813fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:14.890840 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 230/471] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:14.892726 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4a461-ac79-48d4-be23-8ace27350493 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:14.893790 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4a461-ac79-48d4-be23-8ace27350493 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:14.894267 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4a461-ac79-48d4-be23-8ace27350493 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:14.896335 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 231/472] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:14.898249 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4a461-ac79-48d4-be23-8ace27350493 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:14.905382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702da76-dab4-4bb1-a614-bc185a6813fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:14.907000 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702da76-dab4-4bb1-a614-bc185a6813fe None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:14.931459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d702da76-dab4-4bb1-a614-bc185a6813fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:14.931459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:14.931459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:14.931459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:14.931459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:14.931459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:14.931459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:14.931459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:14.931459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:14.931459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:14.931459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:14.931459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:14.931459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:14.931459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:14.931459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:14.933196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:14.934929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:14.934929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:14.934929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:14.934929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:14.934929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 242/473] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:14.934929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d636b42-3dbe-4c86-8c8a-107d4cb93d6b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:14.934929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d636b42-3dbe-4c86-8c8a-107d4cb93d6b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:14.934929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d636b42-3dbe-4c86-8c8a-107d4cb93d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:14.960574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9d636b42-3dbe-4c86-8c8a-107d4cb93d6b None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:14.961801 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9d636b42-3dbe-4c86-8c8a-107d4cb93d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:15.054445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4a461-ac79-48d4-be23-8ace27350493 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:15.061764 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 243/474] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:15.063382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d636b42-3dbe-4c86-8c8a-107d4cb93d6b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:15.071565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:15.099632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b3a04-5f9d-473c-b4f3-6e11f6ba809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:15.100542 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b3a04-5f9d-473c-b4f3-6e11f6ba809a None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:15.100901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b3a04-5f9d-473c-b4f3-6e11f6ba809a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:15.101276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b3a04-5f9d-473c-b4f3-6e11f6ba809a None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:15.102087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b3a04-5f9d-473c-b4f3-6e11f6ba809a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:15.103663 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b3a04-5f9d-473c-b4f3-6e11f6ba809a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:15.136111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 232/475] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:05:14 2022] POST /identity/v3/users => generated 248 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:05:15.137581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b3a04-5f9d-473c-b4f3-6e11f6ba809a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:15.157496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:15.211510 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d636b42-3dbe-4c86-8c8a-107d4cb93d6b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:15.271303 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033851e-d78c-401e-ac98-97aec5cb9da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:15.272160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033851e-d78c-401e-ac98-97aec5cb9da5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:15.272466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033851e-d78c-401e-ac98-97aec5cb9da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:15.272740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033851e-d78c-401e-ac98-97aec5cb9da5 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:15.273474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033851e-d78c-401e-ac98-97aec5cb9da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:15.273784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033851e-d78c-401e-ac98-97aec5cb9da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:15.275367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033851e-d78c-401e-ac98-97aec5cb9da5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:15.281737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b3a04-5f9d-473c-b4f3-6e11f6ba809a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:15.298323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 244/476] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:15.304977 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033851e-d78c-401e-ac98-97aec5cb9da5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:15.322791 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d537f-bc10-44bb-b32b-9e457c1a872c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:15.323493 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d537f-bc10-44bb-b32b-9e457c1a872c None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:15.323777 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d537f-bc10-44bb-b32b-9e457c1a872c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:15.324055 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d537f-bc10-44bb-b32b-9e457c1a872c None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:15.325086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d537f-bc10-44bb-b32b-9e457c1a872c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:15.326683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d537f-bc10-44bb-b32b-9e457c1a872c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:15.335772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.sql.core [None req-f06d537f-bc10-44bb-b32b-9e457c1a872c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 16:05:15.335772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 16:05:15.335772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [parameters: {'id': '74ddd946c7b24bb3990e934e22f61278', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 16:05:15.335772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80366) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 16:05:15.355052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f06d537f-bc10-44bb-b32b-9e457c1a872c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 16:05:15.355052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:15.355052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 16:05:15.355052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 16:05:15.355052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 16:05:15.355052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 16:05:15.355052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 16:05:15.355052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 16:05:15.355052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 16:05:15.355052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application conn.query(q) Jul 25 16:05:15.355052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 16:05:15.355052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 16:05:15.355052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 16:05:15.355052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application result.read() Jul 25 16:05:15.355052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return ref.to_dict() Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 16:05:15.355960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application next(self.gen) Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application yield resource Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application next(self.gen) Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise self.value Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application session.commit() Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 16:05:15.356965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.session.flush() Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application compat.raise_( Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 16:05:15.357916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 16:05:15.358742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 16:05:15.358742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 16:05:15.358742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 16:05:15.358742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 16:05:15.358742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 16:05:15.358742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 16:05:15.358742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 16:05:15.358742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 16:05:15.358742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 16:05:15.358742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 16:05:15.358742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 16:05:15.358742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 16:05:15.358742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 16:05:15.358742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 16:05:15.358742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 16:05:15.358742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception Jul 25 16:05:15.359536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 16:05:15.359536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 16:05:15.359536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 16:05:15.359536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 16:05:15.359536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 16:05:15.359536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 16:05:15.359536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 16:05:15.359536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application conn.query(q) Jul 25 16:05:15.359536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 16:05:15.359536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 16:05:15.359536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 16:05:15.359536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application result.read() Jul 25 16:05:15.359536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 16:05:15.359536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 16:05:15.359536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 16:05:15.359536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 16:05:15.361381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 16:05:15.361381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 16:05:15.361381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 16:05:15.361381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 16:05:15.361381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 16:05:15.361381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 16:05:15.361381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [parameters: {'id': '74ddd946c7b24bb3990e934e22f61278', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 16:05:15.361381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 16:05:15.361381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:15.361381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:05:15.361381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:15.361381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:15.361381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:15.361381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:15.361381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:15.361381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:15.363836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:15.363836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:15.363836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:15.363836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:15.363836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:15.363836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:15.363836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 25 16:05:15.363836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 25 16:05:15.363836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:15.363836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:15.363836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 25 16:05:15.363836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 25 16:05:15.363836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 16:05:15.363836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 16:05:15.363836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 16:05:15.363836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:15.372815 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 233/477] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Jul 25 16:05:15 2022] POST /identity/v3/roles => generated 144 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:15.372815 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d537f-bc10-44bb-b32b-9e457c1a872c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:15.472005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:15.475225 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:15.505894 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d537f-bc10-44bb-b32b-9e457c1a872c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:15.543023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033851e-d78c-401e-ac98-97aec5cb9da5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:15.546195 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d81f8-295a-4ce3-b998-5aab4a4de6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:15.547049 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d81f8-295a-4ce3-b998-5aab4a4de6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:15.547321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d81f8-295a-4ce3-b998-5aab4a4de6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:15.547599 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d81f8-295a-4ce3-b998-5aab4a4de6a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:15.559879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d81f8-295a-4ce3-b998-5aab4a4de6a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:15.568892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-116d81f8-295a-4ce3-b998-5aab4a4de6a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:05:15.568892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:15.568892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:15.568892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:15.568892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:15.568892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:15.568892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:15.568892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:15.568892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:15.568892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:15.568892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:15.568892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:15.568892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:15.568892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:15.568892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:15.568892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:15.569998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:15.569998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:15.569998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:15.569998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:15.569998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:15.569998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:15.569998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:15.569998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:15.569998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:15.569998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:15.569998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:15.569998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:15.569998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:15.569998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:15.569998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:15.569998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:15.571012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:15.571012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:15.571012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:15.571012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:15.571012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:15.571012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:15.571012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:15.571012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:15.571012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:15.571012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:15.571012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 16:05:15.571012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:15.571012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 234/478] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:05:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:15.577317 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d81f8-295a-4ce3-b998-5aab4a4de6a3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:15.607712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ff066-9c83-4928-b328-3c489fc665aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:15.608860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ff066-9c83-4928-b328-3c489fc665aa None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:15.609447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ff066-9c83-4928-b328-3c489fc665aa None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:15.609961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ff066-9c83-4928-b328-3c489fc665aa None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:15.612287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ff066-9c83-4928-b328-3c489fc665aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:15.615139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ff066-9c83-4928-b328-3c489fc665aa None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:15.660284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 245/479] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:05:15 2022] POST /identity/v3/users => generated 249 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:05:15.708640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d81f8-295a-4ce3-b998-5aab4a4de6a3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:15.751698 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad0763-dc23-4b7f-9f60-b61542dfe8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:15.752465 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad0763-dc23-4b7f-9f60-b61542dfe8dd None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:15.752763 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad0763-dc23-4b7f-9f60-b61542dfe8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:15.753044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad0763-dc23-4b7f-9f60-b61542dfe8dd None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:15.753880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad0763-dc23-4b7f-9f60-b61542dfe8dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:15.754191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad0763-dc23-4b7f-9f60-b61542dfe8dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:15.755660 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad0763-dc23-4b7f-9f60-b61542dfe8dd None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:15.758494 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:15.767480 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 235/480] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:16.867601 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba365253-046a-4cb3-84c9-694fb0e535f7 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:16.868664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba365253-046a-4cb3-84c9-694fb0e535f7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:16.869157 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba365253-046a-4cb3-84c9-694fb0e535f7 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:16.870798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 246/481] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:16.877572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da7322-5f21-490c-bc38-c722bd0e6b34 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:16.878406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da7322-5f21-490c-bc38-c722bd0e6b34 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:16.878849 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da7322-5f21-490c-bc38-c722bd0e6b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:16.910124 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-18da7322-5f21-490c-bc38-c722bd0e6b34 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:16.911659 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-18da7322-5f21-490c-bc38-c722bd0e6b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:17.001633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 236/482] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:17.048048 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba365253-046a-4cb3-84c9-694fb0e535f7 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:17.167973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba365253-046a-4cb3-84c9-694fb0e535f7 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:17.191849 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:17.213085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd1b40-58b9-43a7-b197-a6989475fefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:17.214174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd1b40-58b9-43a7-b197-a6989475fefb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:17.214608 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd1b40-58b9-43a7-b197-a6989475fefb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:17.215022 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd1b40-58b9-43a7-b197-a6989475fefb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:17.232278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd1b40-58b9-43a7-b197-a6989475fefb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:17.240525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-65bd1b40-58b9-43a7-b197-a6989475fefb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:17.240525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:17.240525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:17.240525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:17.240525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:17.240525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:17.240525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:17.240525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:17.240525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:17.240525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:17.240525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:17.240525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:17.240525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:17.240525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:17.240525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:17.240525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:17.242372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:17.242372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:17.242372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:17.242372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:17.242372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:17.242372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:17.242372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:17.242372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:17.242372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:17.242372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:17.242372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:17.242372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:17.242372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:17.242372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:17.242372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:17.242372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:17.243983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:17.243983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:17.243983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:17.243983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:17.243983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:17.243983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:17.243983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:17.243983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:17.243983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:17.243983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:17.243983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:17.243983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:17.247435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 247/483] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:17.257447 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da7322-5f21-490c-bc38-c722bd0e6b34 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:17.274275 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfdc09-4ba3-4a30-abfc-8baaebce8f35 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:17.274558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfdc09-4ba3-4a30-abfc-8baaebce8f35 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:17.274880 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfdc09-4ba3-4a30-abfc-8baaebce8f35 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:17.276507 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 248/484] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:05:17.286025 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc077665-b40f-4987-a690-c9326e4b9b19 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:17.286271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc077665-b40f-4987-a690-c9326e4b9b19 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:17.286583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc077665-b40f-4987-a690-c9326e4b9b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:17.313228 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-cc077665-b40f-4987-a690-c9326e4b9b19 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:17.314436 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cc077665-b40f-4987-a690-c9326e4b9b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:17.388646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 249/485] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:05:17.437968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc077665-b40f-4987-a690-c9326e4b9b19 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:17.456650 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da7322-5f21-490c-bc38-c722bd0e6b34 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:17.502960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:17.528294 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9cea1-0a79-481c-9f07-90386862a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:17.529035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9cea1-0a79-481c-9f07-90386862a706 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:17.529318 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9cea1-0a79-481c-9f07-90386862a706 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:17.529598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9cea1-0a79-481c-9f07-90386862a706 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:17.530651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9cea1-0a79-481c-9f07-90386862a706 None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:17.530963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9cea1-0a79-481c-9f07-90386862a706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:17.535408 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9cea1-0a79-481c-9f07-90386862a706 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:17.550358 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 237/486] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:17.559019 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9cea1-0a79-481c-9f07-90386862a706 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:17.616950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc077665-b40f-4987-a690-c9326e4b9b19 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:17.638355 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:17.689467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d839b-352e-4dc4-90ec-9a3ce685e6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:17.690727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d839b-352e-4dc4-90ec-9a3ce685e6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:17.691011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d839b-352e-4dc4-90ec-9a3ce685e6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:17.691287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d839b-352e-4dc4-90ec-9a3ce685e6d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:17.706259 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d839b-352e-4dc4-90ec-9a3ce685e6d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:17.714554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a42d839b-352e-4dc4-90ec-9a3ce685e6d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:17.714554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:17.714554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:17.714554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:17.714554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:17.714554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:17.714554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:17.714554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:17.714554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:17.714554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:17.714554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:17.714554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:17.714554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:17.714554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:17.714554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:17.714554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:17.715484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:17.715484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:17.715484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:17.715484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:17.715484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:17.715484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:17.715484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:17.715484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:17.715484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:17.715484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:17.715484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:17.715484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:17.715484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:17.715484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:17.715484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:17.715484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:17.716243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:17.716243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:17.716243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:17.716243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:17.716243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:17.716243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:17.716243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:17.716243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:17.716243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:17.716243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:17.716243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:17.716243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:17.720719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 250/487] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:05:17.728274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d839b-352e-4dc4-90ec-9a3ce685e6d9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:17.772274 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9cea1-0a79-481c-9f07-90386862a706 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:17.853412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec6e15-b2ca-4396-afb2-7deffd38bef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:17.854225 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec6e15-b2ca-4396-afb2-7deffd38bef7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:17.854508 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec6e15-b2ca-4396-afb2-7deffd38bef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:17.854785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec6e15-b2ca-4396-afb2-7deffd38bef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:17.878362 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec6e15-b2ca-4396-afb2-7deffd38bef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:17.880028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec6e15-b2ca-4396-afb2-7deffd38bef7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:17.900963 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d839b-352e-4dc4-90ec-9a3ce685e6d9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:17.919569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-6bec6e15-b2ca-4396-afb2-7deffd38bef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:17.919569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:17.919569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:17.919569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:17.919569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:17.919569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:17.919569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:17.919569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:17.919569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:17.919569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:17.919569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:17.919569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:17.919569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:17.919569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:17.919569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:17.920566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:17.921530 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:17.921530 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:17.921530 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:17.921530 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:17.921530 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 238/488] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:17.929500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec6e15-b2ca-4396-afb2-7deffd38bef7 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:17.972753 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ba06b-6eb4-4f4e-8c9e-977d33161d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:17.973420 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ba06b-6eb4-4f4e-8c9e-977d33161d77 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:17.973704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ba06b-6eb4-4f4e-8c9e-977d33161d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:17.973982 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ba06b-6eb4-4f4e-8c9e-977d33161d77 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:17.974746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ba06b-6eb4-4f4e-8c9e-977d33161d77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:17.975055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ba06b-6eb4-4f4e-8c9e-977d33161d77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:17.976536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ba06b-6eb4-4f4e-8c9e-977d33161d77 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:17.991666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:17.993160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 251/489] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:17.999118 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ba06b-6eb4-4f4e-8c9e-977d33161d77 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:18.045881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:18.063279 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec6e15-b2ca-4396-afb2-7deffd38bef7 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:18.127945 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ba06b-6eb4-4f4e-8c9e-977d33161d77 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:18.130022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc28466-7dad-4ac6-bb95-523802f55266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:18.130881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28466-7dad-4ac6-bb95-523802f55266 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:18.131312 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28466-7dad-4ac6-bb95-523802f55266 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:18.131733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28466-7dad-4ac6-bb95-523802f55266 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:18.132666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc28466-7dad-4ac6-bb95-523802f55266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:18.133124 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc28466-7dad-4ac6-bb95-523802f55266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:18.134679 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc28466-7dad-4ac6-bb95-523802f55266 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:18.161757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 239/490] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:18.162960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc28466-7dad-4ac6-bb95-523802f55266 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:18.174776 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6425e01-88bd-487e-a990-bff37bd20a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:18.175821 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6425e01-88bd-487e-a990-bff37bd20a1f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:18.175940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6425e01-88bd-487e-a990-bff37bd20a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:18.176213 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6425e01-88bd-487e-a990-bff37bd20a1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:18.195418 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6425e01-88bd-487e-a990-bff37bd20a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:18.196921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6425e01-88bd-487e-a990-bff37bd20a1f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:18.234077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d6425e01-88bd-487e-a990-bff37bd20a1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:18.234077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:18.234077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:18.234077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:18.234077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:18.234077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:18.234077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:18.234077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:18.234077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:18.234077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:18.234077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:18.234077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:18.234077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:18.234077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:18.234077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:18.235111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:18.236093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:18.236093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:18.236093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:18.236093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:18.239928 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 252/491] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:05:18.241992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6425e01-88bd-487e-a990-bff37bd20a1f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:18.287964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc28466-7dad-4ac6-bb95-523802f55266 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:18.290047 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:18.327421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83d51a-954a-40a7-9451-71f3464c2620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:18.328533 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83d51a-954a-40a7-9451-71f3464c2620 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:18.328978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83d51a-954a-40a7-9451-71f3464c2620 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:18.329395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83d51a-954a-40a7-9451-71f3464c2620 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:18.337969 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83d51a-954a-40a7-9451-71f3464c2620 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:18.339679 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83d51a-954a-40a7-9451-71f3464c2620 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:18.356669 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:18.362892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-de83d51a-954a-40a7-9451-71f3464c2620 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:05:18.362892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:18.362892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:18.362892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:18.362892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:18.362892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:18.362892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:18.362892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:18.362892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:18.362892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:18.362892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:18.362892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:18.362892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:18.362892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:18.362892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:18.362892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:18.364039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:18.365090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:18.365090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:18.365090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:18.365090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:18.365090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:18.365090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:18.365090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:18.365090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:18.365090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:05:18.365090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:18.367750 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 240/492] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 25 16:05:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:18.374146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d47bf-7c18-4cb0-95c0-33c0127561c0 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:18.374654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d47bf-7c18-4cb0-95c0-33c0127561c0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:18.374971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6425e01-88bd-487e-a990-bff37bd20a1f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:18.375272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d47bf-7c18-4cb0-95c0-33c0127561c0 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:18.377903 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 241/493] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:18.378901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d47bf-7c18-4cb0-95c0-33c0127561c0 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:18.438756 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8a9ca-be13-4f3c-902d-623dee73f58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:18.440896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8a9ca-be13-4f3c-902d-623dee73f58c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:18.441443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8a9ca-be13-4f3c-902d-623dee73f58c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:18.442466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8a9ca-be13-4f3c-902d-623dee73f58c None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:18.443865 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8a9ca-be13-4f3c-902d-623dee73f58c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:18.444673 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8a9ca-be13-4f3c-902d-623dee73f58c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:18.447648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8a9ca-be13-4f3c-902d-623dee73f58c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:18.477732 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 253/494] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:18.480504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357b8a-fb3f-4497-94db-b4774928ae27 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:18.480876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357b8a-fb3f-4497-94db-b4774928ae27 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:18.481268 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357b8a-fb3f-4497-94db-b4774928ae27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:18.515182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d47bf-7c18-4cb0-95c0-33c0127561c0 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:18.515522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4a357b8a-fb3f-4497-94db-b4774928ae27 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:18.517361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4a357b8a-fb3f-4497-94db-b4774928ae27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:18.579161 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8e209-17a9-4ebd-9ad5-5f01fe826a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:18.580044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8e209-17a9-4ebd-9ad5-5f01fe826a2f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:18.580195 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8e209-17a9-4ebd-9ad5-5f01fe826a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:18.580521 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8e209-17a9-4ebd-9ad5-5f01fe826a2f None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:18.581393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8e209-17a9-4ebd-9ad5-5f01fe826a2f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:18.581881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8e209-17a9-4ebd-9ad5-5f01fe826a2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:18.583468 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8e209-17a9-4ebd-9ad5-5f01fe826a2f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:18.616281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 254/495] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:18.616281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a357b8a-fb3f-4497-94db-b4774928ae27 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:18.628352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 242/496] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 25 16:05:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:18.629961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44967d-a2c2-49f4-9733-d443337880ed None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:18.630297 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44967d-a2c2-49f4-9733-d443337880ed None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:18.630636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44967d-a2c2-49f4-9733-d443337880ed None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:18.632371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 243/497] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:18.635872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44967d-a2c2-49f4-9733-d443337880ed None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:18.669094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:18.713186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:18.739409 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a357b8a-fb3f-4497-94db-b4774928ae27 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:18.754484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44967d-a2c2-49f4-9733-d443337880ed None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:18.772647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e13321-44f0-401c-82d3-084d70df13fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:18.773454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e13321-44f0-401c-82d3-084d70df13fa None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:18.773740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e13321-44f0-401c-82d3-084d70df13fa None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:18.774017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e13321-44f0-401c-82d3-084d70df13fa None admin] PATH_INFO: `/v3/users/glance` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:18.781603 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e13321-44f0-401c-82d3-084d70df13fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:18.783103 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e13321-44f0-401c-82d3-084d70df13fa None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:18.788933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9a07f-f84a-4671-994b-0eced7f69768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:18.789581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9a07f-f84a-4671-994b-0eced7f69768 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:18.789876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9a07f-f84a-4671-994b-0eced7f69768 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:18.790140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9a07f-f84a-4671-994b-0eced7f69768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:18.800477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c6e13321-44f0-401c-82d3-084d70df13fa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 16:05:18.800477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:18.800477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:18.800477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:18.800477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:18.800477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:18.800477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:18.800477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:18.800477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:18.800477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:18.800477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:18.800477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:18.800477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:18.800477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:18.800477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:18.800477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:18.801599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:18.802683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:18.802683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:18.802683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:18.802683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:18.802683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:18.802683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:18.802683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:18.802683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:18.802683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 16:05:18.802683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:18.802683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 255/498] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:18.803350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cc99a-148e-49ed-95a7-988dda3e4f18 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:18.803350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cc99a-148e-49ed-95a7-988dda3e4f18 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:18.803497 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cc99a-148e-49ed-95a7-988dda3e4f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:18.821144 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-cd6cc99a-148e-49ed-95a7-988dda3e4f18 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:18.822341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cd6cc99a-148e-49ed-95a7-988dda3e4f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:18.860424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9a07f-f84a-4671-994b-0eced7f69768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:18.862456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9a07f-f84a-4671-994b-0eced7f69768 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:18.882651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:18.893258 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 256/499] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:18.894127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cc99a-148e-49ed-95a7-988dda3e4f18 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:18.959174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:18.967184 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 244/500] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:18.968640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08540912-8f8a-4b3f-bf98-2e7d94c3faf5 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:18.968932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08540912-8f8a-4b3f-bf98-2e7d94c3faf5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:18.969210 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08540912-8f8a-4b3f-bf98-2e7d94c3faf5 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:18.972724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 245/501] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:18.972724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08540912-8f8a-4b3f-bf98-2e7d94c3faf5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:18.996718 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cc99a-148e-49ed-95a7-988dda3e4f18 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:19.032668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28353621-35e0-4288-9b1b-b9c9e6f89202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:19.034271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28353621-35e0-4288-9b1b-b9c9e6f89202 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:19.034748 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28353621-35e0-4288-9b1b-b9c9e6f89202 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:19.035191 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28353621-35e0-4288-9b1b-b9c9e6f89202 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:19.045828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28353621-35e0-4288-9b1b-b9c9e6f89202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:19.054546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-28353621-35e0-4288-9b1b-b9c9e6f89202 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:19.054546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:19.054546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:19.054546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:19.054546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:19.054546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:19.054546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:19.054546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:19.054546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:19.054546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:19.054546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:19.054546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:19.054546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:19.054546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:19.054546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:19.054546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:19.055468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:19.055468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:19.055468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:19.055468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:19.055468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:19.055468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:19.055468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:19.055468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:19.055468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:19.055468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:19.055468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:19.055468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:19.055468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:19.055468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:19.055468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:19.055468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:19.056241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:19.056241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:19.056241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:19.056241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:19.056241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:19.056241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:19.056241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:19.056241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:19.056241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:19.056241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:19.056241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:19.056241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:19.056241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 257/502] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:19.056914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28353621-35e0-4288-9b1b-b9c9e6f89202 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:19.080976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08540912-8f8a-4b3f-bf98-2e7d94c3faf5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:19.102753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:19.124800 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614e37c-0124-483f-8db2-ab204ffa2159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:19.125481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614e37c-0124-483f-8db2-ab204ffa2159 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:19.125765 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614e37c-0124-483f-8db2-ab204ffa2159 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:19.126036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614e37c-0124-483f-8db2-ab204ffa2159 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:19.126876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614e37c-0124-483f-8db2-ab204ffa2159 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:19.127233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614e37c-0124-483f-8db2-ab204ffa2159 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:19.128721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614e37c-0124-483f-8db2-ab204ffa2159 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:19.146279 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 246/503] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jul 25 16:05:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:19.147120 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614e37c-0124-483f-8db2-ab204ffa2159 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:19.161560 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28353621-35e0-4288-9b1b-b9c9e6f89202 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:19.184571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:19.195490 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550b26f-511b-4226-acce-bdb5c96de159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:19.196311 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550b26f-511b-4226-acce-bdb5c96de159 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:19.196597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550b26f-511b-4226-acce-bdb5c96de159 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:19.196872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550b26f-511b-4226-acce-bdb5c96de159 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:19.207577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550b26f-511b-4226-acce-bdb5c96de159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:19.209051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550b26f-511b-4226-acce-bdb5c96de159 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:19.226525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a550b26f-511b-4226-acce-bdb5c96de159 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:19.226525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:19.226525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:19.226525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:19.226525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:19.226525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:19.226525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:19.226525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:19.226525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:19.226525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:19.226525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:19.226525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:19.226525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:19.226525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:19.226525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:19.227577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:19.228426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:19.228426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:19.228426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:19.228426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:19.228426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 258/504] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:19.229378 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb5eb9-43bd-413e-af83-46eaaad80411 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:19.229660 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb5eb9-43bd-413e-af83-46eaaad80411 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:19.229937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb5eb9-43bd-413e-af83-46eaaad80411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:19.252679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1feb5eb9-43bd-413e-af83-46eaaad80411 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:19.253806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1feb5eb9-43bd-413e-af83-46eaaad80411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:19.266890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614e37c-0124-483f-8db2-ab204ffa2159 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:19.304898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6df0b9-8573-490a-9c45-f2024898291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:19.305693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6df0b9-8573-490a-9c45-f2024898291a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:19.305966 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6df0b9-8573-490a-9c45-f2024898291a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:19.306241 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6df0b9-8573-490a-9c45-f2024898291a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:19.316734 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6df0b9-8573-490a-9c45-f2024898291a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:19.318190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6df0b9-8573-490a-9c45-f2024898291a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:19.323270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 259/505] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:19.324117 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb5eb9-43bd-413e-af83-46eaaad80411 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:19.337890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-2f6df0b9-8573-490a-9c45-f2024898291a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:19.337890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:19.337890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:19.337890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:19.337890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:19.337890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:19.337890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:19.337890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:19.337890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:19.337890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:19.337890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:19.337890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:19.337890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:19.337890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:19.337890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:19.338770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:19.339620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:19.339620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:19.339620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:19.339620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:19.339620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 247/506] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:19.340534 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6df0b9-8573-490a-9c45-f2024898291a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:19.371068 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:19.433086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb5eb9-43bd-413e-af83-46eaaad80411 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:19.440566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:19.442613 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6df0b9-8573-490a-9c45-f2024898291a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:19.471864 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54034f7f-0007-42d4-aa93-eaf970458668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:19.472559 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54034f7f-0007-42d4-aa93-eaf970458668 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:19.472842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54034f7f-0007-42d4-aa93-eaf970458668 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:19.473119 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54034f7f-0007-42d4-aa93-eaf970458668 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:19.473861 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54034f7f-0007-42d4-aa93-eaf970458668 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:19.474163 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54034f7f-0007-42d4-aa93-eaf970458668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:19.475527 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54034f7f-0007-42d4-aa93-eaf970458668 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:19.483680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 260/507] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:19.484532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54034f7f-0007-42d4-aa93-eaf970458668 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:19.489039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cb0c2-3801-4845-9af2-a212bef53aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:19.489212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cb0c2-3801-4845-9af2-a212bef53aba None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:19.489417 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cb0c2-3801-4845-9af2-a212bef53aba None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:19.489691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cb0c2-3801-4845-9af2-a212bef53aba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:19.559066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cb0c2-3801-4845-9af2-a212bef53aba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:19.560572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cb0c2-3801-4845-9af2-a212bef53aba None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:19.592083 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:19.593648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54034f7f-0007-42d4-aa93-eaf970458668 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:19.631838 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b950c0-cbdd-4cdd-9809-7d2a88864746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:19.632537 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b950c0-cbdd-4cdd-9809-7d2a88864746 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:19.632823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b950c0-cbdd-4cdd-9809-7d2a88864746 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:19.633123 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b950c0-cbdd-4cdd-9809-7d2a88864746 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:19.633895 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b950c0-cbdd-4cdd-9809-7d2a88864746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:19.634228 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b950c0-cbdd-4cdd-9809-7d2a88864746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:19.635664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b950c0-cbdd-4cdd-9809-7d2a88864746 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:19.648684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 261/508] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:19.649588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b950c0-cbdd-4cdd-9809-7d2a88864746 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:19.668590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 248/509] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:19.669464 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cb0c2-3801-4845-9af2-a212bef53aba None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:19.680856 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:19.754379 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b950c0-cbdd-4cdd-9809-7d2a88864746 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:19.774651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cb0c2-3801-4845-9af2-a212bef53aba None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:19.792808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a1931-9701-4762-8bab-662234385e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:19.793490 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a1931-9701-4762-8bab-662234385e08 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:19.793775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a1931-9701-4762-8bab-662234385e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:19.794054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a1931-9701-4762-8bab-662234385e08 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:19.794784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a1931-9701-4762-8bab-662234385e08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:19.795089 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a1931-9701-4762-8bab-662234385e08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:19.796512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a1931-9701-4762-8bab-662234385e08 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:19.805560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:19.809799 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 262/510] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:19.810594 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a1931-9701-4762-8bab-662234385e08 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:19.816780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dde0f5-aa76-45b8-9412-d3c7a526db43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:19.817606 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dde0f5-aa76-45b8-9412-d3c7a526db43 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:19.817888 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dde0f5-aa76-45b8-9412-d3c7a526db43 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:19.818163 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dde0f5-aa76-45b8-9412-d3c7a526db43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:19.831170 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dde0f5-aa76-45b8-9412-d3c7a526db43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:19.839086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-31dde0f5-aa76-45b8-9412-d3c7a526db43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:19.839086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:19.839086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:19.839086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:19.839086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:19.839086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:19.839086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:19.839086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:19.839086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:19.839086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:19.839086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:19.839086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:19.839086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:19.839086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:19.839086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:19.839086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:19.840230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:19.840230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:19.840230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:19.840230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:19.840230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:19.840230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:19.840230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:19.840230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:19.840230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:19.840230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:19.840230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:19.840230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:19.840230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:19.840230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:19.840230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:19.840230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:19.841343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:19.841343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:19.841343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:19.841343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:19.841343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:19.841343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:19.841343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:19.841343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:19.841343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:19.841343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:19.841343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:19.841343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:19.841343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 249/511] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:19.841343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dde0f5-aa76-45b8-9412-d3c7a526db43 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:19.909697 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:19.922888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a1931-9701-4762-8bab-662234385e08 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:19.959116 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd1a9d-fe6a-44b6-b6e5-7220b587955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:19.959925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd1a9d-fe6a-44b6-b6e5-7220b587955b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:19.960495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd1a9d-fe6a-44b6-b6e5-7220b587955b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:19.960495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd1a9d-fe6a-44b6-b6e5-7220b587955b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:19.972501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd1a9d-fe6a-44b6-b6e5-7220b587955b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:19.973966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd1a9d-fe6a-44b6-b6e5-7220b587955b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:19.976566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dde0f5-aa76-45b8-9412-d3c7a526db43 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:19.991795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-17cd1a9d-fe6a-44b6-b6e5-7220b587955b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:19.991795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:19.991795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:19.991795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:19.991795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:19.991795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:19.991795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:19.991795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:19.991795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:19.991795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:19.991795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:19.991795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:19.991795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:19.991795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:19.991795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:19.992696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:19.993552 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:19.993552 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:19.993552 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:19.993552 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:19.993552 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 263/512] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:19.993816 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd1a9d-fe6a-44b6-b6e5-7220b587955b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:20.024718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc09096-a6c8-41d3-b36c-a08bb6824832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:20.025409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc09096-a6c8-41d3-b36c-a08bb6824832 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:20.025696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc09096-a6c8-41d3-b36c-a08bb6824832 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:20.025975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc09096-a6c8-41d3-b36c-a08bb6824832 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:20.026941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc09096-a6c8-41d3-b36c-a08bb6824832 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:20.028456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc09096-a6c8-41d3-b36c-a08bb6824832 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:20.051018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 250/513] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:05:19 2022] POST /identity/v3/users => generated 247 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:05:20.052089 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc09096-a6c8-41d3-b36c-a08bb6824832 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:20.121326 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd1a9d-fe6a-44b6-b6e5-7220b587955b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:20.130969 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:20.174852 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8fd1b-0c75-4b20-9118-cfccb30dd74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:20.175683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8fd1b-0c75-4b20-9118-cfccb30dd74b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:20.175964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8fd1b-0c75-4b20-9118-cfccb30dd74b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:20.176238 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8fd1b-0c75-4b20-9118-cfccb30dd74b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:20.190947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:20.193670 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8fd1b-0c75-4b20-9118-cfccb30dd74b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:20.196145 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8fd1b-0c75-4b20-9118-cfccb30dd74b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:20.204465 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc09096-a6c8-41d3-b36c-a08bb6824832 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:20.219807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-9ff8fd1b-0c75-4b20-9118-cfccb30dd74b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:20.219807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:20.219807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:20.219807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:20.219807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:20.219807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:20.219807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:20.219807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:20.219807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:20.219807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:20.219807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:20.219807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:20.219807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:20.219807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:20.219807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:20.220804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:20.222155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:20.222155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:20.222155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:20.222155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:20.222155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 264/514] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:20.227176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8fd1b-0c75-4b20-9118-cfccb30dd74b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:20.246333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55df77-52a5-4d5c-8894-6441bdc72d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:20.247150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55df77-52a5-4d5c-8894-6441bdc72d9a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:20.247427 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55df77-52a5-4d5c-8894-6441bdc72d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:20.247703 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55df77-52a5-4d5c-8894-6441bdc72d9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:20.255758 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55df77-52a5-4d5c-8894-6441bdc72d9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:20.257318 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55df77-52a5-4d5c-8894-6441bdc72d9a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:20.274925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-7d55df77-52a5-4d5c-8894-6441bdc72d9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:20.274925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:20.274925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:20.274925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:20.274925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:20.274925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:20.274925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:20.274925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:20.274925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:20.274925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:20.274925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:20.274925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:20.274925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:20.274925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:20.274925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:20.275804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:20.277359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:20.277359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:20.277359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:20.277359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:20.277359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:20.277359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:20.277359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:20.277359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:20.277359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 251/515] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:20.277914 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55df77-52a5-4d5c-8894-6441bdc72d9a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:20.362342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8fd1b-0c75-4b20-9118-cfccb30dd74b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:20.397879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55df77-52a5-4d5c-8894-6441bdc72d9a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:20.404150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4c21e-e86e-460d-98bd-df9c75b9fa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:20.404861 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4c21e-e86e-460d-98bd-df9c75b9fa8f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:20.405160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4c21e-e86e-460d-98bd-df9c75b9fa8f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:20.405406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4c21e-e86e-460d-98bd-df9c75b9fa8f None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:20.405999 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:20.406834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4c21e-e86e-460d-98bd-df9c75b9fa8f None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:20.406943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4c21e-e86e-460d-98bd-df9c75b9fa8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:20.408898 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4c21e-e86e-460d-98bd-df9c75b9fa8f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:20.421995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 265/516] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:20.427935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4c21e-e86e-460d-98bd-df9c75b9fa8f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:20.438596 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8acc2-e34f-4f94-ab36-27a9a989136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:20.439274 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8acc2-e34f-4f94-ab36-27a9a989136f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:20.440444 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8acc2-e34f-4f94-ab36-27a9a989136f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:20.440573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8acc2-e34f-4f94-ab36-27a9a989136f None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:20.441287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8acc2-e34f-4f94-ab36-27a9a989136f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:20.441720 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8acc2-e34f-4f94-ab36-27a9a989136f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:20.443191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8acc2-e34f-4f94-ab36-27a9a989136f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:20.461260 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 252/517] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:20.461260 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8acc2-e34f-4f94-ab36-27a9a989136f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:20.495764 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:20.544988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4c21e-e86e-460d-98bd-df9c75b9fa8f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:20.570959 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8acc2-e34f-4f94-ab36-27a9a989136f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:20.583968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d950e3a-6851-4b59-b397-3a1d61b2ac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:20.584802 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d950e3a-6851-4b59-b397-3a1d61b2ac55 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:20.585088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d950e3a-6851-4b59-b397-3a1d61b2ac55 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:20.585365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d950e3a-6851-4b59-b397-3a1d61b2ac55 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:20.586107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d950e3a-6851-4b59-b397-3a1d61b2ac55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:20.586415 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d950e3a-6851-4b59-b397-3a1d61b2ac55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:20.587919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d950e3a-6851-4b59-b397-3a1d61b2ac55 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:20.603716 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 266/518] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:20.604544 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d950e3a-6851-4b59-b397-3a1d61b2ac55 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:20.618427 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b68d9-d11d-4293-9546-7fb16e0caab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:20.619094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b68d9-d11d-4293-9546-7fb16e0caab9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:20.619423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b68d9-d11d-4293-9546-7fb16e0caab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:20.619647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b68d9-d11d-4293-9546-7fb16e0caab9 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:20.620471 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b68d9-d11d-4293-9546-7fb16e0caab9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:20.620805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b68d9-d11d-4293-9546-7fb16e0caab9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:20.622248 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b68d9-d11d-4293-9546-7fb16e0caab9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:20.641769 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 253/519] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:20.642966 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b68d9-d11d-4293-9546-7fb16e0caab9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:20.678357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:20.722629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d950e3a-6851-4b59-b397-3a1d61b2ac55 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:20.738207 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:20.762308 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9dc20d-05bd-4513-a1ec-3454353c204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:20.763148 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dc20d-05bd-4513-a1ec-3454353c204e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:20.763473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dc20d-05bd-4513-a1ec-3454353c204e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:20.763689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dc20d-05bd-4513-a1ec-3454353c204e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:20.769133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b68d9-d11d-4293-9546-7fb16e0caab9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:20.775084 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9dc20d-05bd-4513-a1ec-3454353c204e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:20.776819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9dc20d-05bd-4513-a1ec-3454353c204e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:20.798686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-bd9dc20d-05bd-4513-a1ec-3454353c204e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:20.798686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:20.798686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:20.798686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:20.798686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:20.798686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:20.798686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:20.798686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:20.798686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:20.798686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:20.798686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:20.798686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:20.798686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:20.798686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:20.798686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:20.800231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:20.801078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:20.801078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:20.801078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:20.801078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:20.801078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 267/520] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:20.801982 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9dc20d-05bd-4513-a1ec-3454353c204e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:20.813752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc95125-5ea7-4dc1-983b-21d36b4bdeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:20.814507 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc95125-5ea7-4dc1-983b-21d36b4bdeed None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:20.814862 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc95125-5ea7-4dc1-983b-21d36b4bdeed None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:20.815204 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc95125-5ea7-4dc1-983b-21d36b4bdeed None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:20.825082 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc95125-5ea7-4dc1-983b-21d36b4bdeed None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:20.826600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc95125-5ea7-4dc1-983b-21d36b4bdeed None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:20.849697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-edc95125-5ea7-4dc1-983b-21d36b4bdeed None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 16:05:20.849697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:20.849697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:20.849697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:20.849697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:20.849697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:20.849697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:20.849697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:20.849697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:20.849697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:20.849697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:20.849697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:20.849697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:20.849697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:20.849697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:20.849697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:20.850735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:20.851778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:20.851778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:20.851778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:20.851778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:20.851778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:20.851778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:20.851778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:20.851778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:20.851778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 16:05:20.851778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:20.851778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 254/521] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:20.852398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc95125-5ea7-4dc1-983b-21d36b4bdeed None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:20.942658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9dc20d-05bd-4513-a1ec-3454353c204e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:20.982473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff5221-fdf0-4069-beb2-319ede9cb904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:20.983461 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff5221-fdf0-4069-beb2-319ede9cb904 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:20.983622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff5221-fdf0-4069-beb2-319ede9cb904 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:20.983829 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff5221-fdf0-4069-beb2-319ede9cb904 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:20.992623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff5221-fdf0-4069-beb2-319ede9cb904 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:20.994217 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff5221-fdf0-4069-beb2-319ede9cb904 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:20.997185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:21.011037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b6ff5221-fdf0-4069-beb2-319ede9cb904 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:21.011037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:21.011037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:21.011037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:21.011037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:21.011037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:21.011037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:21.011037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:21.011037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:21.011037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:21.011037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:21.011037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:21.011037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:21.011037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:21.011037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:21.012668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:21.014440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:21.014440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:21.014440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:21.014440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:21.014440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:21.014440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:21.014440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:21.014440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:21.014440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 268/522] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:21.014440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff5221-fdf0-4069-beb2-319ede9cb904 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:21.026193 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc95125-5ea7-4dc1-983b-21d36b4bdeed None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:21.056093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:21.074514 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab322ca-9ed8-43d1-a47a-d2f039c2cd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:21.075524 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab322ca-9ed8-43d1-a47a-d2f039c2cd9c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:21.076073 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab322ca-9ed8-43d1-a47a-d2f039c2cd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:21.076741 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab322ca-9ed8-43d1-a47a-d2f039c2cd9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:21.078391 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab322ca-9ed8-43d1-a47a-d2f039c2cd9c None admin] RBAC: Adding query filter params (role.id=276de082c6c04d08a38361e8fea28a9a, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=c455f8d340444b068249213ff504895e) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:21.079095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab322ca-9ed8-43d1-a47a-d2f039c2cd9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:21.082102 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab322ca-9ed8-43d1-a47a-d2f039c2cd9c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:21.089585 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 255/523] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:05:20 2022] GET /identity/v3/role_assignments?user.id=c455f8d340444b068249213ff504895e&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=276de082c6c04d08a38361e8fea28a9a => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:21.100539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab322ca-9ed8-43d1-a47a-d2f039c2cd9c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:21.204283 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff5221-fdf0-4069-beb2-319ede9cb904 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:21.230567 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab322ca-9ed8-43d1-a47a-d2f039c2cd9c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:21.274430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591c59d-9d90-4488-b6ee-209c14a8d4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:21.275542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591c59d-9d90-4488-b6ee-209c14a8d4fc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:21.275891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591c59d-9d90-4488-b6ee-209c14a8d4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:21.276282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591c59d-9d90-4488-b6ee-209c14a8d4fc None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:21.278269 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591c59d-9d90-4488-b6ee-209c14a8d4fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:21.278595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591c59d-9d90-4488-b6ee-209c14a8d4fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:21.280667 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591c59d-9d90-4488-b6ee-209c14a8d4fc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:21.284744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fb9bf-2dd2-4293-825e-7eb338c69b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:21.285607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fb9bf-2dd2-4293-825e-7eb338c69b97 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:21.286002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fb9bf-2dd2-4293-825e-7eb338c69b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:21.286379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fb9bf-2dd2-4293-825e-7eb338c69b97 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:21.287354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fb9bf-2dd2-4293-825e-7eb338c69b97 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:21.287767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fb9bf-2dd2-4293-825e-7eb338c69b97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:21.289458 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fb9bf-2dd2-4293-825e-7eb338c69b97 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:21.296701 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 269/524] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:21.297815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591c59d-9d90-4488-b6ee-209c14a8d4fc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:21.318495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 256/525] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jul 25 16:05:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:21.320835 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fb9bf-2dd2-4293-825e-7eb338c69b97 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:21.337065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:21.413034 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:21.434002 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591c59d-9d90-4488-b6ee-209c14a8d4fc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:21.435475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fb9bf-2dd2-4293-825e-7eb338c69b97 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:21.473693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85066a56-86ef-4619-b12c-fa225c0982dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:21.474766 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85066a56-86ef-4619-b12c-fa225c0982dc None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:21.475179 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85066a56-86ef-4619-b12c-fa225c0982dc None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:21.475585 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85066a56-86ef-4619-b12c-fa225c0982dc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:21.477217 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778355ac-96e8-4bee-b59b-a4c36cd057b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:21.478155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778355ac-96e8-4bee-b59b-a4c36cd057b9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:21.478536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778355ac-96e8-4bee-b59b-a4c36cd057b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:21.478908 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778355ac-96e8-4bee-b59b-a4c36cd057b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:21.480366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778355ac-96e8-4bee-b59b-a4c36cd057b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:21.480801 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778355ac-96e8-4bee-b59b-a4c36cd057b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:21.482446 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778355ac-96e8-4bee-b59b-a4c36cd057b9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:21.485930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85066a56-86ef-4619-b12c-fa225c0982dc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:21.487994 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85066a56-86ef-4619-b12c-fa225c0982dc None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:21.503992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 270/526] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:21.512299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778355ac-96e8-4bee-b59b-a4c36cd057b9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:21.514111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-85066a56-86ef-4619-b12c-fa225c0982dc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 16:05:21.514111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:21.514111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:21.514111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:21.514111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:21.514111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:21.514111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:21.514111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:21.514111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:21.514111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:21.514111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:21.514111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:21.514111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:21.514111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:21.514111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:21.514111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:21.515932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:21.517364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:21.517364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:21.517364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:21.517364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:21.517364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:21.517364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:21.517364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:21.517364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:21.517364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 16:05:21.517364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:21.517364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 257/527] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:21.517364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85066a56-86ef-4619-b12c-fa225c0982dc None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:21.612456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:21.658100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778355ac-96e8-4bee-b59b-a4c36cd057b9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:21.678509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85066a56-86ef-4619-b12c-fa225c0982dc None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:21.718355 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed25f26-b668-430d-b90d-9a325ac4529d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:21.719518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed25f26-b668-430d-b90d-9a325ac4529d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:21.720068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed25f26-b668-430d-b90d-9a325ac4529d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:21.720849 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed25f26-b668-430d-b90d-9a325ac4529d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:21.723317 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3d37f-f255-41e7-948e-9b3f84fe5524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:21.724244 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3d37f-f255-41e7-948e-9b3f84fe5524 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:21.724706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3d37f-f255-41e7-948e-9b3f84fe5524 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:21.725148 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3d37f-f255-41e7-948e-9b3f84fe5524 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:21.726138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3d37f-f255-41e7-948e-9b3f84fe5524 None admin] RBAC: Adding query filter params (role.id=276de082c6c04d08a38361e8fea28a9a, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=623c97746d304c6ba971e79e4dbeb730) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:21.726603 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3d37f-f255-41e7-948e-9b3f84fe5524 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:21.728396 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3d37f-f255-41e7-948e-9b3f84fe5524 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:21.740715 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 258/528] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:05:21 2022] GET /identity/v3/role_assignments?user.id=623c97746d304c6ba971e79e4dbeb730&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=276de082c6c04d08a38361e8fea28a9a => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:21.742006 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3d37f-f255-41e7-948e-9b3f84fe5524 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:21.767084 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:21.887299 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3d37f-f255-41e7-948e-9b3f84fe5524 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:21.926530 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:21.929404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed25f26-b668-430d-b90d-9a325ac4529d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:21.931161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed25f26-b668-430d-b90d-9a325ac4529d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:21.933897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65317728-03e8-4fb5-be60-1ce929804c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:21.935090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65317728-03e8-4fb5-be60-1ce929804c6b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:21.935596 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65317728-03e8-4fb5-be60-1ce929804c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:21.936079 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65317728-03e8-4fb5-be60-1ce929804c6b None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:21.937240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65317728-03e8-4fb5-be60-1ce929804c6b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:21.937817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65317728-03e8-4fb5-be60-1ce929804c6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:21.939640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65317728-03e8-4fb5-be60-1ce929804c6b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:21.960238 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 259/529] 10.222.0.70 () {56 vars in 1139 bytes} [Mon Jul 25 16:05:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:21.966339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65317728-03e8-4fb5-be60-1ce929804c6b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:22.142231 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65317728-03e8-4fb5-be60-1ce929804c6b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:22.200526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 271/530] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:22.211106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed25f26-b668-430d-b90d-9a325ac4529d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:22.249801 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c17c1-5018-4fb8-88f4-880c209a3a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:22.250593 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c17c1-5018-4fb8-88f4-880c209a3a8b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:22.250885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c17c1-5018-4fb8-88f4-880c209a3a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:22.251161 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c17c1-5018-4fb8-88f4-880c209a3a8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:22.301881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:22.375239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:22.386029 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed25f26-b668-430d-b90d-9a325ac4529d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:22.395489 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c17c1-5018-4fb8-88f4-880c209a3a8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:22.397159 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c17c1-5018-4fb8-88f4-880c209a3a8b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:22.430695 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a2a49-c47f-4303-b611-8f0ec8946148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:22.431853 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a2a49-c47f-4303-b611-8f0ec8946148 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:22.432695 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a2a49-c47f-4303-b611-8f0ec8946148 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:22.433175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a2a49-c47f-4303-b611-8f0ec8946148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:22.450270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a2a49-c47f-4303-b611-8f0ec8946148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:22.452435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a2a49-c47f-4303-b611-8f0ec8946148 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:22.491332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-589a2a49-c47f-4303-b611-8f0ec8946148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:22.491332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:22.491332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:22.491332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:22.491332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:22.491332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:22.491332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:22.491332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:22.491332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:22.491332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:22.491332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:22.491332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:22.491332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:22.491332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:22.491332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:22.493447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:22.495361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:22.495361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:22.495361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:22.495361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:22.500280 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 272/531] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:22.504553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343441b7-e1f0-4054-ab66-42ca854ebc22 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:22.505154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343441b7-e1f0-4054-ab66-42ca854ebc22 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:22.505854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343441b7-e1f0-4054-ab66-42ca854ebc22 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:22.510522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 273/532] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:22.512419 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343441b7-e1f0-4054-ab66-42ca854ebc22 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:22.562573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 260/533] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:22.564664 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b74fd0-9ac4-4878-af6f-e3ba222d1457 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:22.564664 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b74fd0-9ac4-4878-af6f-e3ba222d1457 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:22.565060 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b74fd0-9ac4-4878-af6f-e3ba222d1457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:22.585220 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-53b74fd0-9ac4-4878-af6f-e3ba222d1457 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:22.586554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-53b74fd0-9ac4-4878-af6f-e3ba222d1457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:22.696453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 261/534] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:22.697582 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b74fd0-9ac4-4878-af6f-e3ba222d1457 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:22.699279 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:22.709532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343441b7-e1f0-4054-ab66-42ca854ebc22 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:22.727638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:22.764610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2298436-4eef-43ae-8ac5-1354ecc5d1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:22.765461 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2298436-4eef-43ae-8ac5-1354ecc5d1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:22.765848 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2298436-4eef-43ae-8ac5-1354ecc5d1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:22.766235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2298436-4eef-43ae-8ac5-1354ecc5d1b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:22.767084 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2298436-4eef-43ae-8ac5-1354ecc5d1b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:22.767624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2298436-4eef-43ae-8ac5-1354ecc5d1b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:22.769325 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2298436-4eef-43ae-8ac5-1354ecc5d1b2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:22.783899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 274/535] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:22.785082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2298436-4eef-43ae-8ac5-1354ecc5d1b2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:22.825937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b74fd0-9ac4-4878-af6f-e3ba222d1457 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:22.865160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afa52d-4042-45c4-92a1-afd3387ebcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:22.866244 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afa52d-4042-45c4-92a1-afd3387ebcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:22.866711 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afa52d-4042-45c4-92a1-afd3387ebcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:22.867136 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afa52d-4042-45c4-92a1-afd3387ebcb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:22.879362 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afa52d-4042-45c4-92a1-afd3387ebcb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:22.881420 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afa52d-4042-45c4-92a1-afd3387ebcb6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:22.897138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2298436-4eef-43ae-8ac5-1354ecc5d1b2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:22.901369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-96afa52d-4042-45c4-92a1-afd3387ebcb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:22.901369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:22.901369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:22.901369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:22.901369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:22.901369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:22.901369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:22.901369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:22.901369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:22.901369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:22.901369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:22.901369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:22.901369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:22.901369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:22.901369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:22.902630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:22.903490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:22.903490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:22.903490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:22.903490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:22.905785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 262/536] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:22.906869 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afa52d-4042-45c4-92a1-afd3387ebcb6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:22.947057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb2560-2527-41b1-b366-1e7674b8856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:22.947894 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb2560-2527-41b1-b366-1e7674b8856a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:22.948174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb2560-2527-41b1-b366-1e7674b8856a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:22.948479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb2560-2527-41b1-b366-1e7674b8856a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:22.964372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb2560-2527-41b1-b366-1e7674b8856a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:22.975740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-8cfb2560-2527-41b1-b366-1e7674b8856a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:22.975740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:22.975740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:22.975740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:22.975740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:22.975740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:22.975740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:22.975740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:22.975740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:22.975740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:22.975740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:22.975740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:22.975740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:22.975740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:22.975740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:22.975740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:22.976962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:22.976962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:22.976962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:22.976962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:22.976962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:22.976962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:22.976962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:22.976962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:22.976962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:22.976962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:22.976962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:22.976962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:22.976962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:22.976962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:22.976962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:22.976962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:22.977823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:22.977823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:22.977823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:22.977823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:22.977823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:22.977823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:22.977823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:22.977823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:22.977823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:22.977823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:22.977823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:22.977823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:22.977823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 275/537] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:22.978490 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb2560-2527-41b1-b366-1e7674b8856a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:23.001094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:23.014436 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:23.057891 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afa52d-4042-45c4-92a1-afd3387ebcb6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:23.111960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65436d-c056-4150-9ed2-17e866c6e931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:23.114226 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65436d-c056-4150-9ed2-17e866c6e931 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:23.114887 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65436d-c056-4150-9ed2-17e866c6e931 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:23.115375 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65436d-c056-4150-9ed2-17e866c6e931 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:23.126848 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb2560-2527-41b1-b366-1e7674b8856a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:23.128232 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65436d-c056-4150-9ed2-17e866c6e931 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:23.130870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65436d-c056-4150-9ed2-17e866c6e931 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:23.158046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-aa65436d-c056-4150-9ed2-17e866c6e931 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:23.158046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:23.158046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:23.158046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:23.158046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:23.158046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:23.158046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:23.158046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:23.158046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:23.158046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:23.158046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:23.158046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:23.158046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:23.158046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:23.158046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:23.160360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:23.161829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:23.161829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:23.161829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:23.161829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:23.161829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:23.161829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:23.161829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:23.161829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:23.164819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe449da-ff03-40dc-9ff1-1eb2c8a8b54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:23.165647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe449da-ff03-40dc-9ff1-1eb2c8a8b54e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:23.165754 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe449da-ff03-40dc-9ff1-1eb2c8a8b54e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:23.166136 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe449da-ff03-40dc-9ff1-1eb2c8a8b54e None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:23.166335 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 263/538] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:23.166975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe449da-ff03-40dc-9ff1-1eb2c8a8b54e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:23.167282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe449da-ff03-40dc-9ff1-1eb2c8a8b54e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:23.167823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65436d-c056-4150-9ed2-17e866c6e931 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:23.168684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe449da-ff03-40dc-9ff1-1eb2c8a8b54e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:23.183176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 276/539] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:23.188541 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe449da-ff03-40dc-9ff1-1eb2c8a8b54e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:23.283377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:23.310103 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65436d-c056-4150-9ed2-17e866c6e931 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:23.314684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe449da-ff03-40dc-9ff1-1eb2c8a8b54e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:23.367603 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:23.377581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae69d10-84cf-4e06-9984-d643ceac5be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:23.379070 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae69d10-84cf-4e06-9984-d643ceac5be3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:23.379847 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae69d10-84cf-4e06-9984-d643ceac5be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:23.380296 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069eb3de-65e9-4324-b44f-d7c25c8566b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:23.380925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae69d10-84cf-4e06-9984-d643ceac5be3 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:23.381077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069eb3de-65e9-4324-b44f-d7c25c8566b1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:23.381331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069eb3de-65e9-4324-b44f-d7c25c8566b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:23.381576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069eb3de-65e9-4324-b44f-d7c25c8566b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:23.382385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069eb3de-65e9-4324-b44f-d7c25c8566b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:23.382695 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069eb3de-65e9-4324-b44f-d7c25c8566b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:23.383340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae69d10-84cf-4e06-9984-d643ceac5be3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:23.383918 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae69d10-84cf-4e06-9984-d643ceac5be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:23.384492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069eb3de-65e9-4324-b44f-d7c25c8566b1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:23.386093 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae69d10-84cf-4e06-9984-d643ceac5be3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:23.398566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 264/540] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:23.399656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 277/541] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:23.400145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae69d10-84cf-4e06-9984-d643ceac5be3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:23.404466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069eb3de-65e9-4324-b44f-d7c25c8566b1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:23.539739 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae69d10-84cf-4e06-9984-d643ceac5be3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:23.547573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069eb3de-65e9-4324-b44f-d7c25c8566b1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:23.583367 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991ca52-8bd2-4c31-b919-c58a928f1719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:23.584562 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991ca52-8bd2-4c31-b919-c58a928f1719 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:23.584986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991ca52-8bd2-4c31-b919-c58a928f1719 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:23.585685 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991ca52-8bd2-4c31-b919-c58a928f1719 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:23.588800 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba47616-52e2-4758-88cf-8c1ab5c7dec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:23.589626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba47616-52e2-4758-88cf-8c1ab5c7dec6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:23.589912 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba47616-52e2-4758-88cf-8c1ab5c7dec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:23.590182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba47616-52e2-4758-88cf-8c1ab5c7dec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:23.596191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991ca52-8bd2-4c31-b919-c58a928f1719 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:23.598231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:23.599367 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991ca52-8bd2-4c31-b919-c58a928f1719 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:23.606269 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba47616-52e2-4758-88cf-8c1ab5c7dec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:23.609075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba47616-52e2-4758-88cf-8c1ab5c7dec6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:23.617666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-a991ca52-8bd2-4c31-b919-c58a928f1719 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:23.617666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:23.617666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:23.617666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:23.617666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:23.617666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:23.617666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:23.617666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:23.617666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:23.617666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:23.617666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:23.617666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:23.617666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:23.617666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:23.617666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:23.618719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:23.619768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:23.619768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:23.619768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:23.619768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:23.619768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:23.619768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:23.619768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:23.619768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:23.621782 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 265/542] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:23.622821 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991ca52-8bd2-4c31-b919-c58a928f1719 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:23.644960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-bba47616-52e2-4758-88cf-8c1ab5c7dec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:23.644960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:23.644960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:23.644960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:23.644960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:23.644960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:23.644960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:23.644960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:23.644960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:23.644960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:23.644960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:23.644960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:23.644960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:23.644960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:23.644960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:23.646746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:23.648467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:23.648467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:23.648467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:23.648467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:23.648467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 278/543] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:05:23.648467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c744a-10bb-49da-b0ea-2dca57268dc5 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:23.648467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c744a-10bb-49da-b0ea-2dca57268dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:23.648467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c744a-10bb-49da-b0ea-2dca57268dc5 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:23.650056 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 279/544] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:23.650898 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c744a-10bb-49da-b0ea-2dca57268dc5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:23.715691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:23.800275 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c744a-10bb-49da-b0ea-2dca57268dc5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:23.803317 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991ca52-8bd2-4c31-b919-c58a928f1719 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:23.846217 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bf90e-f70f-4a82-bb70-cb2ca4b57c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:23.847189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bf90e-f70f-4a82-bb70-cb2ca4b57c86 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:23.847561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bf90e-f70f-4a82-bb70-cb2ca4b57c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:23.847769 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bf90e-f70f-4a82-bb70-cb2ca4b57c86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:23.848592 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bf90e-f70f-4a82-bb70-cb2ca4b57c86 None admin] RBAC: Adding query filter params (role.id=276de082c6c04d08a38361e8fea28a9a, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=b419d3dba854407f97f16fac79910d25) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:23.848902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bf90e-f70f-4a82-bb70-cb2ca4b57c86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:23.850374 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bf90e-f70f-4a82-bb70-cb2ca4b57c86 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:23.850671 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d4726-d0d4-4891-89ea-680a921ce3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:23.851460 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d4726-d0d4-4891-89ea-680a921ce3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:23.851808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d4726-d0d4-4891-89ea-680a921ce3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:23.852158 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d4726-d0d4-4891-89ea-680a921ce3e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:23.852989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d4726-d0d4-4891-89ea-680a921ce3e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:23.853301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d4726-d0d4-4891-89ea-680a921ce3e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:23.854738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d4726-d0d4-4891-89ea-680a921ce3e4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:23.868609 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 266/545] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:05:23 2022] GET /identity/v3/role_assignments?user.id=b419d3dba854407f97f16fac79910d25&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=276de082c6c04d08a38361e8fea28a9a => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:23.868609 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bf90e-f70f-4a82-bb70-cb2ca4b57c86 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:23.886651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 280/546] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:23.888324 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26ce00-c4e9-4242-9ea7-ad6922db27d6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:23.888706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26ce00-c4e9-4242-9ea7-ad6922db27d6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:23.888986 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26ce00-c4e9-4242-9ea7-ad6922db27d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:23.914777 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5b26ce00-c4e9-4242-9ea7-ad6922db27d6 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:23.916482 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5b26ce00-c4e9-4242-9ea7-ad6922db27d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:23.994987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:24.006894 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bf90e-f70f-4a82-bb70-cb2ca4b57c86 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:24.025371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 281/547] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:24.026971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26ce00-c4e9-4242-9ea7-ad6922db27d6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:24.028517 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:24.048328 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5548eda-9006-4ca1-b222-691d0f3eba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:24.048562 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5548eda-9006-4ca1-b222-691d0f3eba2c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:24.049331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5548eda-9006-4ca1-b222-691d0f3eba2c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:24.049614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5548eda-9006-4ca1-b222-691d0f3eba2c None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:24.050441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5548eda-9006-4ca1-b222-691d0f3eba2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:24.050723 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5548eda-9006-4ca1-b222-691d0f3eba2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:24.055807 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5548eda-9006-4ca1-b222-691d0f3eba2c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:24.070061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 267/548] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:24.071123 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5548eda-9006-4ca1-b222-691d0f3eba2c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:24.176267 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26ce00-c4e9-4242-9ea7-ad6922db27d6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:24.213601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5548eda-9006-4ca1-b222-691d0f3eba2c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:24.219007 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e61ae2-39d8-46a0-9a6d-93b0b706d6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:24.219772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e61ae2-39d8-46a0-9a6d-93b0b706d6bb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:24.220100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e61ae2-39d8-46a0-9a6d-93b0b706d6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:24.220344 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e61ae2-39d8-46a0-9a6d-93b0b706d6bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:24.222238 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e61ae2-39d8-46a0-9a6d-93b0b706d6bb None admin] RBAC: Adding query filter params (role.id=276de082c6c04d08a38361e8fea28a9a, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=ad22a7d1e01c4c40b7cbefe971755148) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:24.222657 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e61ae2-39d8-46a0-9a6d-93b0b706d6bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:24.228052 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e61ae2-39d8-46a0-9a6d-93b0b706d6bb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:24.238214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 282/549] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:05:24 2022] GET /identity/v3/role_assignments?user.id=ad22a7d1e01c4c40b7cbefe971755148&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=276de082c6c04d08a38361e8fea28a9a => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:24.239528 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e61ae2-39d8-46a0-9a6d-93b0b706d6bb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:24.268746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c5f56-45f4-474a-a91b-1f5b70f91d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:24.269583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c5f56-45f4-474a-a91b-1f5b70f91d5e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:24.269874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c5f56-45f4-474a-a91b-1f5b70f91d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:24.270157 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c5f56-45f4-474a-a91b-1f5b70f91d5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:24.284630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c5f56-45f4-474a-a91b-1f5b70f91d5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:24.293481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-3f7c5f56-45f4-474a-a91b-1f5b70f91d5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:24.293481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:24.293481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:24.293481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:24.293481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:24.293481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:24.293481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:24.293481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:24.293481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:24.293481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:24.293481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:24.293481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:24.293481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:24.293481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:24.293481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:24.293481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:24.294958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:24.294958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:24.294958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:24.294958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:24.294958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:24.294958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:24.294958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:24.294958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:24.294958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:24.294958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:24.294958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:24.294958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:24.294958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:24.294958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:24.294958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:24.294958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:24.296942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:24.296942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:24.296942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:24.296942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:24.296942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:24.296942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:24.296942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:24.296942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:24.296942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:24.296942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:24.296942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:24.296942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:24.296942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 268/550] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:24.296942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a2fbc-9c43-41d9-b9bf-dfd74a6334ff None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:24.297687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a2fbc-9c43-41d9-b9bf-dfd74a6334ff None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:24.297687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a2fbc-9c43-41d9-b9bf-dfd74a6334ff None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:24.303477 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 269/551] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:24.304400 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a2fbc-9c43-41d9-b9bf-dfd74a6334ff None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:24.317602 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:24.371590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:24.427813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e61ae2-39d8-46a0-9a6d-93b0b706d6bb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:24.481643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adbc65-dbd1-4bb3-a5db-5a2f2232c91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:24.482437 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adbc65-dbd1-4bb3-a5db-5a2f2232c91c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:24.482765 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adbc65-dbd1-4bb3-a5db-5a2f2232c91c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:24.483473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adbc65-dbd1-4bb3-a5db-5a2f2232c91c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:24.493489 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adbc65-dbd1-4bb3-a5db-5a2f2232c91c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:24.495369 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adbc65-dbd1-4bb3-a5db-5a2f2232c91c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:24.498128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a2fbc-9c43-41d9-b9bf-dfd74a6334ff None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:24.514950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b3adbc65-dbd1-4bb3-a5db-5a2f2232c91c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 16:05:24.514950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:24.514950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:24.514950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:24.514950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:24.514950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:24.514950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:24.514950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:24.514950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:24.514950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:24.514950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:24.514950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:24.514950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:24.514950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:24.514950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:24.514950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:24.515899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:24.516987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:24.516987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:24.516987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:24.516987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:24.516987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:24.516987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:24.516987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:24.516987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:24.516987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 16:05:24.516987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:24.519750 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 283/552] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:05:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:24.522800 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a479b5-94ea-4a3a-916a-b2845d68e053 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:24.523539 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a479b5-94ea-4a3a-916a-b2845d68e053 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:24.524344 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a479b5-94ea-4a3a-916a-b2845d68e053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:24.546212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e6a479b5-94ea-4a3a-916a-b2845d68e053 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:24.547825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e6a479b5-94ea-4a3a-916a-b2845d68e053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:24.548298 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442d82e-970f-40ff-9481-f9e0a6544898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:24.549066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442d82e-970f-40ff-9481-f9e0a6544898 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:24.549350 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442d82e-970f-40ff-9481-f9e0a6544898 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:24.549630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442d82e-970f-40ff-9481-f9e0a6544898 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:24.550394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442d82e-970f-40ff-9481-f9e0a6544898 None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:24.550706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442d82e-970f-40ff-9481-f9e0a6544898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:24.552500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442d82e-970f-40ff-9481-f9e0a6544898 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:24.565767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 270/553] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:24.567043 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442d82e-970f-40ff-9481-f9e0a6544898 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:24.632469 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 284/554] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:24.634295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a479b5-94ea-4a3a-916a-b2845d68e053 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:24.695755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:24.729202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:24.733064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442d82e-970f-40ff-9481-f9e0a6544898 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:24.773745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f8fd3-9c03-4eb7-9f40-e62e5c7f1ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:24.774679 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f8fd3-9c03-4eb7-9f40-e62e5c7f1ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:24.775116 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f8fd3-9c03-4eb7-9f40-e62e5c7f1ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:24.775578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f8fd3-9c03-4eb7-9f40-e62e5c7f1ab0 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:24.776936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f8fd3-9c03-4eb7-9f40-e62e5c7f1ab0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:24.777403 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f8fd3-9c03-4eb7-9f40-e62e5c7f1ab0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:24.779099 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f8fd3-9c03-4eb7-9f40-e62e5c7f1ab0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:24.790570 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a479b5-94ea-4a3a-916a-b2845d68e053 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:24.799555 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 271/555] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jul 25 16:05:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:24.805412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f8fd3-9c03-4eb7-9f40-e62e5c7f1ab0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:24.837291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d64271-c332-499d-8763-cbca386f392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:24.838149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d64271-c332-499d-8763-cbca386f392d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:24.838756 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d64271-c332-499d-8763-cbca386f392d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:24.839107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d64271-c332-499d-8763-cbca386f392d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:24.853471 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d64271-c332-499d-8763-cbca386f392d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:24.855515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d64271-c332-499d-8763-cbca386f392d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:24.887235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-12d64271-c332-499d-8763-cbca386f392d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:24.887235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:24.887235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:24.887235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:24.887235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:24.887235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:24.887235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:24.887235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:24.887235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:24.887235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:24.887235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:24.887235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:24.887235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:24.887235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:24.887235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:24.888159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:24.889414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:24.889414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:24.889414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:24.889414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:24.889414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 285/556] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:24.890215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d64271-c332-499d-8763-cbca386f392d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:24.930271 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f8fd3-9c03-4eb7-9f40-e62e5c7f1ab0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:24.976422 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc99b31-84a5-4f3c-b262-0059cd7f35a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:24.977356 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc99b31-84a5-4f3c-b262-0059cd7f35a4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:24.977722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc99b31-84a5-4f3c-b262-0059cd7f35a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:24.978067 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc99b31-84a5-4f3c-b262-0059cd7f35a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:24.993861 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc99b31-84a5-4f3c-b262-0059cd7f35a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:25.005272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-3fc99b31-84a5-4f3c-b262-0059cd7f35a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:25.005272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:25.005272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:25.005272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:25.005272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:25.005272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:25.005272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:25.005272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:25.005272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:25.005272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:25.005272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:25.005272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:25.005272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:25.005272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:25.005272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:25.005272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:25.007173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:25.007173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:25.007173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:25.007173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:25.007173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:25.007173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:25.007173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:25.007173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:25.007173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:25.007173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:25.007173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:25.007173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:25.007173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:25.007173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:25.007173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:25.007173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:25.009439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:25.009439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:25.009439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:25.009439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:25.009439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:25.009439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:25.009439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:25.009439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:25.009439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:25.009439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:25.009439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:25.009439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:25.009439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 272/557] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:25.009439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc99b31-84a5-4f3c-b262-0059cd7f35a4 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:25.032505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:25.051719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:25.071071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d64271-c332-499d-8763-cbca386f392d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:25.120109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab37168-0915-44f5-809b-ac0df9f7c79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:25.120923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab37168-0915-44f5-809b-ac0df9f7c79e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:25.121315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab37168-0915-44f5-809b-ac0df9f7c79e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:25.121604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab37168-0915-44f5-809b-ac0df9f7c79e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:25.152414 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc99b31-84a5-4f3c-b262-0059cd7f35a4 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:25.196763 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d73953-ee98-4733-8d85-3451ab24b155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:25.197973 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d73953-ee98-4733-8d85-3451ab24b155 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:25.198475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d73953-ee98-4733-8d85-3451ab24b155 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:25.198969 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d73953-ee98-4733-8d85-3451ab24b155 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:25.200118 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d73953-ee98-4733-8d85-3451ab24b155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:25.201036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d73953-ee98-4733-8d85-3451ab24b155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:25.204320 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d73953-ee98-4733-8d85-3451ab24b155 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:25.224582 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab37168-0915-44f5-809b-ac0df9f7c79e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:25.226104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab37168-0915-44f5-809b-ac0df9f7c79e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:25.226659 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 273/558] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:25.230935 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d73953-ee98-4733-8d85-3451ab24b155 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:25.336103 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:25.358960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:25.362236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d73953-ee98-4733-8d85-3451ab24b155 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:25.390643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 286/559] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:25.390643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab37168-0915-44f5-809b-ac0df9f7c79e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:25.411466 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724ddef-ba2e-492a-96f4-60014eefc041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:25.412904 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724ddef-ba2e-492a-96f4-60014eefc041 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:25.413391 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724ddef-ba2e-492a-96f4-60014eefc041 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:25.413968 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724ddef-ba2e-492a-96f4-60014eefc041 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:25.414909 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724ddef-ba2e-492a-96f4-60014eefc041 None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:25.415871 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724ddef-ba2e-492a-96f4-60014eefc041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:25.417931 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724ddef-ba2e-492a-96f4-60014eefc041 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:25.435258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 274/560] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:25.436582 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724ddef-ba2e-492a-96f4-60014eefc041 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:25.514559 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab37168-0915-44f5-809b-ac0df9f7c79e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:25.560358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8a8f2-a76e-48c0-a8d6-1ea9aa647336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:25.561175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8a8f2-a76e-48c0-a8d6-1ea9aa647336 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:25.561465 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8a8f2-a76e-48c0-a8d6-1ea9aa647336 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:25.562001 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8a8f2-a76e-48c0-a8d6-1ea9aa647336 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:25.565993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724ddef-ba2e-492a-96f4-60014eefc041 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:25.571684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8a8f2-a76e-48c0-a8d6-1ea9aa647336 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:25.573178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8a8f2-a76e-48c0-a8d6-1ea9aa647336 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:25.595395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-65c8a8f2-a76e-48c0-a8d6-1ea9aa647336 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:05:25.595395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:25.595395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:25.595395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:25.595395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:25.595395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:25.595395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:25.595395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:25.595395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:25.595395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:25.595395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:25.595395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:25.595395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:25.595395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:25.595395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:25.595395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:25.596583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:25.598023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:25.598023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:25.598023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:25.598023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:25.598023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:25.598023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:25.598023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:25.598023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:25.598023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:05:25.598023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:25.598023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 287/561] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 25 16:05:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:25.598023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8a8f2-a76e-48c0-a8d6-1ea9aa647336 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:25.606501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb9172-01dd-4326-8ada-6f639ab33839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:25.607698 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb9172-01dd-4326-8ada-6f639ab33839 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:25.608176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb9172-01dd-4326-8ada-6f639ab33839 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:25.608718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb9172-01dd-4326-8ada-6f639ab33839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:25.620525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:25.625239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb9172-01dd-4326-8ada-6f639ab33839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:25.627939 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb9172-01dd-4326-8ada-6f639ab33839 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:25.654708 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:25.657563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-13fb9172-01dd-4326-8ada-6f639ab33839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:25.657563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:25.657563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:25.657563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:25.657563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:25.657563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:25.657563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:25.657563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:25.657563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:25.657563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:25.657563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:25.657563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:25.657563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:25.657563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:25.657563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:25.658986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:25.659844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:25.659844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:25.659844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:25.659844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:25.665536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 275/562] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:25.666702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb9172-01dd-4326-8ada-6f639ab33839 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:25.730008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8a8f2-a76e-48c0-a8d6-1ea9aa647336 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:25.779608 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46ae65-adb6-4a12-8fcf-c7cd0fa81193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:25.780558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46ae65-adb6-4a12-8fcf-c7cd0fa81193 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:25.780837 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46ae65-adb6-4a12-8fcf-c7cd0fa81193 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:25.781109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46ae65-adb6-4a12-8fcf-c7cd0fa81193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:25.793519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46ae65-adb6-4a12-8fcf-c7cd0fa81193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:25.795356 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46ae65-adb6-4a12-8fcf-c7cd0fa81193 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:25.805144 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb9172-01dd-4326-8ada-6f639ab33839 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:25.816752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-cd46ae65-adb6-4a12-8fcf-c7cd0fa81193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:25.816752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:25.816752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:25.816752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:25.816752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:25.816752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:25.816752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:25.816752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:25.816752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:25.816752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:25.816752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:25.816752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:25.816752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:25.816752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:25.816752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:25.817712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:25.818591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:25.818591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:25.818591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:25.818591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:25.824282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 288/563] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:25.825292 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46ae65-adb6-4a12-8fcf-c7cd0fa81193 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:25.853416 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196096e9-5617-4282-96de-9a4684380282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:25.854566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196096e9-5617-4282-96de-9a4684380282 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:25.855058 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196096e9-5617-4282-96de-9a4684380282 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:25.855554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196096e9-5617-4282-96de-9a4684380282 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:25.856693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196096e9-5617-4282-96de-9a4684380282 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:25.857225 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196096e9-5617-4282-96de-9a4684380282 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:25.858999 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196096e9-5617-4282-96de-9a4684380282 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:25.879224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 276/564] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 25 16:05:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:25.880459 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196096e9-5617-4282-96de-9a4684380282 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:25.936475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:25.937117 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:25.944166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46ae65-adb6-4a12-8fcf-c7cd0fa81193 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:25.982389 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a1ef5-cf23-40c1-8cf5-eb5734ec595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:25.983426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a1ef5-cf23-40c1-8cf5-eb5734ec595a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:25.984001 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a1ef5-cf23-40c1-8cf5-eb5734ec595a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:25.984522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a1ef5-cf23-40c1-8cf5-eb5734ec595a None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:25.985440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a1ef5-cf23-40c1-8cf5-eb5734ec595a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:25.985971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a1ef5-cf23-40c1-8cf5-eb5734ec595a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:25.987709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a1ef5-cf23-40c1-8cf5-eb5734ec595a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:25.993944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196096e9-5617-4282-96de-9a4684380282 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:26.006260 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 289/565] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:26.007535 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a1ef5-cf23-40c1-8cf5-eb5734ec595a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:26.032342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dbbfb-0b9f-4606-9341-e14b5e94a6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:26.033607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dbbfb-0b9f-4606-9341-e14b5e94a6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:26.033898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dbbfb-0b9f-4606-9341-e14b5e94a6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:26.034218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dbbfb-0b9f-4606-9341-e14b5e94a6b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:26.035086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dbbfb-0b9f-4606-9341-e14b5e94a6b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:26.035374 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dbbfb-0b9f-4606-9341-e14b5e94a6b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:26.036976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dbbfb-0b9f-4606-9341-e14b5e94a6b7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:26.054725 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 277/566] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:26.054725 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dbbfb-0b9f-4606-9341-e14b5e94a6b7 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:26.128910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a1ef5-cf23-40c1-8cf5-eb5734ec595a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:26.161822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dbbfb-0b9f-4606-9341-e14b5e94a6b7 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:26.168762 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b0b81-a4b6-4fcc-a13e-5da3f46c3179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:26.170050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b0b81-a4b6-4fcc-a13e-5da3f46c3179 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:26.170337 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b0b81-a4b6-4fcc-a13e-5da3f46c3179 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:26.170648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b0b81-a4b6-4fcc-a13e-5da3f46c3179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:26.172437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:26.185681 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b0b81-a4b6-4fcc-a13e-5da3f46c3179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:26.187213 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b0b81-a4b6-4fcc-a13e-5da3f46c3179 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:26.203108 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60953b4-6c82-4a89-8823-08faf6f2a459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:26.203910 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60953b4-6c82-4a89-8823-08faf6f2a459 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:26.204190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60953b4-6c82-4a89-8823-08faf6f2a459 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:26.204490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60953b4-6c82-4a89-8823-08faf6f2a459 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:26.207374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f91b0b81-a4b6-4fcc-a13e-5da3f46c3179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:26.207374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:26.207374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:26.207374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:26.207374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:26.207374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:26.207374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:26.207374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:26.207374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:26.207374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:26.207374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:26.207374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:26.207374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:26.207374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:26.207374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:26.208689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:26.209875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:26.209875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:26.209875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:26.209875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:26.209875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 290/567] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:26.209875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b0b81-a4b6-4fcc-a13e-5da3f46c3179 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:26.218212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60953b4-6c82-4a89-8823-08faf6f2a459 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:26.219674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60953b4-6c82-4a89-8823-08faf6f2a459 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:26.228847 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:26.239619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f60953b4-6c82-4a89-8823-08faf6f2a459 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:26.239619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:26.239619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:26.239619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:26.239619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:26.239619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:26.239619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:26.239619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:26.239619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:26.239619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:26.239619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:26.239619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:26.239619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:26.239619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:26.239619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:26.240870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:26.241793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:26.241793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:26.241793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:26.241793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:26.241793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:26.241793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:26.241793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:26.241793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:26.246087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 278/568] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:26.247813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7522a-67c3-4cb0-a78e-57d4a05ea948 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:26.248124 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7522a-67c3-4cb0-a78e-57d4a05ea948 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:26.248447 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7522a-67c3-4cb0-a78e-57d4a05ea948 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:26.249978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 279/569] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:26.250969 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7522a-67c3-4cb0-a78e-57d4a05ea948 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:26.339595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b0b81-a4b6-4fcc-a13e-5da3f46c3179 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:26.370857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7522a-67c3-4cb0-a78e-57d4a05ea948 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:26.376270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29aaa7-b0bb-4a1d-acef-ffc85d7c7291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:26.377139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29aaa7-b0bb-4a1d-acef-ffc85d7c7291 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:26.377420 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29aaa7-b0bb-4a1d-acef-ffc85d7c7291 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:26.377697 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29aaa7-b0bb-4a1d-acef-ffc85d7c7291 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:26.386120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29aaa7-b0bb-4a1d-acef-ffc85d7c7291 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:26.387556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29aaa7-b0bb-4a1d-acef-ffc85d7c7291 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:26.402365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-fa29aaa7-b0bb-4a1d-acef-ffc85d7c7291 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 16:05:26.402365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:26.402365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:26.402365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:26.402365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:26.402365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:26.402365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:26.402365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:26.402365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:26.402365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:26.402365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:26.402365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:26.402365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:26.402365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:26.402365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:26.402365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:26.403408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:26.404366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:26.404366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:26.404366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:26.404366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:26.404366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:26.404366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:26.404366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:26.404366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:26.404366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 16:05:26.404366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:26.404366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 291/570] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:26.405014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29aaa7-b0bb-4a1d-acef-ffc85d7c7291 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:26.409984 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693b57e-5eed-4f16-9d52-d9cf79f04cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:26.410667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693b57e-5eed-4f16-9d52-d9cf79f04cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:26.410951 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693b57e-5eed-4f16-9d52-d9cf79f04cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:26.411222 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693b57e-5eed-4f16-9d52-d9cf79f04cc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:26.411952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693b57e-5eed-4f16-9d52-d9cf79f04cc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:26.412278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693b57e-5eed-4f16-9d52-d9cf79f04cc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:26.413660 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693b57e-5eed-4f16-9d52-d9cf79f04cc6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:26.425625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 280/571] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:26.427165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78a783-e6ae-46fc-b19e-8b73d3baacc5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:26.427456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78a783-e6ae-46fc-b19e-8b73d3baacc5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:26.427733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78a783-e6ae-46fc-b19e-8b73d3baacc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:26.446882 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-bf78a783-e6ae-46fc-b19e-8b73d3baacc5 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:26.448006 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bf78a783-e6ae-46fc-b19e-8b73d3baacc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:26.471886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:26.479883 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:26.517306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29aaa7-b0bb-4a1d-acef-ffc85d7c7291 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:26.526294 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 281/572] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:26.527902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f9d55-5483-41d6-833d-38d1247c685b None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:26.528199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f9d55-5483-41d6-833d-38d1247c685b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:26.528508 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f9d55-5483-41d6-833d-38d1247c685b None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:26.534346 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 282/573] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:26.534346 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f9d55-5483-41d6-833d-38d1247c685b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:26.558255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df6b24-d205-4c21-a2f2-5bc9836fc3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:26.559043 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df6b24-d205-4c21-a2f2-5bc9836fc3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:26.559389 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df6b24-d205-4c21-a2f2-5bc9836fc3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:26.559692 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df6b24-d205-4c21-a2f2-5bc9836fc3f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:26.560594 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df6b24-d205-4c21-a2f2-5bc9836fc3f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:26.560986 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df6b24-d205-4c21-a2f2-5bc9836fc3f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:26.562477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df6b24-d205-4c21-a2f2-5bc9836fc3f1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:26.574618 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 292/574] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:26.576643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df6b24-d205-4c21-a2f2-5bc9836fc3f1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:26.651028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f9d55-5483-41d6-833d-38d1247c685b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:26.681129 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df6b24-d205-4c21-a2f2-5bc9836fc3f1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:26.686759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37885f3-e5d6-48b5-b417-bcd1c4f195aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:26.687423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37885f3-e5d6-48b5-b417-bcd1c4f195aa None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:26.687708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37885f3-e5d6-48b5-b417-bcd1c4f195aa None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:26.687980 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37885f3-e5d6-48b5-b417-bcd1c4f195aa None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:26.688840 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37885f3-e5d6-48b5-b417-bcd1c4f195aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:26.689718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37885f3-e5d6-48b5-b417-bcd1c4f195aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:26.691140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37885f3-e5d6-48b5-b417-bcd1c4f195aa None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:26.713409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 283/575] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jul 25 16:05:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:26.713409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd007d45-c8f3-49f9-aa9f-b9cae284d239 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:26.713409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd007d45-c8f3-49f9-aa9f-b9cae284d239 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:26.713742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:26.713822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd007d45-c8f3-49f9-aa9f-b9cae284d239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:26.717692 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43883ab-b45d-4af5-ae2a-00ead2e004ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:26.718783 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43883ab-b45d-4af5-ae2a-00ead2e004ce None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:26.719071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43883ab-b45d-4af5-ae2a-00ead2e004ce None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:26.719350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43883ab-b45d-4af5-ae2a-00ead2e004ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:26.726244 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43883ab-b45d-4af5-ae2a-00ead2e004ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:26.727694 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43883ab-b45d-4af5-ae2a-00ead2e004ce None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:26.728179 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-cd007d45-c8f3-49f9-aa9f-b9cae284d239 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:26.729473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-cd007d45-c8f3-49f9-aa9f-b9cae284d239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:26.741438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f43883ab-b45d-4af5-ae2a-00ead2e004ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:26.741438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:26.741438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:26.741438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:26.741438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:26.741438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:26.741438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:26.741438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:26.741438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:26.741438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:26.741438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:26.741438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:26.741438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:26.741438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:26.741438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:26.742291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:26.743134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:26.743134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:26.743134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:26.743134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:26.743134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:26.743134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:26.743134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:26.743134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:26.743134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 293/576] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:26.743601 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43883ab-b45d-4af5-ae2a-00ead2e004ce None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:26.744592 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:26.800788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 284/577] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:26.801735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd007d45-c8f3-49f9-aa9f-b9cae284d239 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:26.862429 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43883ab-b45d-4af5-ae2a-00ead2e004ce None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:26.899883 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67243a3-6611-480d-8a4e-2ac9dfda59f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:26.900744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67243a3-6611-480d-8a4e-2ac9dfda59f8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:26.901201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67243a3-6611-480d-8a4e-2ac9dfda59f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:26.901519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67243a3-6611-480d-8a4e-2ac9dfda59f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:26.909254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd007d45-c8f3-49f9-aa9f-b9cae284d239 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:26.913842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67243a3-6611-480d-8a4e-2ac9dfda59f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:26.922206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f67243a3-6611-480d-8a4e-2ac9dfda59f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:26.922206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:26.922206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:26.922206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:26.922206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:26.922206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:26.922206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:26.922206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:26.922206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:26.922206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:26.922206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:26.922206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:26.922206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:26.922206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:26.922206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:26.922206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:26.923373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:26.923373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:26.923373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:26.923373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:26.923373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:26.923373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:26.923373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:26.923373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:26.923373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:26.923373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:26.923373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:26.923373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:26.923373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:26.923373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:26.923373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:26.923373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:26.924988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:26.924988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:26.924988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:26.924988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:26.924988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:26.924988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:26.924988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:26.924988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:26.924988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:26.924988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:26.924988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:26.924988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:26.924988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 294/578] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:26.924988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67243a3-6611-480d-8a4e-2ac9dfda59f8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:26.950785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd564e2-2797-4cc9-a715-d3213aeb29d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:26.951012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd564e2-2797-4cc9-a715-d3213aeb29d7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:26.951142 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd564e2-2797-4cc9-a715-d3213aeb29d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:26.951470 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd564e2-2797-4cc9-a715-d3213aeb29d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:26.952337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd564e2-2797-4cc9-a715-d3213aeb29d7 None admin] RBAC: Adding query filter params (role.id=276de082c6c04d08a38361e8fea28a9a, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=4dbc2609b13f45dc883ae18d3d056e76) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:26.952654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd564e2-2797-4cc9-a715-d3213aeb29d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:26.954103 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd564e2-2797-4cc9-a715-d3213aeb29d7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:26.959897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 285/579] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:05:26 2022] GET /identity/v3/role_assignments?user.id=4dbc2609b13f45dc883ae18d3d056e76&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=276de082c6c04d08a38361e8fea28a9a => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:26.960752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd564e2-2797-4cc9-a715-d3213aeb29d7 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:26.978980 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:26.984450 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:27.043981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67243a3-6611-480d-8a4e-2ac9dfda59f8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:27.081829 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45279bd0-747e-49be-bc24-11ec2c1b1920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:27.082639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45279bd0-747e-49be-bc24-11ec2c1b1920 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:27.082923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45279bd0-747e-49be-bc24-11ec2c1b1920 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:27.083195 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45279bd0-747e-49be-bc24-11ec2c1b1920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:27.086540 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd564e2-2797-4cc9-a715-d3213aeb29d7 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:27.094993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45279bd0-747e-49be-bc24-11ec2c1b1920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:27.096706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45279bd0-747e-49be-bc24-11ec2c1b1920 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:27.117769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-45279bd0-747e-49be-bc24-11ec2c1b1920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:27.117769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:27.117769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:27.117769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:27.117769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:27.117769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:27.117769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:27.117769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:27.117769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:27.117769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:27.117769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:27.117769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:27.117769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:27.117769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:27.117769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:27.118710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:27.119819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:27.119819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:27.119819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:27.119819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:27.119819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 295/580] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:27.120483 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45279bd0-747e-49be-bc24-11ec2c1b1920 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:27.132585 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fdceb-4c2b-4851-a25e-3ac898f08efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:27.133254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fdceb-4c2b-4851-a25e-3ac898f08efa None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:27.133537 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fdceb-4c2b-4851-a25e-3ac898f08efa None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:27.133815 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fdceb-4c2b-4851-a25e-3ac898f08efa None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:27.135060 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fdceb-4c2b-4851-a25e-3ac898f08efa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:27.135060 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fdceb-4c2b-4851-a25e-3ac898f08efa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:27.136388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fdceb-4c2b-4851-a25e-3ac898f08efa None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:27.149902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 286/581] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:27.150992 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fdceb-4c2b-4851-a25e-3ac898f08efa None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:27.240120 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:27.250187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45279bd0-747e-49be-bc24-11ec2c1b1920 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:27.252401 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:27.277682 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fdceb-4c2b-4851-a25e-3ac898f08efa None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:27.290141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a88e63-7ab2-4a45-b02f-c277b7d53e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:27.290879 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a88e63-7ab2-4a45-b02f-c277b7d53e63 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:27.291166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a88e63-7ab2-4a45-b02f-c277b7d53e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:27.291445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a88e63-7ab2-4a45-b02f-c277b7d53e63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:27.304836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a88e63-7ab2-4a45-b02f-c277b7d53e63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:27.312689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-73a88e63-7ab2-4a45-b02f-c277b7d53e63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:27.312689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:27.312689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:27.312689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:27.312689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:27.312689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:27.312689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:27.312689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:27.312689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:27.312689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:27.312689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:27.312689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:27.312689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:27.312689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:27.312689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:27.312689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:27.313630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:27.313630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:27.313630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:27.313630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:27.313630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:27.313630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:27.313630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:27.313630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:27.313630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:27.313630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:27.313630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:27.313630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:27.313630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:27.313630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:27.313630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:27.313630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:27.314959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:27.314959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:27.314959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:27.314959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:27.314959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:27.314959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:27.314959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:27.314959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:27.314959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:27.314959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:27.314959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:27.314959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:27.314959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 296/582] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:27.315629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a88e63-7ab2-4a45-b02f-c277b7d53e63 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:27.320701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972295b1-3d20-454c-a217-6b0282d5b3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:27.321393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972295b1-3d20-454c-a217-6b0282d5b3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:27.321673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972295b1-3d20-454c-a217-6b0282d5b3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:27.321998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972295b1-3d20-454c-a217-6b0282d5b3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:27.322774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972295b1-3d20-454c-a217-6b0282d5b3b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:27.323152 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972295b1-3d20-454c-a217-6b0282d5b3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:27.324889 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972295b1-3d20-454c-a217-6b0282d5b3b5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:27.338628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 287/583] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:27.338628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972295b1-3d20-454c-a217-6b0282d5b3b5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:27.435921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a88e63-7ab2-4a45-b02f-c277b7d53e63 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:27.446727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972295b1-3d20-454c-a217-6b0282d5b3b5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:27.473677 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b05fc-33d3-4d6a-bcef-3a01e8e880e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:27.474351 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b05fc-33d3-4d6a-bcef-3a01e8e880e8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:27.474638 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b05fc-33d3-4d6a-bcef-3a01e8e880e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:27.474915 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b05fc-33d3-4d6a-bcef-3a01e8e880e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:27.475635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b05fc-33d3-4d6a-bcef-3a01e8e880e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:27.475950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b05fc-33d3-4d6a-bcef-3a01e8e880e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:27.477363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b05fc-33d3-4d6a-bcef-3a01e8e880e8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:27.483521 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331da361-8b73-4f08-8663-eead56ae5e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:27.484653 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331da361-8b73-4f08-8663-eead56ae5e55 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:27.484936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331da361-8b73-4f08-8663-eead56ae5e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:27.485212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331da361-8b73-4f08-8663-eead56ae5e55 None admin] PATH_INFO: `/v3/projects/0c9d252e2e0347029d58192fab233f09/users/c455f8d340444b068249213ff504895e/roles/276de082c6c04d08a38361e8fea28a9a` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:27.487989 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:27.494525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 297/584] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:27.494525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b05fc-33d3-4d6a-bcef-3a01e8e880e8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:27.503337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331da361-8b73-4f08-8663-eead56ae5e55 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9d252e2e0347029d58192fab233f09, user_id=c455f8d340444b068249213ff504895e, role_id=276de082c6c04d08a38361e8fea28a9a)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:27.505339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331da361-8b73-4f08-8663-eead56ae5e55 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:27.522176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:27.523099 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 288/585] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:05:27 2022] PUT /identity/v3/projects/0c9d252e2e0347029d58192fab233f09/users/c455f8d340444b068249213ff504895e/roles/276de082c6c04d08a38361e8fea28a9a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:05:27.523818 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331da361-8b73-4f08-8663-eead56ae5e55 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:27.666788 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b05fc-33d3-4d6a-bcef-3a01e8e880e8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:27.685859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331da361-8b73-4f08-8663-eead56ae5e55 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:27.719069 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef82a16-1293-4839-891f-1cf6159263e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:27.719750 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef82a16-1293-4839-891f-1cf6159263e4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:27.720069 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef82a16-1293-4839-891f-1cf6159263e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:27.720532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef82a16-1293-4839-891f-1cf6159263e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:27.721614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef82a16-1293-4839-891f-1cf6159263e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:27.721922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef82a16-1293-4839-891f-1cf6159263e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:27.723501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef82a16-1293-4839-891f-1cf6159263e4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:27.733719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 298/586] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:27.734513 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef82a16-1293-4839-891f-1cf6159263e4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:27.735879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc8029-3013-4a9b-9c1b-ec5eba78273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:27.737832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc8029-3013-4a9b-9c1b-ec5eba78273d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:27.738257 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc8029-3013-4a9b-9c1b-ec5eba78273d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:27.738627 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc8029-3013-4a9b-9c1b-ec5eba78273d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:27.749790 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc8029-3013-4a9b-9c1b-ec5eba78273d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:27.751401 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc8029-3013-4a9b-9c1b-ec5eba78273d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:27.770379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-81cc8029-3013-4a9b-9c1b-ec5eba78273d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:27.770379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:27.770379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:27.770379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:27.770379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:27.770379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:27.770379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:27.770379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:27.770379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:27.770379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:27.770379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:27.770379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:27.770379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:27.770379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:27.770379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:27.771452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:27.772529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:27.772529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:27.772529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:27.772529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:27.774077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 289/587] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:27.774967 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc8029-3013-4a9b-9c1b-ec5eba78273d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:27.816911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:27.850427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:27.872857 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef82a16-1293-4839-891f-1cf6159263e4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:27.899012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc8029-3013-4a9b-9c1b-ec5eba78273d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:27.926319 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b24d40-4ede-40dd-9acf-6dc56e89635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:27.927530 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b24d40-4ede-40dd-9acf-6dc56e89635d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:27.927830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b24d40-4ede-40dd-9acf-6dc56e89635d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:27.928112 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b24d40-4ede-40dd-9acf-6dc56e89635d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:27.938534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b24d40-4ede-40dd-9acf-6dc56e89635d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:27.940533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b24d40-4ede-40dd-9acf-6dc56e89635d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:27.947457 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d7c00-e915-4cb6-9c48-7a1c43f5ffb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:27.948446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d7c00-e915-4cb6-9c48-7a1c43f5ffb3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:27.948824 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d7c00-e915-4cb6-9c48-7a1c43f5ffb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:27.949192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d7c00-e915-4cb6-9c48-7a1c43f5ffb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:27.958719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-81b24d40-4ede-40dd-9acf-6dc56e89635d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:27.958719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:27.958719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:27.958719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:27.958719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:27.958719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:27.958719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:27.958719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:27.958719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:27.958719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:27.958719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:27.958719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:27.958719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:27.958719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:27.958719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:27.959958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:27.961161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:27.961161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:27.961161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:27.961161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:27.961161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:27.961161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:27.961161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:27.961161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:27.964364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 299/588] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:27.965517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b24d40-4ede-40dd-9acf-6dc56e89635d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:27.966442 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d7c00-e915-4cb6-9c48-7a1c43f5ffb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:27.968349 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d7c00-e915-4cb6-9c48-7a1c43f5ffb3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:27.989208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f25d7c00-e915-4cb6-9c48-7a1c43f5ffb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:27.989208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:27.989208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:27.989208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:27.989208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:27.989208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:27.989208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:27.989208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:27.989208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:27.989208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:27.989208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:27.989208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:27.989208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:27.989208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:27.989208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:27.990337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:27.991510 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:27.991510 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:27.991510 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:27.991510 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:27.997376 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 290/589] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:27.998542 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d7c00-e915-4cb6-9c48-7a1c43f5ffb3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:28.099140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:28.102974 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b24d40-4ede-40dd-9acf-6dc56e89635d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:28.113893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d7c00-e915-4cb6-9c48-7a1c43f5ffb3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:28.148806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf007ac1-7ca9-42f1-a168-00e1c44e2158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:28.149839 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf007ac1-7ca9-42f1-a168-00e1c44e2158 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:28.150345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf007ac1-7ca9-42f1-a168-00e1c44e2158 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:28.150825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf007ac1-7ca9-42f1-a168-00e1c44e2158 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:28.151344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11139d91-7121-4401-bf64-c706f756fe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:28.152288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf007ac1-7ca9-42f1-a168-00e1c44e2158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:28.152410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11139d91-7121-4401-bf64-c706f756fe7e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:28.152576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11139d91-7121-4401-bf64-c706f756fe7e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:28.152859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11139d91-7121-4401-bf64-c706f756fe7e None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:28.153371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf007ac1-7ca9-42f1-a168-00e1c44e2158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:28.153631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11139d91-7121-4401-bf64-c706f756fe7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:28.153940 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11139d91-7121-4401-bf64-c706f756fe7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:28.155360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf007ac1-7ca9-42f1-a168-00e1c44e2158 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:28.155475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11139d91-7121-4401-bf64-c706f756fe7e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:28.175364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 300/590] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:28.175364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf007ac1-7ca9-42f1-a168-00e1c44e2158 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:28.182727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:28.186061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 291/591] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:28.188067 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11139d91-7121-4401-bf64-c706f756fe7e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:28.330301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf007ac1-7ca9-42f1-a168-00e1c44e2158 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:28.363275 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11139d91-7121-4401-bf64-c706f756fe7e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:28.379872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d93d9a-d9f4-400a-9cb6-81b20cd3acb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:28.381228 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d93d9a-d9f4-400a-9cb6-81b20cd3acb3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:28.381742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d93d9a-d9f4-400a-9cb6-81b20cd3acb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:28.382457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d93d9a-d9f4-400a-9cb6-81b20cd3acb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:28.383774 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d93d9a-d9f4-400a-9cb6-81b20cd3acb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:28.384327 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d93d9a-d9f4-400a-9cb6-81b20cd3acb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:28.385954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d93d9a-d9f4-400a-9cb6-81b20cd3acb3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:28.402240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeab07-cffb-4d58-90ef-e745b9aa7bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:28.403173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeab07-cffb-4d58-90ef-e745b9aa7bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:28.403528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeab07-cffb-4d58-90ef-e745b9aa7bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:28.403895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeab07-cffb-4d58-90ef-e745b9aa7bf7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:28.404280 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 301/592] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:28.405338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d93d9a-d9f4-400a-9cb6-81b20cd3acb3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:28.412997 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baeab07-cffb-4d58-90ef-e745b9aa7bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:28.414555 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baeab07-cffb-4d58-90ef-e745b9aa7bf7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:28.432176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-5baeab07-cffb-4d58-90ef-e745b9aa7bf7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 16:05:28.432176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:28.432176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:28.432176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:28.432176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:28.432176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:28.432176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:28.432176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:28.432176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:28.432176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:28.432176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:28.432176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:28.432176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:28.432176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:28.432176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:28.432176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:28.433182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:28.434096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:28.434096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:28.434096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:28.434096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:28.434096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:28.434096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:28.434096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:28.434096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:28.434096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 16:05:28.434096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:28.438858 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 292/593] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:28.440043 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeab07-cffb-4d58-90ef-e745b9aa7bf7 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:28.453026 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:28.488430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:28.531887 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d93d9a-d9f4-400a-9cb6-81b20cd3acb3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:28.568000 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444091c-d90b-4d2b-8125-14d647d66c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:28.569105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444091c-d90b-4d2b-8125-14d647d66c77 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:28.569559 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444091c-d90b-4d2b-8125-14d647d66c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:28.569910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444091c-d90b-4d2b-8125-14d647d66c77 None admin] PATH_INFO: `/v3/projects/0c9d252e2e0347029d58192fab233f09/users/623c97746d304c6ba971e79e4dbeb730/roles/276de082c6c04d08a38361e8fea28a9a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:28.570511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeab07-cffb-4d58-90ef-e745b9aa7bf7 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:28.587025 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444091c-d90b-4d2b-8125-14d647d66c77 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9d252e2e0347029d58192fab233f09, user_id=623c97746d304c6ba971e79e4dbeb730, role_id=276de082c6c04d08a38361e8fea28a9a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:28.588534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444091c-d90b-4d2b-8125-14d647d66c77 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:28.606316 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 302/594] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:05:28 2022] PUT /identity/v3/projects/0c9d252e2e0347029d58192fab233f09/users/623c97746d304c6ba971e79e4dbeb730/roles/276de082c6c04d08a38361e8fea28a9a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:05:28.607574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444091c-d90b-4d2b-8125-14d647d66c77 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:28.620451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b0057-916f-40d1-aca3-05d74d4c2b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:28.621624 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b0057-916f-40d1-aca3-05d74d4c2b4e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:28.622086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b0057-916f-40d1-aca3-05d74d4c2b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:28.622549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b0057-916f-40d1-aca3-05d74d4c2b4e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:28.634194 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b0057-916f-40d1-aca3-05d74d4c2b4e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:28.637541 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b0057-916f-40d1-aca3-05d74d4c2b4e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:28.670761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-c87b0057-916f-40d1-aca3-05d74d4c2b4e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 16:05:28.670761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:28.670761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:28.670761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:28.670761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:28.670761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:28.670761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:28.670761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:28.670761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:28.670761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:28.670761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:28.670761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:28.670761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:28.670761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:28.670761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:28.670761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:28.671721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:28.672658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:28.672658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:28.672658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:28.672658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:28.672658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:28.672658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:28.672658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:28.672658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:28.672658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 16:05:28.672658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:28.677702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 293/595] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:28.686679 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b0057-916f-40d1-aca3-05d74d4c2b4e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:28.809122 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:28.824718 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444091c-d90b-4d2b-8125-14d647d66c77 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:28.846545 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:28.864243 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b0057-916f-40d1-aca3-05d74d4c2b4e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:28.876532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148779f-ceea-42ed-b0d6-45f03d8b445c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:28.878212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148779f-ceea-42ed-b0d6-45f03d8b445c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:28.878604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148779f-ceea-42ed-b0d6-45f03d8b445c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:28.878987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148779f-ceea-42ed-b0d6-45f03d8b445c None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:28.880304 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148779f-ceea-42ed-b0d6-45f03d8b445c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:28.880731 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148779f-ceea-42ed-b0d6-45f03d8b445c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:28.882846 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148779f-ceea-42ed-b0d6-45f03d8b445c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:28.906881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc3ddc-2842-46fd-b092-2d5a1dbdd921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:28.908505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc3ddc-2842-46fd-b092-2d5a1dbdd921 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:28.908960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc3ddc-2842-46fd-b092-2d5a1dbdd921 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:28.909393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc3ddc-2842-46fd-b092-2d5a1dbdd921 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:28.910708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc3ddc-2842-46fd-b092-2d5a1dbdd921 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:28.911185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc3ddc-2842-46fd-b092-2d5a1dbdd921 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:28.912831 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc3ddc-2842-46fd-b092-2d5a1dbdd921 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:28.935693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 294/596] 10.222.0.70 () {56 vars in 1139 bytes} [Mon Jul 25 16:05:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:28.938012 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 303/597] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jul 25 16:05:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:28.944615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc3ddc-2842-46fd-b092-2d5a1dbdd921 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:28.944906 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148779f-ceea-42ed-b0d6-45f03d8b445c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:29.060304 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc3ddc-2842-46fd-b092-2d5a1dbdd921 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:29.092826 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:29.101484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098618ad-7ac6-4f85-b114-20f7bc90c26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:29.102959 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098618ad-7ac6-4f85-b114-20f7bc90c26d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:29.103470 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098618ad-7ac6-4f85-b114-20f7bc90c26d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:29.104100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098618ad-7ac6-4f85-b114-20f7bc90c26d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:29.119207 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148779f-ceea-42ed-b0d6-45f03d8b445c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:29.119742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098618ad-7ac6-4f85-b114-20f7bc90c26d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:29.122537 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098618ad-7ac6-4f85-b114-20f7bc90c26d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:29.150527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-098618ad-7ac6-4f85-b114-20f7bc90c26d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:29.150527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:29.150527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:29.150527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:29.150527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:29.150527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:29.150527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:29.150527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:29.150527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:29.150527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:29.150527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:29.150527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:29.150527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:29.150527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:29.150527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:29.151498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:29.152774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:29.152774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:29.152774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:29.152774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:29.154048 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 295/598] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:29.158726 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f7e71-10af-44b9-a447-1142c0b6f23a None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:29.158726 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f7e71-10af-44b9-a447-1142c0b6f23a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:29.158726 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f7e71-10af-44b9-a447-1142c0b6f23a None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:29.158726 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 296/599] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:29.162298 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f7e71-10af-44b9-a447-1142c0b6f23a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:29.165975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b460055-3e8b-49cc-b1c9-e84ab4d6d2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:29.166821 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b460055-3e8b-49cc-b1c9-e84ab4d6d2ca None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:29.167107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b460055-3e8b-49cc-b1c9-e84ab4d6d2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:29.167387 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b460055-3e8b-49cc-b1c9-e84ab4d6d2ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:29.184543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b460055-3e8b-49cc-b1c9-e84ab4d6d2ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:29.186071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b460055-3e8b-49cc-b1c9-e84ab4d6d2ca None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:29.206485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-1b460055-3e8b-49cc-b1c9-e84ab4d6d2ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:29.206485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:29.206485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:29.206485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:29.206485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:29.206485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:29.206485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:29.206485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:29.206485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:29.206485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:29.206485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:29.206485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:29.206485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:29.206485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:29.206485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:29.207430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:29.208331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:29.208331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:29.208331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:29.208331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:29.212354 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 304/600] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:05:29.213794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70296567-b958-42bd-83cb-c71b1ab7f4e7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:29.214093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70296567-b958-42bd-83cb-c71b1ab7f4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:29.214378 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70296567-b958-42bd-83cb-c71b1ab7f4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:29.236735 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-70296567-b958-42bd-83cb-c71b1ab7f4e7 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:29.238364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-70296567-b958-42bd-83cb-c71b1ab7f4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:29.263190 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:29.320636 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 305/601] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:29.320986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f7e71-10af-44b9-a447-1142c0b6f23a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:29.321603 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70296567-b958-42bd-83cb-c71b1ab7f4e7 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:29.365514 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dd880-50d7-4890-9685-533790b87470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:29.367334 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dd880-50d7-4890-9685-533790b87470 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:29.367845 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dd880-50d7-4890-9685-533790b87470 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:29.368720 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58dd880-50d7-4890-9685-533790b87470 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:29.369672 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dd880-50d7-4890-9685-533790b87470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:29.370479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dd880-50d7-4890-9685-533790b87470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:29.372408 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58dd880-50d7-4890-9685-533790b87470 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:29.388499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 297/602] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:29.394199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dd880-50d7-4890-9685-533790b87470 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:29.440708 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70296567-b958-42bd-83cb-c71b1ab7f4e7 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:29.441535 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:29.480567 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68c232-3fd9-47f4-889b-38c928e0c1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:29.481295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68c232-3fd9-47f4-889b-38c928e0c1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:29.481581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68c232-3fd9-47f4-889b-38c928e0c1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:29.481860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68c232-3fd9-47f4-889b-38c928e0c1c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:29.482616 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68c232-3fd9-47f4-889b-38c928e0c1c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:29.482919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68c232-3fd9-47f4-889b-38c928e0c1c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:29.484408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68c232-3fd9-47f4-889b-38c928e0c1c7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:29.502992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 306/603] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:29.504111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68c232-3fd9-47f4-889b-38c928e0c1c7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:29.515280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58dd880-50d7-4890-9685-533790b87470 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:29.521753 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:29.556776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752a662-b3bf-4f51-9495-362eb9e96615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:29.557981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752a662-b3bf-4f51-9495-362eb9e96615 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:29.558467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752a662-b3bf-4f51-9495-362eb9e96615 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:29.558935 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752a662-b3bf-4f51-9495-362eb9e96615 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:29.575647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752a662-b3bf-4f51-9495-362eb9e96615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:29.585064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-a752a662-b3bf-4f51-9495-362eb9e96615 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:29.585064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:29.585064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:29.585064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:29.585064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:29.585064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:29.585064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:29.585064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:29.585064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:29.585064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:29.585064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:29.585064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:29.585064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:29.585064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:29.585064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:29.585064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:29.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:29.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:29.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:29.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:29.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:29.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:29.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:29.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:29.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:29.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:29.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:29.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:29.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:29.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:29.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:29.586085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:29.586924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:29.586924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:29.586924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:29.586924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:29.586924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:29.586924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:29.586924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:29.586924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:29.586924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:29.586924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:29.586924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:29.586924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:29.586924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 298/604] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:29.588117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752a662-b3bf-4f51-9495-362eb9e96615 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:29.633101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68c232-3fd9-47f4-889b-38c928e0c1c7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:29.672301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a63732-cd29-4dc2-97b4-2de79f72d508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:29.673151 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a63732-cd29-4dc2-97b4-2de79f72d508 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:29.673422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a63732-cd29-4dc2-97b4-2de79f72d508 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:29.674197 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a63732-cd29-4dc2-97b4-2de79f72d508 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:29.683199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a63732-cd29-4dc2-97b4-2de79f72d508 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:29.684871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a63732-cd29-4dc2-97b4-2de79f72d508 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:29.704300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-86a63732-cd29-4dc2-97b4-2de79f72d508 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:29.704300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:29.704300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:29.704300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:29.704300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:29.704300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:29.704300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:29.704300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:29.704300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:29.704300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:29.704300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:29.704300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:29.704300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:29.704300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:29.704300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:29.705323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:29.706162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:29.706162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:29.706162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:29.706162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:29.706162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:29.706162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:29.706162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:29.706162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:29.708454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 307/605] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:29.709850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a63732-cd29-4dc2-97b4-2de79f72d508 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:29.729314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:29.736581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752a662-b3bf-4f51-9495-362eb9e96615 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:29.773966 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d541db-36c4-4769-8e01-ab6f7e471e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:29.774809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d541db-36c4-4769-8e01-ab6f7e471e3a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:29.775093 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d541db-36c4-4769-8e01-ab6f7e471e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:29.775367 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d541db-36c4-4769-8e01-ab6f7e471e3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:29.782893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d541db-36c4-4769-8e01-ab6f7e471e3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:29.784406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d541db-36c4-4769-8e01-ab6f7e471e3a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:29.799114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-68d541db-36c4-4769-8e01-ab6f7e471e3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:29.799114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:29.799114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:29.799114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:29.799114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:29.799114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:29.799114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:29.799114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:29.799114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:29.799114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:29.799114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:29.799114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:29.799114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:29.799114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:29.799114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:29.800002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:29.800925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:29.800925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:29.800925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:29.800925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:29.800925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:29.800925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:29.800925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:29.800925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:29.800925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 299/606] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:29.801398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d541db-36c4-4769-8e01-ab6f7e471e3a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:29.811840 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:29.841045 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a63732-cd29-4dc2-97b4-2de79f72d508 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:29.880741 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386c864-5195-4674-ac95-41ed269234b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:29.881422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386c864-5195-4674-ac95-41ed269234b4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:29.881696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386c864-5195-4674-ac95-41ed269234b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:29.881972 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386c864-5195-4674-ac95-41ed269234b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:29.883360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386c864-5195-4674-ac95-41ed269234b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:29.883360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386c864-5195-4674-ac95-41ed269234b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:29.884426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386c864-5195-4674-ac95-41ed269234b4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:29.898471 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 308/607] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:29.898471 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2e4a1-2280-4b7a-83a6-bda1d01dfc6e None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:29.898471 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2e4a1-2280-4b7a-83a6-bda1d01dfc6e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:29.898471 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2e4a1-2280-4b7a-83a6-bda1d01dfc6e None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:29.898471 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 309/608] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:29.898471 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2e4a1-2280-4b7a-83a6-bda1d01dfc6e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:29.922642 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d541db-36c4-4769-8e01-ab6f7e471e3a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:29.967454 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f252d-b947-43a6-9eb0-a927d2a8f752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:29.968151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f252d-b947-43a6-9eb0-a927d2a8f752 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:29.968592 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f252d-b947-43a6-9eb0-a927d2a8f752 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:29.968749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f252d-b947-43a6-9eb0-a927d2a8f752 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:29.969753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f252d-b947-43a6-9eb0-a927d2a8f752 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:29.969880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f252d-b947-43a6-9eb0-a927d2a8f752 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:29.971913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f252d-b947-43a6-9eb0-a927d2a8f752 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:29.990931 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 300/609] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:29.990931 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f252d-b947-43a6-9eb0-a927d2a8f752 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:30.012203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:30.023029 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2e4a1-2280-4b7a-83a6-bda1d01dfc6e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:30.061459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853ad5b-fb5b-4f8f-a3c2-c9d70df29ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:30.062486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853ad5b-fb5b-4f8f-a3c2-c9d70df29ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:30.063035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853ad5b-fb5b-4f8f-a3c2-c9d70df29ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:30.063322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853ad5b-fb5b-4f8f-a3c2-c9d70df29ab1 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:30.064143 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853ad5b-fb5b-4f8f-a3c2-c9d70df29ab1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:30.064499 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853ad5b-fb5b-4f8f-a3c2-c9d70df29ab1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:30.066101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853ad5b-fb5b-4f8f-a3c2-c9d70df29ab1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:30.070584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:30.088338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 310/610] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:30.088338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da289d-99f3-4abd-b2a3-7d238c3b634c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:30.088338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da289d-99f3-4abd-b2a3-7d238c3b634c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:30.088338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da289d-99f3-4abd-b2a3-7d238c3b634c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:30.102745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f252d-b947-43a6-9eb0-a927d2a8f752 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:30.107954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a3da289d-99f3-4abd-b2a3-7d238c3b634c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:30.109213 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a3da289d-99f3-4abd-b2a3-7d238c3b634c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:30.144894 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106597f6-9a52-4686-9426-0db6c0f8ceec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:30.145674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106597f6-9a52-4686-9426-0db6c0f8ceec None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:30.145968 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106597f6-9a52-4686-9426-0db6c0f8ceec None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:30.146245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106597f6-9a52-4686-9426-0db6c0f8ceec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:30.158784 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106597f6-9a52-4686-9426-0db6c0f8ceec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:30.160615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106597f6-9a52-4686-9426-0db6c0f8ceec None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:30.178188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-106597f6-9a52-4686-9426-0db6c0f8ceec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:30.178188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:30.178188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:30.178188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:30.178188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:30.178188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:30.178188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:30.178188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:30.178188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:30.178188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:30.178188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:30.178188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:30.178188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:30.178188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:30.178188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:30.179239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:30.180117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:30.180117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:30.180117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:30.180117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:30.180117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 301/611] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:30.181179 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106597f6-9a52-4686-9426-0db6c0f8ceec None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:30.185743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 311/612] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:30.186705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da289d-99f3-4abd-b2a3-7d238c3b634c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:30.263703 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:30.298735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106597f6-9a52-4686-9426-0db6c0f8ceec None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:30.306357 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da289d-99f3-4abd-b2a3-7d238c3b634c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:30.335887 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a61b14-0dc9-4685-a9b2-f6759cdad699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:30.336811 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a61b14-0dc9-4685-a9b2-f6759cdad699 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:30.337097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a61b14-0dc9-4685-a9b2-f6759cdad699 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:30.337370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a61b14-0dc9-4685-a9b2-f6759cdad699 None admin] PATH_INFO: `/v3/projects/0c9d252e2e0347029d58192fab233f09/users/ad22a7d1e01c4c40b7cbefe971755148/roles/276de082c6c04d08a38361e8fea28a9a` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:30.340084 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:30.350953 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86b3b1-5d1c-4544-b6ec-9df72751e115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:30.352524 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86b3b1-5d1c-4544-b6ec-9df72751e115 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:30.353004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86b3b1-5d1c-4544-b6ec-9df72751e115 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:30.353493 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86b3b1-5d1c-4544-b6ec-9df72751e115 None admin] PATH_INFO: `/v3/projects/0c9d252e2e0347029d58192fab233f09/users/b419d3dba854407f97f16fac79910d25/roles/276de082c6c04d08a38361e8fea28a9a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:30.354805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a61b14-0dc9-4685-a9b2-f6759cdad699 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9d252e2e0347029d58192fab233f09, user_id=ad22a7d1e01c4c40b7cbefe971755148, role_id=276de082c6c04d08a38361e8fea28a9a)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:30.356735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a61b14-0dc9-4685-a9b2-f6759cdad699 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:30.380072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 302/613] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:05:30 2022] PUT /identity/v3/projects/0c9d252e2e0347029d58192fab233f09/users/ad22a7d1e01c4c40b7cbefe971755148/roles/276de082c6c04d08a38361e8fea28a9a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:05:30.380856 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86b3b1-5d1c-4544-b6ec-9df72751e115 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9d252e2e0347029d58192fab233f09, user_id=b419d3dba854407f97f16fac79910d25, role_id=276de082c6c04d08a38361e8fea28a9a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:30.381731 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86b3b1-5d1c-4544-b6ec-9df72751e115 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:30.382089 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a61b14-0dc9-4685-a9b2-f6759cdad699 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:30.408830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 312/614] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:05:30 2022] PUT /identity/v3/projects/0c9d252e2e0347029d58192fab233f09/users/b419d3dba854407f97f16fac79910d25/roles/276de082c6c04d08a38361e8fea28a9a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:05:30.409907 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86b3b1-5d1c-4544-b6ec-9df72751e115 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:30.588338 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a61b14-0dc9-4685-a9b2-f6759cdad699 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:30.616832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:30.626856 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86b3b1-5d1c-4544-b6ec-9df72751e115 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:30.638733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d62ceb-dd80-415f-90b5-aad0a5906e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:30.639852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d62ceb-dd80-415f-90b5-aad0a5906e7e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:30.640389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d62ceb-dd80-415f-90b5-aad0a5906e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:30.640869 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d62ceb-dd80-415f-90b5-aad0a5906e7e None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:30.641820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d62ceb-dd80-415f-90b5-aad0a5906e7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:30.642861 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d62ceb-dd80-415f-90b5-aad0a5906e7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:30.644695 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d62ceb-dd80-415f-90b5-aad0a5906e7e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:30.667402 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 303/615] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:30.672674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d62ceb-dd80-415f-90b5-aad0a5906e7e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:30.677819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb001c8-1b30-4fa1-a8c0-24208ac77544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:30.678650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb001c8-1b30-4fa1-a8c0-24208ac77544 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:30.678916 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb001c8-1b30-4fa1-a8c0-24208ac77544 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:30.679189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb001c8-1b30-4fa1-a8c0-24208ac77544 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:30.693524 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb001c8-1b30-4fa1-a8c0-24208ac77544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:30.701730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-7fb001c8-1b30-4fa1-a8c0-24208ac77544 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:30.701730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:30.701730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:30.701730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:30.701730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:30.701730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:30.701730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:30.701730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:30.701730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:30.701730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:30.701730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:30.701730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:30.701730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:30.701730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:30.701730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:30.701730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:30.702698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:30.702698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:30.702698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:30.702698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:30.702698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:30.702698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:30.702698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:30.702698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:30.702698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:30.702698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:30.702698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:30.702698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:30.702698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:30.702698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:30.702698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:30.702698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:30.703961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:30.703961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:30.703961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:30.703961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:30.703961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:30.703961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:30.703961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:30.703961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:30.703961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:30.703961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:30.703961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:30.703961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:30.703961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 313/616] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:30.709858 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb001c8-1b30-4fa1-a8c0-24208ac77544 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:30.763533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:30.870943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d62ceb-dd80-415f-90b5-aad0a5906e7e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:30.889587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb001c8-1b30-4fa1-a8c0-24208ac77544 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:30.931315 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd67426-beca-4a50-ab15-59469eba87ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:30.932394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd67426-beca-4a50-ab15-59469eba87ee None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:30.933075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd67426-beca-4a50-ab15-59469eba87ee None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:30.933360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd67426-beca-4a50-ab15-59469eba87ee None admin] PATH_INFO: `/v3/users/swift` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:30.937556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c5071-7fc4-421f-b7a6-57e5eaeda164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:30.938319 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c5071-7fc4-421f-b7a6-57e5eaeda164 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:30.938763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c5071-7fc4-421f-b7a6-57e5eaeda164 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:30.939341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c5071-7fc4-421f-b7a6-57e5eaeda164 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:30.940157 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c5071-7fc4-421f-b7a6-57e5eaeda164 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:30.940557 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c5071-7fc4-421f-b7a6-57e5eaeda164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:30.941749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd67426-beca-4a50-ab15-59469eba87ee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:30.942106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c5071-7fc4-421f-b7a6-57e5eaeda164 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:30.943201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd67426-beca-4a50-ab15-59469eba87ee None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:30.951876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 314/617] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:30.957498 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6ec8f-e634-4f72-9bcc-2efad167fb88 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:30.957930 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6ec8f-e634-4f72-9bcc-2efad167fb88 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:30.958322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6ec8f-e634-4f72-9bcc-2efad167fb88 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:30.959340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-7cd67426-beca-4a50-ab15-59469eba87ee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 16:05:30.959340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:30.959340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:30.959340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:30.959340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:30.959340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:30.959340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:30.959340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:30.959340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:30.959340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:30.959340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:30.959340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:30.959340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:30.959340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:30.959340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:30.959340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:30.960579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:30.962270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:30.962270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:30.962270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:30.962270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:30.962270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:30.962270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:30.962270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:30.962270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:30.962270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 16:05:30.962270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:30.965788 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 315/618] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:30.965788 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6ec8f-e634-4f72-9bcc-2efad167fb88 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:30.966085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 304/619] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:05:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:30.967390 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9693ee7-e6e9-413c-b70b-a746cb8562a5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:30.967674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9693ee7-e6e9-413c-b70b-a746cb8562a5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:30.968282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9693ee7-e6e9-413c-b70b-a746cb8562a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:30.987819 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c9693ee7-e6e9-413c-b70b-a746cb8562a5 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:30.989054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c9693ee7-e6e9-413c-b70b-a746cb8562a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:31.027830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:31.065516 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 305/620] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:31.066475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9693ee7-e6e9-413c-b70b-a746cb8562a5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:31.077242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:31.082979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6ec8f-e634-4f72-9bcc-2efad167fb88 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:31.140281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f7a54-754b-4cc4-8fa3-aae1ee9e2fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:31.140281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f7a54-754b-4cc4-8fa3-aae1ee9e2fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:31.140281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f7a54-754b-4cc4-8fa3-aae1ee9e2fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:31.140993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f7a54-754b-4cc4-8fa3-aae1ee9e2fa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:31.158398 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f7a54-754b-4cc4-8fa3-aae1ee9e2fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:31.160754 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f7a54-754b-4cc4-8fa3-aae1ee9e2fa1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:31.184932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f20f7a54-754b-4cc4-8fa3-aae1ee9e2fa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:31.184932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:31.184932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:31.184932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:31.184932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:31.184932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:31.184932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:31.184932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:31.184932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:31.184932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:31.184932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:31.184932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:31.184932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:31.184932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:31.184932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:31.186147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:31.187260 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:31.187260 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:31.187260 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:31.187260 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:31.187260 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 316/621] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:31.188938 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f7a54-754b-4cc4-8fa3-aae1ee9e2fa1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:31.211362 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9693ee7-e6e9-413c-b70b-a746cb8562a5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:31.253513 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece30e4-fc52-4910-b30c-f231899782ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:31.254442 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece30e4-fc52-4910-b30c-f231899782ec None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:31.254947 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece30e4-fc52-4910-b30c-f231899782ec None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:31.255317 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece30e4-fc52-4910-b30c-f231899782ec None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:31.256296 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece30e4-fc52-4910-b30c-f231899782ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:31.256715 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece30e4-fc52-4910-b30c-f231899782ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:31.258433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece30e4-fc52-4910-b30c-f231899782ec None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:31.280203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 306/622] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jul 25 16:05:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:31.281293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece30e4-fc52-4910-b30c-f231899782ec None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:31.316656 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:31.328101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f7a54-754b-4cc4-8fa3-aae1ee9e2fa1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:31.371892 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9ba26-57e8-495c-b3e4-95c4e0ae34ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:31.372886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9ba26-57e8-495c-b3e4-95c4e0ae34ca None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:31.373265 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9ba26-57e8-495c-b3e4-95c4e0ae34ca None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:31.373635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9ba26-57e8-495c-b3e4-95c4e0ae34ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:31.385903 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9ba26-57e8-495c-b3e4-95c4e0ae34ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:31.394487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f2f9ba26-57e8-495c-b3e4-95c4e0ae34ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:31.394487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:31.394487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:31.394487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:31.394487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:31.394487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:31.394487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:31.394487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:31.394487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:31.394487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:31.394487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:31.394487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:31.394487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:31.394487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:31.394487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:31.394487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:31.396370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:31.396370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:31.396370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:31.396370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:31.396370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:31.396370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:31.396370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:31.396370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:31.396370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:31.396370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:31.396370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:31.396370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:31.396370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:31.396370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:31.396370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:31.396370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:31.398494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:31.398494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:31.398494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:31.398494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:31.398494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:31.398494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:31.398494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:31.398494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:31.398494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:31.398494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:31.398494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:31.398494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:31.405201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 317/623] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:31.405201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9ba26-57e8-495c-b3e4-95c4e0ae34ca None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:31.411059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece30e4-fc52-4910-b30c-f231899782ec None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:31.416791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:31.455787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd956e2-797c-4ee5-a606-1cf61d414f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:31.456450 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd956e2-797c-4ee5-a606-1cf61d414f7b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:31.456734 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd956e2-797c-4ee5-a606-1cf61d414f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:31.457010 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd956e2-797c-4ee5-a606-1cf61d414f7b None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:31.457785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd956e2-797c-4ee5-a606-1cf61d414f7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:31.458093 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd956e2-797c-4ee5-a606-1cf61d414f7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:31.459473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd956e2-797c-4ee5-a606-1cf61d414f7b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:31.473040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 307/624] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:31.473891 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd956e2-797c-4ee5-a606-1cf61d414f7b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:31.541598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9ba26-57e8-495c-b3e4-95c4e0ae34ca None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:31.582967 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:31.585526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a0b4a-915f-4062-93ae-87d5ecd0eb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:31.586678 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a0b4a-915f-4062-93ae-87d5ecd0eb41 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:31.586989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a0b4a-915f-4062-93ae-87d5ecd0eb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:31.587259 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a0b4a-915f-4062-93ae-87d5ecd0eb41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:31.598941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd956e2-797c-4ee5-a606-1cf61d414f7b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:31.600983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a0b4a-915f-4062-93ae-87d5ecd0eb41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:31.602557 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a0b4a-915f-4062-93ae-87d5ecd0eb41 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:31.627592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d21a0b4a-915f-4062-93ae-87d5ecd0eb41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:31.627592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:31.627592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:31.627592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:31.627592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:31.627592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:31.627592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:31.627592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:31.627592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:31.627592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:31.627592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:31.627592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:31.627592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:31.627592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:31.627592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:31.630168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:31.632278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:31.632278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:31.632278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:31.632278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:31.636424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 318/625] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:31.637322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a0b4a-915f-4062-93ae-87d5ecd0eb41 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:31.641002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f2682-24df-4d2f-80a0-8fc78e45c556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:31.641728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f2682-24df-4d2f-80a0-8fc78e45c556 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:31.642008 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f2682-24df-4d2f-80a0-8fc78e45c556 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:31.642951 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f2682-24df-4d2f-80a0-8fc78e45c556 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:31.643702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f2682-24df-4d2f-80a0-8fc78e45c556 None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:31.644058 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f2682-24df-4d2f-80a0-8fc78e45c556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:31.645537 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f2682-24df-4d2f-80a0-8fc78e45c556 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:31.655160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 308/626] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:31.656021 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f2682-24df-4d2f-80a0-8fc78e45c556 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:31.725920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:31.778257 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f2682-24df-4d2f-80a0-8fc78e45c556 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:31.793810 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a0b4a-915f-4062-93ae-87d5ecd0eb41 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:31.815190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa92120-7283-43b0-9a32-955f62df4d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:31.815948 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa92120-7283-43b0-9a32-955f62df4d38 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:31.816358 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa92120-7283-43b0-9a32-955f62df4d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:31.816697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa92120-7283-43b0-9a32-955f62df4d38 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:31.817592 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa92120-7283-43b0-9a32-955f62df4d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:31.818018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa92120-7283-43b0-9a32-955f62df4d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:31.819752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa92120-7283-43b0-9a32-955f62df4d38 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:31.839781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 309/627] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:31.839781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa92120-7283-43b0-9a32-955f62df4d38 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:31.847108 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:31.864773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a44a1-a3d2-40be-9ced-6ae6c4ab8351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:31.865977 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a44a1-a3d2-40be-9ced-6ae6c4ab8351 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:31.866489 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a44a1-a3d2-40be-9ced-6ae6c4ab8351 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:31.867115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a44a1-a3d2-40be-9ced-6ae6c4ab8351 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:31.877284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a44a1-a3d2-40be-9ced-6ae6c4ab8351 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:31.878902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a44a1-a3d2-40be-9ced-6ae6c4ab8351 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:31.896068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b91a44a1-a3d2-40be-9ced-6ae6c4ab8351 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:05:31.896068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:31.896068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:31.896068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:31.896068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:31.896068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:31.896068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:31.896068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:31.896068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:31.896068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:31.896068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:31.896068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:31.896068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:31.896068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:31.896068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:31.896068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:31.897285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:31.898882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:31.898882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:31.898882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:31.898882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:31.898882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:31.898882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:31.898882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:31.898882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:31.898882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:05:31.898882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:31.903356 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 319/628] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 25 16:05:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:31.904340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a44a1-a3d2-40be-9ced-6ae6c4ab8351 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:31.969196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa92120-7283-43b0-9a32-955f62df4d38 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:32.006421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f6484-183a-4636-98be-92d0e4d1080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:32.007160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f6484-183a-4636-98be-92d0e4d1080f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:32.007438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f6484-183a-4636-98be-92d0e4d1080f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:32.007709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f6484-183a-4636-98be-92d0e4d1080f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:32.018629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f6484-183a-4636-98be-92d0e4d1080f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:32.020651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f6484-183a-4636-98be-92d0e4d1080f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:32.026523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a44a1-a3d2-40be-9ced-6ae6c4ab8351 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:32.039867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-a93f6484-183a-4636-98be-92d0e4d1080f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:32.039867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:32.039867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:32.039867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:32.039867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:32.039867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:32.039867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:32.039867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:32.039867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:32.039867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:32.039867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:32.039867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:32.039867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:32.039867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:32.039867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:32.040943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:32.041924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:32.041924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:32.041924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:32.041924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:32.045770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 310/629] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:32.046695 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f6484-183a-4636-98be-92d0e4d1080f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:32.066736 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:32.089799 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48025be8-7daa-4c5a-96dd-92e8dca44213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:32.091759 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48025be8-7daa-4c5a-96dd-92e8dca44213 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:32.092804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48025be8-7daa-4c5a-96dd-92e8dca44213 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:32.093610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48025be8-7daa-4c5a-96dd-92e8dca44213 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:32.107284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48025be8-7daa-4c5a-96dd-92e8dca44213 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:32.110747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48025be8-7daa-4c5a-96dd-92e8dca44213 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:32.122259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:32.135647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-48025be8-7daa-4c5a-96dd-92e8dca44213 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:32.135647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:32.135647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:32.135647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:32.135647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:32.135647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:32.135647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:32.135647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:32.135647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:32.135647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:32.135647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:32.135647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:32.135647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:32.135647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:32.135647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:32.136710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:32.137664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:32.137664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:32.137664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:32.137664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:32.137664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:32.137664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:32.137664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:32.137664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:32.140231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 320/630] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:32.141453 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48025be8-7daa-4c5a-96dd-92e8dca44213 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:32.172890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f6484-183a-4636-98be-92d0e4d1080f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:32.213284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da3aca-c517-43aa-b81f-cc873737ee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:32.214056 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3aca-c517-43aa-b81f-cc873737ee02 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:32.214656 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3aca-c517-43aa-b81f-cc873737ee02 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:32.214774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da3aca-c517-43aa-b81f-cc873737ee02 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:32.215597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da3aca-c517-43aa-b81f-cc873737ee02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:32.215926 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da3aca-c517-43aa-b81f-cc873737ee02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:32.217609 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da3aca-c517-43aa-b81f-cc873737ee02 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:32.239402 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 311/631] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 25 16:05:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:32.240494 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da3aca-c517-43aa-b81f-cc873737ee02 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:32.265336 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48025be8-7daa-4c5a-96dd-92e8dca44213 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:32.306792 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813b513-3836-4b1d-83cb-26c0320cd76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:32.307940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813b513-3836-4b1d-83cb-26c0320cd76d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:32.308574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813b513-3836-4b1d-83cb-26c0320cd76d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:32.309157 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813b513-3836-4b1d-83cb-26c0320cd76d None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:32.310415 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813b513-3836-4b1d-83cb-26c0320cd76d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:32.311050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813b513-3836-4b1d-83cb-26c0320cd76d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:32.312936 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813b513-3836-4b1d-83cb-26c0320cd76d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:32.327629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 321/632] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:32.329076 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813b513-3836-4b1d-83cb-26c0320cd76d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:32.366693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da3aca-c517-43aa-b81f-cc873737ee02 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:32.378401 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:32.393683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:32.410649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fddc3-c4d6-4598-bc26-01e52e79984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:32.411725 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fddc3-c4d6-4598-bc26-01e52e79984e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:32.411725 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fddc3-c4d6-4598-bc26-01e52e79984e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:32.412395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fddc3-c4d6-4598-bc26-01e52e79984e None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:32.412790 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fddc3-c4d6-4598-bc26-01e52e79984e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:32.413105 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fddc3-c4d6-4598-bc26-01e52e79984e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:32.414599 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fddc3-c4d6-4598-bc26-01e52e79984e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:32.434027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 312/633] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:32.435065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fddc3-c4d6-4598-bc26-01e52e79984e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:32.465652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813b513-3836-4b1d-83cb-26c0320cd76d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:32.513205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12c18a-8c05-43da-bcb6-31476523de5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:32.514533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12c18a-8c05-43da-bcb6-31476523de5f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:32.515089 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12c18a-8c05-43da-bcb6-31476523de5f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:32.515872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12c18a-8c05-43da-bcb6-31476523de5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:32.551176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fddc3-c4d6-4598-bc26-01e52e79984e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:32.588434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9253cb8-c01a-4e86-9aed-b67bf372d5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:32.589300 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9253cb8-c01a-4e86-9aed-b67bf372d5da None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:32.589585 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9253cb8-c01a-4e86-9aed-b67bf372d5da None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:32.589860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9253cb8-c01a-4e86-9aed-b67bf372d5da None admin] PATH_INFO: `/v3/users/glance` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:32.599010 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9253cb8-c01a-4e86-9aed-b67bf372d5da None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:32.600676 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9253cb8-c01a-4e86-9aed-b67bf372d5da None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:32.616394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-d9253cb8-c01a-4e86-9aed-b67bf372d5da None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 16:05:32.616394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:32.616394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:32.616394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:32.616394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:32.616394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:32.616394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:32.616394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:32.616394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:32.616394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:32.616394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:32.616394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:32.616394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:32.616394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:32.616394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:32.616394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:32.618171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:32.619746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:32.619746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:32.619746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:32.619746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:32.619746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:32.619746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:32.619746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:32.619746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:32.619746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 16:05:32.619746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:32.619746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 313/634] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:32.619746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9253cb8-c01a-4e86-9aed-b67bf372d5da None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:32.647921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12c18a-8c05-43da-bcb6-31476523de5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:32.652321 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12c18a-8c05-43da-bcb6-31476523de5f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:32.666928 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:32.705475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:32.768292 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 322/635] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:32.769235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12c18a-8c05-43da-bcb6-31476523de5f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:32.777080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9253cb8-c01a-4e86-9aed-b67bf372d5da None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:32.825434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e9cb2-05a8-477f-8c57-047f1aa11d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:32.826351 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e9cb2-05a8-477f-8c57-047f1aa11d19 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:32.826632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e9cb2-05a8-477f-8c57-047f1aa11d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:32.826905 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e9cb2-05a8-477f-8c57-047f1aa11d19 None admin] PATH_INFO: `/v3/projects/0c9d252e2e0347029d58192fab233f09/users/4dbc2609b13f45dc883ae18d3d056e76/roles/276de082c6c04d08a38361e8fea28a9a` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:32.842983 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e9cb2-05a8-477f-8c57-047f1aa11d19 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9d252e2e0347029d58192fab233f09, user_id=4dbc2609b13f45dc883ae18d3d056e76, role_id=276de082c6c04d08a38361e8fea28a9a)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:32.844495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e9cb2-05a8-477f-8c57-047f1aa11d19 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:32.874731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 314/636] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:05:32 2022] PUT /identity/v3/projects/0c9d252e2e0347029d58192fab233f09/users/4dbc2609b13f45dc883ae18d3d056e76/roles/276de082c6c04d08a38361e8fea28a9a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:05:32.874731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe2db5-3442-4fd2-8d48-68a60c4c866a None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:32.874731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe2db5-3442-4fd2-8d48-68a60c4c866a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:32.874731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe2db5-3442-4fd2-8d48-68a60c4c866a None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:32.874731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 315/637] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:32.874731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9bba9-050c-47d1-9dc9-eb8c33982ade None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:32.875418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9bba9-050c-47d1-9dc9-eb8c33982ade None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:32.875418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9bba9-050c-47d1-9dc9-eb8c33982ade None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:32.875418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 316/638] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:32.875418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9bba9-050c-47d1-9dc9-eb8c33982ade None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:32.889228 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12c18a-8c05-43da-bcb6-31476523de5f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:32.934587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29a6e4-ecad-4bf6-acb3-b9b5c6206e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:32.935323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29a6e4-ecad-4bf6-acb3-b9b5c6206e6c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:32.935597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29a6e4-ecad-4bf6-acb3-b9b5c6206e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:32.935877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29a6e4-ecad-4bf6-acb3-b9b5c6206e6c None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:32.936767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29a6e4-ecad-4bf6-acb3-b9b5c6206e6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:32.937078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29a6e4-ecad-4bf6-acb3-b9b5c6206e6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:32.938561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29a6e4-ecad-4bf6-acb3-b9b5c6206e6c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:32.958181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:32.968460 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 323/639] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jul 25 16:05:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:32.969974 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6ea04-5826-47f5-928d-20fdf9f355ec None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:32.970307 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6ea04-5826-47f5-928d-20fdf9f355ec None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:32.971117 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6ea04-5826-47f5-928d-20fdf9f355ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:32.988664 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:32.990126 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-53a6ea04-5826-47f5-928d-20fdf9f355ec None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:32.991396 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-53a6ea04-5826-47f5-928d-20fdf9f355ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:33.007507 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9bba9-050c-47d1-9dc9-eb8c33982ade None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:33.056310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c637265-ce75-4d7f-8921-48edffb1dca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:33.057694 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c637265-ce75-4d7f-8921-48edffb1dca7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:33.058131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c637265-ce75-4d7f-8921-48edffb1dca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:33.058583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c637265-ce75-4d7f-8921-48edffb1dca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:33.076147 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c637265-ce75-4d7f-8921-48edffb1dca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:33.078023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c637265-ce75-4d7f-8921-48edffb1dca7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:33.080715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 324/640] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:33.082257 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835d73c-8ec6-41c5-b09f-c3ac6272c221 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:33.082657 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835d73c-8ec6-41c5-b09f-c3ac6272c221 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:33.083031 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835d73c-8ec6-41c5-b09f-c3ac6272c221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:33.102211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-2c637265-ce75-4d7f-8921-48edffb1dca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:33.102211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:33.102211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:33.102211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:33.102211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:33.102211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:33.102211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:33.102211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:33.102211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:33.102211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:33.102211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:33.102211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:33.102211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:33.102211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:33.102211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:33.103661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:33.104976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:33.104976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:33.104976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:33.104976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:33.105257 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3835d73c-8ec6-41c5-b09f-c3ac6272c221 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:33.106568 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3835d73c-8ec6-41c5-b09f-c3ac6272c221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:33.111762 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 317/641] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:33.111762 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c637265-ce75-4d7f-8921-48edffb1dca7 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:33.187039 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 325/642] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:33.187039 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835d73c-8ec6-41c5-b09f-c3ac6272c221 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:33.273072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c637265-ce75-4d7f-8921-48edffb1dca7 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:33.278588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:33.319617 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a697ab5-a05b-45e1-928f-9c608aceec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:33.320626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a697ab5-a05b-45e1-928f-9c608aceec16 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:33.321079 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a697ab5-a05b-45e1-928f-9c608aceec16 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:33.321400 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a697ab5-a05b-45e1-928f-9c608aceec16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:33.332531 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835d73c-8ec6-41c5-b09f-c3ac6272c221 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:33.336608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:33.368077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187266a0-fd6a-4210-a7a6-ed7b7aa6565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:33.368786 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187266a0-fd6a-4210-a7a6-ed7b7aa6565d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:33.369075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187266a0-fd6a-4210-a7a6-ed7b7aa6565d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:33.369352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187266a0-fd6a-4210-a7a6-ed7b7aa6565d None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:33.370068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187266a0-fd6a-4210-a7a6-ed7b7aa6565d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:33.370382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187266a0-fd6a-4210-a7a6-ed7b7aa6565d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:33.371776 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187266a0-fd6a-4210-a7a6-ed7b7aa6565d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:33.384139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 326/643] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:33.385102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187266a0-fd6a-4210-a7a6-ed7b7aa6565d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:33.406304 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a697ab5-a05b-45e1-928f-9c608aceec16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:33.407992 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a697ab5-a05b-45e1-928f-9c608aceec16 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:33.499865 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187266a0-fd6a-4210-a7a6-ed7b7aa6565d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:33.516060 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 318/644] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:33.516971 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a697ab5-a05b-45e1-928f-9c608aceec16 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:33.535214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:33.555455 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266bd87-0956-4f33-9396-fe5b751b141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:33.556646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266bd87-0956-4f33-9396-fe5b751b141b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:33.557097 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266bd87-0956-4f33-9396-fe5b751b141b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:33.557552 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266bd87-0956-4f33-9396-fe5b751b141b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:33.570404 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:33.571021 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266bd87-0956-4f33-9396-fe5b751b141b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:33.578980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-5266bd87-0956-4f33-9396-fe5b751b141b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:33.578980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:33.578980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:33.578980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:33.578980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:33.578980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:33.578980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:33.578980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:33.578980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:33.578980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:33.578980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:33.578980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:33.578980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:33.578980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:33.578980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:33.578980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:33.580970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:33.580970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:33.580970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:33.580970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:33.580970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:33.580970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:33.580970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:33.580970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:33.580970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:33.580970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:33.580970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:33.580970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:33.580970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:33.580970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:33.580970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:33.580970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:33.582057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:33.582057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:33.582057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:33.582057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:33.582057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:33.582057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:33.582057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:33.582057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:33.582057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:33.582057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:33.582057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:33.582057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:33.584808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 327/645] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:33.586036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266bd87-0956-4f33-9396-fe5b751b141b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:33.649576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a697ab5-a05b-45e1-928f-9c608aceec16 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:33.688967 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a166f-0ac4-466e-89bd-0c41bb80d4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:33.690515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a166f-0ac4-466e-89bd-0c41bb80d4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:33.690808 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a166f-0ac4-466e-89bd-0c41bb80d4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:33.691088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a166f-0ac4-466e-89bd-0c41bb80d4b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:33.703377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a166f-0ac4-466e-89bd-0c41bb80d4b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:33.703922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266bd87-0956-4f33-9396-fe5b751b141b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:33.711492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-378a166f-0ac4-466e-89bd-0c41bb80d4b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:33.711492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:33.711492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:33.711492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:33.711492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:33.711492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:33.711492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:33.711492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:33.711492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:33.711492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:33.711492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:33.711492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:33.711492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:33.711492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:33.711492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:33.711492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:33.712526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:33.712526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:33.712526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:33.712526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:33.712526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:33.712526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:33.712526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:33.712526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:33.712526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:33.712526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:33.712526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:33.712526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:33.712526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:33.712526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:33.712526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:33.712526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:33.713467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:33.713467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:33.713467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:33.713467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:33.713467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:33.713467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:33.713467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:33.713467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:33.713467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:33.713467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:33.713467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:33.713467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:33.713467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 319/646] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:33.714181 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a166f-0ac4-466e-89bd-0c41bb80d4b8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:33.750163 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afe57c-ec72-464e-ae69-18b1d636ea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:33.751257 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afe57c-ec72-464e-ae69-18b1d636ea90 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:33.751636 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afe57c-ec72-464e-ae69-18b1d636ea90 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:33.752471 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afe57c-ec72-464e-ae69-18b1d636ea90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:33.763071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afe57c-ec72-464e-ae69-18b1d636ea90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:33.764581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afe57c-ec72-464e-ae69-18b1d636ea90 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:33.784215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d8afe57c-ec72-464e-ae69-18b1d636ea90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:33.784215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:33.784215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:33.784215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:33.784215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:33.784215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:33.784215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:33.784215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:33.784215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:33.784215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:33.784215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:33.784215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:33.784215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:33.784215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:33.784215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:33.785188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:33.786935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:33.786935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:33.786935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:33.786935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:33.786935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:33.786935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:33.786935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:33.786935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:33.786935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 328/647] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:33.786935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afe57c-ec72-464e-ae69-18b1d636ea90 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:33.836155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:33.848729 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a166f-0ac4-466e-89bd-0c41bb80d4b8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:33.850550 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:33.888794 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a0393-e0a0-462b-8020-b4735fab64f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:33.889591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a0393-e0a0-462b-8020-b4735fab64f6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:33.889872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a0393-e0a0-462b-8020-b4735fab64f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:33.890151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a0393-e0a0-462b-8020-b4735fab64f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:33.901336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a0393-e0a0-462b-8020-b4735fab64f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:33.902855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afe57c-ec72-464e-ae69-18b1d636ea90 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:33.903353 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a0393-e0a0-462b-8020-b4735fab64f6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:33.921572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-ee4a0393-e0a0-462b-8020-b4735fab64f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:33.921572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:33.921572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:33.921572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:33.921572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:33.921572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:33.921572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:33.921572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:33.921572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:33.921572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:33.921572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:33.921572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:33.921572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:33.921572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:33.921572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:33.922488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:33.923872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:33.923872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:33.923872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:33.923872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:33.927879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 320/648] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:33.928757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a0393-e0a0-462b-8020-b4735fab64f6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:33.944282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb637b7-1b41-4640-adae-45bae73a29b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:33.945081 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb637b7-1b41-4640-adae-45bae73a29b8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:33.945366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb637b7-1b41-4640-adae-45bae73a29b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:33.945759 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb637b7-1b41-4640-adae-45bae73a29b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:33.946497 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb637b7-1b41-4640-adae-45bae73a29b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:33.946810 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb637b7-1b41-4640-adae-45bae73a29b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:33.948640 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb637b7-1b41-4640-adae-45bae73a29b8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:33.961950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 329/649] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:33.962870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb637b7-1b41-4640-adae-45bae73a29b8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:34.039062 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a0393-e0a0-462b-8020-b4735fab64f6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:34.075229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb637b7-1b41-4640-adae-45bae73a29b8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:34.076943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:34.077139 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762097d-d426-4466-b1cc-ef157892e2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:34.077912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762097d-d426-4466-b1cc-ef157892e2ee None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:34.078263 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762097d-d426-4466-b1cc-ef157892e2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:34.078608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762097d-d426-4466-b1cc-ef157892e2ee None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:34.079814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762097d-d426-4466-b1cc-ef157892e2ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:34.080302 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762097d-d426-4466-b1cc-ef157892e2ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:34.081798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762097d-d426-4466-b1cc-ef157892e2ee None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:34.090596 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 321/650] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:34.096437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762097d-d426-4466-b1cc-ef157892e2ee None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:34.113805 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201cf72-76a0-4c5c-90e9-c558e18b0878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:34.114379 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201cf72-76a0-4c5c-90e9-c558e18b0878 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:34.114661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201cf72-76a0-4c5c-90e9-c558e18b0878 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:34.114933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201cf72-76a0-4c5c-90e9-c558e18b0878 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:34.115745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201cf72-76a0-4c5c-90e9-c558e18b0878 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:34.116007 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201cf72-76a0-4c5c-90e9-c558e18b0878 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:34.117398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:34.117511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201cf72-76a0-4c5c-90e9-c558e18b0878 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:34.130483 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 330/651] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:34.131150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201cf72-76a0-4c5c-90e9-c558e18b0878 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:34.210858 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762097d-d426-4466-b1cc-ef157892e2ee None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:34.244012 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201cf72-76a0-4c5c-90e9-c558e18b0878 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:34.252533 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2955ace-fb40-43b3-9809-9eb3b68388b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:34.253194 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2955ace-fb40-43b3-9809-9eb3b68388b2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:34.253473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2955ace-fb40-43b3-9809-9eb3b68388b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:34.253742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2955ace-fb40-43b3-9809-9eb3b68388b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:34.254451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2955ace-fb40-43b3-9809-9eb3b68388b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:34.254757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2955ace-fb40-43b3-9809-9eb3b68388b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:34.256106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2955ace-fb40-43b3-9809-9eb3b68388b2 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:34.268287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 322/652] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:34.268660 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2955ace-fb40-43b3-9809-9eb3b68388b2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:34.288967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62586393-9299-43fd-b144-2fd44b4aae07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:34.289767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62586393-9299-43fd-b144-2fd44b4aae07 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:34.290032 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62586393-9299-43fd-b144-2fd44b4aae07 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:34.290300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62586393-9299-43fd-b144-2fd44b4aae07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:34.302103 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62586393-9299-43fd-b144-2fd44b4aae07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:34.303541 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62586393-9299-43fd-b144-2fd44b4aae07 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:34.321845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-62586393-9299-43fd-b144-2fd44b4aae07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:34.321845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:34.321845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:34.321845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:34.321845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:34.321845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:34.321845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:34.321845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:34.321845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:34.321845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:34.321845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:34.321845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:34.321845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:34.321845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:34.321845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:34.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:34.323906 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:34.323906 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:34.323906 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:34.323906 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:34.323906 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 331/653] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:34.324396 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62586393-9299-43fd-b144-2fd44b4aae07 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:34.341049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:34.361468 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:34.390923 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2955ace-fb40-43b3-9809-9eb3b68388b2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:34.430037 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed6448-a69a-4c83-afb7-0fec94a49875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:34.430830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed6448-a69a-4c83-afb7-0fec94a49875 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:34.431111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed6448-a69a-4c83-afb7-0fec94a49875 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:34.431381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed6448-a69a-4c83-afb7-0fec94a49875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:34.434951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62586393-9299-43fd-b144-2fd44b4aae07 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:34.441972 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed6448-a69a-4c83-afb7-0fec94a49875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:34.443422 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed6448-a69a-4c83-afb7-0fec94a49875 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:34.463785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-60ed6448-a69a-4c83-afb7-0fec94a49875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:34.463785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:34.463785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:34.463785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:34.463785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:34.463785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:34.463785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:34.463785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:34.463785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:34.463785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:34.463785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:34.463785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:34.463785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:34.463785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:34.463785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:34.464941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:34.465908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:34.465908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:34.465908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:34.465908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:34.465908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 323/654] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:34.465908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed6448-a69a-4c83-afb7-0fec94a49875 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:34.477953 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27052ad9-cecc-4ecd-9198-fbd6a0521bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:34.478621 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27052ad9-cecc-4ecd-9198-fbd6a0521bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:34.478918 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27052ad9-cecc-4ecd-9198-fbd6a0521bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:34.479222 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27052ad9-cecc-4ecd-9198-fbd6a0521bb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:34.480056 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27052ad9-cecc-4ecd-9198-fbd6a0521bb1 None admin] RBAC: Adding query filter params (role.id=276de082c6c04d08a38361e8fea28a9a, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=c455f8d340444b068249213ff504895e) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:34.480404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27052ad9-cecc-4ecd-9198-fbd6a0521bb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:34.481832 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27052ad9-cecc-4ecd-9198-fbd6a0521bb1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:34.488507 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 332/655] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:05:34 2022] GET /identity/v3/role_assignments?user.id=c455f8d340444b068249213ff504895e&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=276de082c6c04d08a38361e8fea28a9a => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:34.501293 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27052ad9-cecc-4ecd-9198-fbd6a0521bb1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:34.581785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed6448-a69a-4c83-afb7-0fec94a49875 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:34.613772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:34.625845 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0cc4e-6565-4a23-97d5-6c9088f04b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:34.627469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0cc4e-6565-4a23-97d5-6c9088f04b47 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:34.627837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0cc4e-6565-4a23-97d5-6c9088f04b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:34.628202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0cc4e-6565-4a23-97d5-6c9088f04b47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:34.629579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:34.637404 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0cc4e-6565-4a23-97d5-6c9088f04b47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:34.639207 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0cc4e-6565-4a23-97d5-6c9088f04b47 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:34.655830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-59f0cc4e-6565-4a23-97d5-6c9088f04b47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:34.655830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:34.655830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:34.655830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:34.655830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:34.655830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:34.655830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:34.655830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:34.655830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:34.655830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:34.655830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:34.655830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:34.655830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:34.655830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:34.655830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:34.656961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:34.657976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:34.657976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:34.657976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:34.657976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:34.657976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:34.657976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:34.657976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:34.657976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:34.660702 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27052ad9-cecc-4ecd-9198-fbd6a0521bb1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:34.662755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 324/656] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:34.664508 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0cc4e-6565-4a23-97d5-6c9088f04b47 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:34.701156 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17ce10-bf8e-498e-8d1b-e2d94e422ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:34.702875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17ce10-bf8e-498e-8d1b-e2d94e422ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:34.702875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17ce10-bf8e-498e-8d1b-e2d94e422ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:34.702875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17ce10-bf8e-498e-8d1b-e2d94e422ae2 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:34.703127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17ce10-bf8e-498e-8d1b-e2d94e422ae2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:34.703434 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17ce10-bf8e-498e-8d1b-e2d94e422ae2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:34.706211 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17ce10-bf8e-498e-8d1b-e2d94e422ae2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:34.720760 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 333/657] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:34.721628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17ce10-bf8e-498e-8d1b-e2d94e422ae2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:34.796098 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0cc4e-6565-4a23-97d5-6c9088f04b47 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:34.844551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad14f07-f24a-4db9-b14f-b5b6780e421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:34.846102 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad14f07-f24a-4db9-b14f-b5b6780e421f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:34.846385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad14f07-f24a-4db9-b14f-b5b6780e421f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:34.846661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad14f07-f24a-4db9-b14f-b5b6780e421f None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:34.847412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad14f07-f24a-4db9-b14f-b5b6780e421f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:34.847713 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad14f07-f24a-4db9-b14f-b5b6780e421f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:34.849173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad14f07-f24a-4db9-b14f-b5b6780e421f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:34.864209 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 325/658] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:34.865053 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad14f07-f24a-4db9-b14f-b5b6780e421f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:34.870627 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17ce10-bf8e-498e-8d1b-e2d94e422ae2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:34.918322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170afda-6f71-4734-a646-aed80f63a3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:34.919253 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170afda-6f71-4734-a646-aed80f63a3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:34.919966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170afda-6f71-4734-a646-aed80f63a3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:34.920283 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170afda-6f71-4734-a646-aed80f63a3a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:34.921421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170afda-6f71-4734-a646-aed80f63a3a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:34.921737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170afda-6f71-4734-a646-aed80f63a3a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:34.922346 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:34.923399 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170afda-6f71-4734-a646-aed80f63a3a2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:34.936126 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:34.941511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 334/659] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:34.942606 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170afda-6f71-4734-a646-aed80f63a3a2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:34.996895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad14f07-f24a-4db9-b14f-b5b6780e421f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:35.034377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f732c-6c77-41eb-a878-ffab1cbb88b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:35.035337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f732c-6c77-41eb-a878-ffab1cbb88b3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:35.035625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f732c-6c77-41eb-a878-ffab1cbb88b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:35.035940 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f732c-6c77-41eb-a878-ffab1cbb88b3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:35.044771 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f732c-6c77-41eb-a878-ffab1cbb88b3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:35.046370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f732c-6c77-41eb-a878-ffab1cbb88b3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:35.058029 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170afda-6f71-4734-a646-aed80f63a3a2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:35.063578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-e61f732c-6c77-41eb-a878-ffab1cbb88b3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 16:05:35.063578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:35.063578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:35.063578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:35.063578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:35.063578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:35.063578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:35.063578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:35.063578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:35.063578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:35.063578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:35.063578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:35.063578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:35.063578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:35.063578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:35.063578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:35.064636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:35.070437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:35.070437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:35.070437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:35.070437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:35.070437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:35.070437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:35.070437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:35.070437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:35.070437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 16:05:35.070437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:35.070437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 326/660] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:35.070437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f732c-6c77-41eb-a878-ffab1cbb88b3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:35.093357 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b62515-31ea-472a-9212-857f5eea127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:35.094178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b62515-31ea-472a-9212-857f5eea127f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:35.094459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b62515-31ea-472a-9212-857f5eea127f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:35.094741 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b62515-31ea-472a-9212-857f5eea127f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:35.102987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b62515-31ea-472a-9212-857f5eea127f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:35.104452 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b62515-31ea-472a-9212-857f5eea127f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:35.120352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-70b62515-31ea-472a-9212-857f5eea127f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 16:05:35.120352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:35.120352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:35.120352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:35.120352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:35.120352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:35.120352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:35.120352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:35.120352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:35.120352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:35.120352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:35.120352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:35.120352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:35.120352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:35.120352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:35.120352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:35.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:35.128502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:35.128502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:35.128502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:35.128502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:35.128502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:35.128502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:35.128502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:35.128502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:35.128502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 16:05:35.128502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:35.128502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 335/661] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:35.128502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75c0b0-2f01-4004-abe0-c7f83cf226fa None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:35.128502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75c0b0-2f01-4004-abe0-c7f83cf226fa None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:35.129841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75c0b0-2f01-4004-abe0-c7f83cf226fa None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:35.129841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 336/662] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:35.129841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75c0b0-2f01-4004-abe0-c7f83cf226fa None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:35.191337 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:35.193783 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f732c-6c77-41eb-a878-ffab1cbb88b3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:35.204688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:35.237108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75c0b0-2f01-4004-abe0-c7f83cf226fa None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:35.237810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8599d-25cf-4719-8c66-bddbd697f52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:35.238690 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8599d-25cf-4719-8c66-bddbd697f52f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:35.239125 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8599d-25cf-4719-8c66-bddbd697f52f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:35.239594 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8599d-25cf-4719-8c66-bddbd697f52f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:35.240622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8599d-25cf-4719-8c66-bddbd697f52f None admin] RBAC: Adding query filter params (role.id=276de082c6c04d08a38361e8fea28a9a, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=623c97746d304c6ba971e79e4dbeb730) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:35.241132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8599d-25cf-4719-8c66-bddbd697f52f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:35.242741 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8599d-25cf-4719-8c66-bddbd697f52f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:35.249385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 327/663] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:05:35 2022] GET /identity/v3/role_assignments?user.id=623c97746d304c6ba971e79e4dbeb730&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=276de082c6c04d08a38361e8fea28a9a => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:35.250273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8599d-25cf-4719-8c66-bddbd697f52f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:35.287875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85129e45-ea1c-4bd8-99bb-84bef3ca30d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:35.289213 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85129e45-ea1c-4bd8-99bb-84bef3ca30d7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:35.289570 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85129e45-ea1c-4bd8-99bb-84bef3ca30d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:35.289926 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85129e45-ea1c-4bd8-99bb-84bef3ca30d7 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:35.290907 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85129e45-ea1c-4bd8-99bb-84bef3ca30d7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:35.291315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85129e45-ea1c-4bd8-99bb-84bef3ca30d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:35.293012 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85129e45-ea1c-4bd8-99bb-84bef3ca30d7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:35.316388 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 337/664] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Jul 25 16:05:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:35.318155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e9f9a-99ac-4045-8624-398efd80fe84 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:35.318516 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e9f9a-99ac-4045-8624-398efd80fe84 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:35.318865 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e9f9a-99ac-4045-8624-398efd80fe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:35.339367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c25e9f9a-99ac-4045-8624-398efd80fe84 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:35.340650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c25e9f9a-99ac-4045-8624-398efd80fe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:35.400813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8599d-25cf-4719-8c66-bddbd697f52f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:35.423352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 338/665] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:35.424389 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e9f9a-99ac-4045-8624-398efd80fe84 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:35.445502 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2cbaa-2981-4114-80dc-f96ad0574ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:35.446239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2cbaa-2981-4114-80dc-f96ad0574ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:35.446523 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2cbaa-2981-4114-80dc-f96ad0574ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:35.446846 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2cbaa-2981-4114-80dc-f96ad0574ec5 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:35.447685 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2cbaa-2981-4114-80dc-f96ad0574ec5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:35.448017 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2cbaa-2981-4114-80dc-f96ad0574ec5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:35.449913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2cbaa-2981-4114-80dc-f96ad0574ec5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:35.472713 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 328/666] 10.222.0.70 () {56 vars in 1139 bytes} [Mon Jul 25 16:05:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:35.473661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2cbaa-2981-4114-80dc-f96ad0574ec5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:35.484705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:35.514197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:35.547166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e9f9a-99ac-4045-8624-398efd80fe84 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:35.585009 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd5a1e-d936-4edf-82d4-c8f9429d072e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:35.585668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd5a1e-d936-4edf-82d4-c8f9429d072e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:35.585948 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd5a1e-d936-4edf-82d4-c8f9429d072e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:35.586219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd5a1e-d936-4edf-82d4-c8f9429d072e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:35.593975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2cbaa-2981-4114-80dc-f96ad0574ec5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:35.649511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932dccd-e910-420f-9779-7df6f26d0d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:35.650577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932dccd-e910-420f-9779-7df6f26d0d2f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:35.651332 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932dccd-e910-420f-9779-7df6f26d0d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:35.651551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932dccd-e910-420f-9779-7df6f26d0d2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:35.666291 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932dccd-e910-420f-9779-7df6f26d0d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:35.666463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd5a1e-d936-4edf-82d4-c8f9429d072e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:35.667934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd5a1e-d936-4edf-82d4-c8f9429d072e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:35.675620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-8932dccd-e910-420f-9779-7df6f26d0d2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:35.675620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:35.675620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:35.675620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:35.675620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:35.675620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:35.675620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:35.675620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:35.675620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:35.675620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:35.675620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:35.675620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:35.675620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:35.675620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:35.675620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:35.675620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:35.676601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:35.676601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:35.676601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:35.676601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:35.676601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:35.676601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:35.676601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:35.676601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:35.676601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:35.676601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:35.676601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:35.676601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:35.676601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:35.676601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:35.676601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:35.676601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:35.677413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:35.677413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:35.677413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:35.677413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:35.677413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:35.677413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:35.677413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:35.677413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:35.677413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:35.677413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:35.677413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:35.677413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:35.678024 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 329/667] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:35.680699 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932dccd-e910-420f-9779-7df6f26d0d2f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:35.725956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:35.791243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 339/668] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:35.792151 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd5a1e-d936-4edf-82d4-c8f9429d072e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:35.937894 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:35.945185 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd5a1e-d936-4edf-82d4-c8f9429d072e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:35.954324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932dccd-e910-420f-9779-7df6f26d0d2f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:36.002892 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a44fd0-0109-446d-9d32-d4c56215e340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:36.004041 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a44fd0-0109-446d-9d32-d4c56215e340 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:36.004725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a44fd0-0109-446d-9d32-d4c56215e340 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:36.005233 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a44fd0-0109-446d-9d32-d4c56215e340 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:36.006353 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9bac2-abf2-4e73-8777-5280ac25d1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:36.006624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a44fd0-0109-446d-9d32-d4c56215e340 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:36.007143 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a44fd0-0109-446d-9d32-d4c56215e340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:36.007544 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9bac2-abf2-4e73-8777-5280ac25d1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:36.008035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9bac2-abf2-4e73-8777-5280ac25d1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:36.008518 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9bac2-abf2-4e73-8777-5280ac25d1f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:36.009840 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a44fd0-0109-446d-9d32-d4c56215e340 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:36.029609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 340/669] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:36.029609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a44fd0-0109-446d-9d32-d4c56215e340 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:36.049356 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:36.115550 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9bac2-abf2-4e73-8777-5280ac25d1f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:36.117163 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9bac2-abf2-4e73-8777-5280ac25d1f8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:36.180707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a44fd0-0109-446d-9d32-d4c56215e340 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:36.223407 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:36.231325 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628fc90-df28-4479-94b2-330ee8434cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:36.232650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628fc90-df28-4479-94b2-330ee8434cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:36.232940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628fc90-df28-4479-94b2-330ee8434cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:36.233220 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628fc90-df28-4479-94b2-330ee8434cf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:36.238414 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 330/670] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:36.239558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9bac2-abf2-4e73-8777-5280ac25d1f8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:36.250560 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628fc90-df28-4479-94b2-330ee8434cf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:36.252221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628fc90-df28-4479-94b2-330ee8434cf2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:36.271662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-0628fc90-df28-4479-94b2-330ee8434cf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:36.271662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:36.271662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:36.271662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:36.271662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:36.271662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:36.271662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:36.271662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:36.271662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:36.271662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:36.271662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:36.271662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:36.271662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:36.271662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:36.271662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:36.272632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:36.273486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:36.273486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:36.273486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:36.273486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:36.276925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 341/671] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:36.277876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628fc90-df28-4479-94b2-330ee8434cf2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:36.354721 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:36.358301 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9bac2-abf2-4e73-8777-5280ac25d1f8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:36.394192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b26c3e-150e-4219-97f0-472f388af09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:36.395387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b26c3e-150e-4219-97f0-472f388af09b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:36.395888 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b26c3e-150e-4219-97f0-472f388af09b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:36.396396 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b26c3e-150e-4219-97f0-472f388af09b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:36.405310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628fc90-df28-4479-94b2-330ee8434cf2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:36.408913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b26c3e-150e-4219-97f0-472f388af09b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:36.410870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b26c3e-150e-4219-97f0-472f388af09b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:36.430787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-82b26c3e-150e-4219-97f0-472f388af09b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:36.430787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:36.430787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:36.430787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:36.430787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:36.430787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:36.430787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:36.430787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:36.430787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:36.430787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:36.430787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:36.430787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:36.430787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:36.430787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:36.430787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:36.431724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:36.433044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:36.433044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:36.433044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:36.433044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:36.439900 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 331/672] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:36.441138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b26c3e-150e-4219-97f0-472f388af09b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:36.449725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ce679-af1c-498a-9672-c3d7c6790066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:36.450537 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ce679-af1c-498a-9672-c3d7c6790066 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:36.450825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ce679-af1c-498a-9672-c3d7c6790066 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:36.451106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ce679-af1c-498a-9672-c3d7c6790066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:36.463593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ce679-af1c-498a-9672-c3d7c6790066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:36.464967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ce679-af1c-498a-9672-c3d7c6790066 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:36.484609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-ad6ce679-af1c-498a-9672-c3d7c6790066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:36.484609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:36.484609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:36.484609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:36.484609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:36.484609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:36.484609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:36.484609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:36.484609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:36.484609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:36.484609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:36.484609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:36.484609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:36.484609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:36.484609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:36.485481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:36.486503 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:36.486503 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:36.486503 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:36.486503 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:36.490398 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 342/673] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:36.491380 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ce679-af1c-498a-9672-c3d7c6790066 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:36.492893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:36.555415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b26c3e-150e-4219-97f0-472f388af09b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:36.592024 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abe0a4-ba84-4a27-91ff-28976f3e94a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:36.592859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abe0a4-ba84-4a27-91ff-28976f3e94a9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:36.593236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abe0a4-ba84-4a27-91ff-28976f3e94a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:36.593802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abe0a4-ba84-4a27-91ff-28976f3e94a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:36.594418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abe0a4-ba84-4a27-91ff-28976f3e94a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:36.594958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abe0a4-ba84-4a27-91ff-28976f3e94a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:36.596376 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abe0a4-ba84-4a27-91ff-28976f3e94a9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:36.609114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 332/674] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:36.610219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abe0a4-ba84-4a27-91ff-28976f3e94a9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:36.616044 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ce679-af1c-498a-9672-c3d7c6790066 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:36.631920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:36.658133 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539c7b5-7992-4554-b6d8-55075bd13188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:36.659052 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539c7b5-7992-4554-b6d8-55075bd13188 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:36.659611 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539c7b5-7992-4554-b6d8-55075bd13188 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:36.660063 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539c7b5-7992-4554-b6d8-55075bd13188 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:36.661075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539c7b5-7992-4554-b6d8-55075bd13188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:36.661582 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539c7b5-7992-4554-b6d8-55075bd13188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:36.663197 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539c7b5-7992-4554-b6d8-55075bd13188 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:36.682206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 343/675] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:36.683373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539c7b5-7992-4554-b6d8-55075bd13188 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:36.715196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abe0a4-ba84-4a27-91ff-28976f3e94a9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:36.716927 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:36.751687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab99b0c-a5a8-4b4c-9e08-6473047922fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:36.752451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab99b0c-a5a8-4b4c-9e08-6473047922fa None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:36.753003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab99b0c-a5a8-4b4c-9e08-6473047922fa None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:36.753192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab99b0c-a5a8-4b4c-9e08-6473047922fa None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:36.754009 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab99b0c-a5a8-4b4c-9e08-6473047922fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:36.754414 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab99b0c-a5a8-4b4c-9e08-6473047922fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:36.755880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab99b0c-a5a8-4b4c-9e08-6473047922fa None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:36.768323 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 333/676] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:36.769273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab99b0c-a5a8-4b4c-9e08-6473047922fa None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:36.802329 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539c7b5-7992-4554-b6d8-55075bd13188 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:36.838138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6be6f9-7e17-4248-810c-010d8f85063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:36.838940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6be6f9-7e17-4248-810c-010d8f85063f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:36.839226 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6be6f9-7e17-4248-810c-010d8f85063f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:36.839506 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6be6f9-7e17-4248-810c-010d8f85063f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:36.847282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6be6f9-7e17-4248-810c-010d8f85063f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:36.848761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6be6f9-7e17-4248-810c-010d8f85063f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:36.864154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-df6be6f9-7e17-4248-810c-010d8f85063f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:36.864154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:36.864154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:36.864154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:36.864154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:36.864154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:36.864154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:36.864154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:36.864154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:36.864154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:36.864154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:36.864154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:36.864154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:36.864154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:36.864154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:36.865278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:36.866278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:36.866278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:36.866278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:36.866278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:36.866278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:36.866278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:36.866278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:36.866278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:36.866278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 344/677] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:36.867024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e028b-72fb-4a63-8a5b-d5d234ab6bdc None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:36.867311 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e028b-72fb-4a63-8a5b-d5d234ab6bdc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:36.867584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e028b-72fb-4a63-8a5b-d5d234ab6bdc None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:36.869065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 345/678] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:36.873582 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e028b-72fb-4a63-8a5b-d5d234ab6bdc None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:36.882572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab99b0c-a5a8-4b4c-9e08-6473047922fa None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:36.913422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:36.921582 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbf15c-944f-4701-b2ad-c2003ac671ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:36.922395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbf15c-944f-4701-b2ad-c2003ac671ea None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:36.922686 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbf15c-944f-4701-b2ad-c2003ac671ea None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:36.922962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbf15c-944f-4701-b2ad-c2003ac671ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:36.935921 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbf15c-944f-4701-b2ad-c2003ac671ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:36.937407 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbf15c-944f-4701-b2ad-c2003ac671ea None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:36.953013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-2efbf15c-944f-4701-b2ad-c2003ac671ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 16:05:36.953013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:36.953013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:36.953013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:36.953013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:36.953013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:36.953013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:36.953013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:36.953013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:36.953013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:36.953013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:36.953013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:36.953013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:36.953013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:36.953013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:36.953013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:36.954119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:36.955028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:36.955028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:36.955028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:36.955028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:36.955028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:36.955028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:36.955028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:36.955028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:36.955028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 16:05:36.955028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:36.955028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 334/679] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:05:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:36.955028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbf15c-944f-4701-b2ad-c2003ac671ea None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:36.981902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:36.999994 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e028b-72fb-4a63-8a5b-d5d234ab6bdc None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:37.038628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7a684-c288-455a-b942-b645bdce31fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:37.039381 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7a684-c288-455a-b942-b645bdce31fc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:37.039678 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7a684-c288-455a-b942-b645bdce31fc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:37.039950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7a684-c288-455a-b942-b645bdce31fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:37.047275 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7a684-c288-455a-b942-b645bdce31fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:37.049397 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7a684-c288-455a-b942-b645bdce31fc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:37.065214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-2bf7a684-c288-455a-b942-b645bdce31fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:37.065214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:37.065214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:37.065214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:37.065214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:37.065214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:37.065214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:37.065214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:37.065214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:37.065214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:37.065214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:37.065214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:37.065214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:37.065214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:37.065214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:37.066332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:37.067335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:37.067335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:37.067335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:37.067335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:37.067335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:37.067335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:37.067335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:37.067335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:37.067335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 346/680] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:37.068014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30403b-74c9-4817-93d4-ada666e424eb None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:37.068326 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30403b-74c9-4817-93d4-ada666e424eb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:37.068607 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30403b-74c9-4817-93d4-ada666e424eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:37.073978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbf15c-944f-4701-b2ad-c2003ac671ea None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:37.087552 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9c30403b-74c9-4817-93d4-ada666e424eb None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:37.088792 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9c30403b-74c9-4817-93d4-ada666e424eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:37.115581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e9e88-bb94-4585-ae79-472f305ea7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:37.116268 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e9e88-bb94-4585-ae79-472f305ea7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:37.116856 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e9e88-bb94-4585-ae79-472f305ea7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:37.116856 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e9e88-bb94-4585-ae79-472f305ea7a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:37.117611 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e9e88-bb94-4585-ae79-472f305ea7a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:37.117924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e9e88-bb94-4585-ae79-472f305ea7a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:37.119375 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e9e88-bb94-4585-ae79-472f305ea7a2 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:37.132176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 335/681] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:37.133059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e9e88-bb94-4585-ae79-472f305ea7a2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:37.172300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 347/682] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:37.172300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30403b-74c9-4817-93d4-ada666e424eb None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:37.199854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:37.242117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:37.265248 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e9e88-bb94-4585-ae79-472f305ea7a2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:37.312352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30403b-74c9-4817-93d4-ada666e424eb None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:37.318505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18c5e6-d143-4d0c-8ff4-828182cf3669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:37.319665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18c5e6-d143-4d0c-8ff4-828182cf3669 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:37.320204 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18c5e6-d143-4d0c-8ff4-828182cf3669 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:37.320772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18c5e6-d143-4d0c-8ff4-828182cf3669 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:37.322302 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18c5e6-d143-4d0c-8ff4-828182cf3669 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:37.322828 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18c5e6-d143-4d0c-8ff4-828182cf3669 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:37.325851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18c5e6-d143-4d0c-8ff4-828182cf3669 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:37.355140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 336/683] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jul 25 16:05:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:37.356468 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18c5e6-d143-4d0c-8ff4-828182cf3669 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:37.368132 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865087f-8acb-4f61-9ceb-b004a074246b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:37.369080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865087f-8acb-4f61-9ceb-b004a074246b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:37.370055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865087f-8acb-4f61-9ceb-b004a074246b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:37.370538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865087f-8acb-4f61-9ceb-b004a074246b None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:37.371487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865087f-8acb-4f61-9ceb-b004a074246b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:37.372350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865087f-8acb-4f61-9ceb-b004a074246b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:37.374550 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865087f-8acb-4f61-9ceb-b004a074246b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:37.391686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 348/684] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:37.393322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865087f-8acb-4f61-9ceb-b004a074246b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:37.483902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:37.490668 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18c5e6-d143-4d0c-8ff4-828182cf3669 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:37.504235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865087f-8acb-4f61-9ceb-b004a074246b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:37.524843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a57fcb-6f61-4f27-ba72-86e4330cbd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:37.525489 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a57fcb-6f61-4f27-ba72-86e4330cbd11 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:37.525770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a57fcb-6f61-4f27-ba72-86e4330cbd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:37.526038 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a57fcb-6f61-4f27-ba72-86e4330cbd11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:37.527109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a57fcb-6f61-4f27-ba72-86e4330cbd11 None admin] RBAC: Adding query filter params (role.id=276de082c6c04d08a38361e8fea28a9a, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=b419d3dba854407f97f16fac79910d25) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:37.527412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a57fcb-6f61-4f27-ba72-86e4330cbd11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:37.528872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a57fcb-6f61-4f27-ba72-86e4330cbd11 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:37.541203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 337/685] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:05:37 2022] GET /identity/v3/role_assignments?user.id=b419d3dba854407f97f16fac79910d25&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=276de082c6c04d08a38361e8fea28a9a => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:37.541203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a57fcb-6f61-4f27-ba72-86e4330cbd11 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:37.544849 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77f357-d953-4a7e-bef6-3ffcd7aa79b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:37.545597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:37.547213 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77f357-d953-4a7e-bef6-3ffcd7aa79b1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:37.547554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77f357-d953-4a7e-bef6-3ffcd7aa79b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:37.547907 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77f357-d953-4a7e-bef6-3ffcd7aa79b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:37.567137 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77f357-d953-4a7e-bef6-3ffcd7aa79b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:37.580766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-1b77f357-d953-4a7e-bef6-3ffcd7aa79b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:37.580766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:37.580766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:37.580766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:37.580766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:37.580766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:37.580766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:37.580766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:37.580766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:37.580766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:37.580766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:37.580766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:37.580766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:37.580766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:37.580766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:37.580766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:37.581775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:37.581775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:37.581775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:37.581775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:37.581775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:37.581775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:37.581775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:37.581775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:37.581775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:37.581775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:37.581775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:37.581775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:37.581775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:37.581775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:37.581775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:37.581775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:37.582575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:37.582575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:37.582575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:37.582575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:37.582575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:37.582575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:37.582575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:37.582575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:37.582575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:37.582575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:37.582575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:37.582575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:37.583205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 349/686] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:05:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:37.584182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77f357-d953-4a7e-bef6-3ffcd7aa79b1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:37.675099 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a57fcb-6f61-4f27-ba72-86e4330cbd11 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:37.716561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6f394-d0c7-4ab4-94ea-f46423cb3423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:37.717321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6f394-d0c7-4ab4-94ea-f46423cb3423 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:37.717613 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6f394-d0c7-4ab4-94ea-f46423cb3423 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:37.717891 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6f394-d0c7-4ab4-94ea-f46423cb3423 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:37.800234 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6f394-d0c7-4ab4-94ea-f46423cb3423 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:37.801931 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6f394-d0c7-4ab4-94ea-f46423cb3423 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:37.804797 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:37.853408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77f357-d953-4a7e-bef6-3ffcd7aa79b1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:37.903573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e1a64-3d69-46d9-81f8-d5bc1cd39bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:37.904301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1a64-3d69-46d9-81f8-d5bc1cd39bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:37.904675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1a64-3d69-46d9-81f8-d5bc1cd39bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:37.905024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1a64-3d69-46d9-81f8-d5bc1cd39bc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:37.906021 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e1a64-3d69-46d9-81f8-d5bc1cd39bc6 None admin] RBAC: Adding query filter params (role.id=276de082c6c04d08a38361e8fea28a9a, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=ad22a7d1e01c4c40b7cbefe971755148) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:37.906348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e1a64-3d69-46d9-81f8-d5bc1cd39bc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:37.908495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e1a64-3d69-46d9-81f8-d5bc1cd39bc6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:37.924349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 350/687] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:05:37 2022] GET /identity/v3/role_assignments?user.id=ad22a7d1e01c4c40b7cbefe971755148&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=276de082c6c04d08a38361e8fea28a9a => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:37.924349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53404190-86ca-4149-bf26-5aa19049d6ec None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:37.924349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53404190-86ca-4149-bf26-5aa19049d6ec None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:37.924349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53404190-86ca-4149-bf26-5aa19049d6ec None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:37.924349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 351/688] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:37.924349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53404190-86ca-4149-bf26-5aa19049d6ec None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:37.936642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:37.961189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 338/689] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:37.963497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6134b-fdae-41c2-a55b-d0a1d0a3d735 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:37.964050 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6134b-fdae-41c2-a55b-d0a1d0a3d735 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:37.964519 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6134b-fdae-41c2-a55b-d0a1d0a3d735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:37.989692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-00f6134b-fdae-41c2-a55b-d0a1d0a3d735 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:37.991851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-00f6134b-fdae-41c2-a55b-d0a1d0a3d735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:38.087650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53404190-86ca-4149-bf26-5aa19049d6ec None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:38.105087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 339/690] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:38.106207 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6134b-fdae-41c2-a55b-d0a1d0a3d735 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:38.142942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:38.146644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4af780-27dc-4c89-9478-6737b9b88e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:38.147625 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af780-27dc-4c89-9478-6737b9b88e48 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:38.148116 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af780-27dc-4c89-9478-6737b9b88e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:38.148653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af780-27dc-4c89-9478-6737b9b88e48 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:38.149608 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4af780-27dc-4c89-9478-6737b9b88e48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:38.150133 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4af780-27dc-4c89-9478-6737b9b88e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:38.152101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4af780-27dc-4c89-9478-6737b9b88e48 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:38.162645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 352/691] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:38.164044 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4af780-27dc-4c89-9478-6737b9b88e48 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:38.259940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:38.289869 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6134b-fdae-41c2-a55b-d0a1d0a3d735 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:38.302517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4af780-27dc-4c89-9478-6737b9b88e48 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:38.340786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290478b-6426-470a-b8e5-fb210481ba75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:38.341459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab8ade-e66c-49f9-8990-7902355b7032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:38.341658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290478b-6426-470a-b8e5-fb210481ba75 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:38.341937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290478b-6426-470a-b8e5-fb210481ba75 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:38.342196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290478b-6426-470a-b8e5-fb210481ba75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:38.342295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab8ade-e66c-49f9-8990-7902355b7032 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:38.342559 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab8ade-e66c-49f9-8990-7902355b7032 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:38.342836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab8ade-e66c-49f9-8990-7902355b7032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:38.354673 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab8ade-e66c-49f9-8990-7902355b7032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:38.355883 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290478b-6426-470a-b8e5-fb210481ba75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:38.356278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab8ade-e66c-49f9-8990-7902355b7032 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:38.357525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290478b-6426-470a-b8e5-fb210481ba75 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:38.382384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-3290478b-6426-470a-b8e5-fb210481ba75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:38.382384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:38.382384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:38.382384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:38.382384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:38.382384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:38.382384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:38.382384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:38.382384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:38.382384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:38.382384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:38.382384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:38.382384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:38.382384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:38.382384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:38.383324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:38.384688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:38.384688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:38.384688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:38.384688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:38.384909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a2ab8ade-e66c-49f9-8990-7902355b7032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:38.384909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:38.384909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:38.384909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:38.384909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:38.384909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:38.384909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:38.384909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:38.384909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:38.384909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:38.384909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:38.384909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:38.384909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:38.384909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:38.384909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:38.385740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:38.386593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:38.386593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:38.386593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:38.386593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:38.386809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 340/693] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:38.386880 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 353/693] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:38.386946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290478b-6426-470a-b8e5-fb210481ba75 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:38.401418 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab8ade-e66c-49f9-8990-7902355b7032 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:38.521994 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:38.542621 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290478b-6426-470a-b8e5-fb210481ba75 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:38.552227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab8ade-e66c-49f9-8990-7902355b7032 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:38.573730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:38.581775 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba033a7f-0050-4341-aaff-2ac8befa3d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:38.582675 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba033a7f-0050-4341-aaff-2ac8befa3d9d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:38.582958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba033a7f-0050-4341-aaff-2ac8befa3d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:38.583232 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba033a7f-0050-4341-aaff-2ac8befa3d9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:38.590344 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef327b8-8e51-4993-a410-3178f7c8e357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:38.591166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef327b8-8e51-4993-a410-3178f7c8e357 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:38.591551 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef327b8-8e51-4993-a410-3178f7c8e357 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:38.591928 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef327b8-8e51-4993-a410-3178f7c8e357 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:38.592833 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef327b8-8e51-4993-a410-3178f7c8e357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:38.593262 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef327b8-8e51-4993-a410-3178f7c8e357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:38.594693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba033a7f-0050-4341-aaff-2ac8befa3d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:38.595704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef327b8-8e51-4993-a410-3178f7c8e357 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:38.596729 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba033a7f-0050-4341-aaff-2ac8befa3d9d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:38.609527 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 354/694] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:38.610510 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef327b8-8e51-4993-a410-3178f7c8e357 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:38.615859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-ba033a7f-0050-4341-aaff-2ac8befa3d9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:38.615859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:38.615859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:38.615859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:38.615859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:38.615859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:38.615859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:38.615859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:38.615859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:38.615859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:38.615859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:38.615859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:38.615859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:38.615859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:38.615859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:38.616896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:38.617978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:38.617978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:38.617978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:38.617978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:38.617978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 341/695] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:38.618597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba033a7f-0050-4341-aaff-2ac8befa3d9d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:38.718920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef327b8-8e51-4993-a410-3178f7c8e357 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:38.727123 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba033a7f-0050-4341-aaff-2ac8befa3d9d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:38.764344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ff59d-e81b-49c3-a896-ef88b202cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:38.765162 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ff59d-e81b-49c3-a896-ef88b202cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:38.765444 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ff59d-e81b-49c3-a896-ef88b202cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:38.765717 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ff59d-e81b-49c3-a896-ef88b202cbf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:38.771895 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd198aa-3fcb-4587-a01d-6263799e1394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:38.773172 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd198aa-3fcb-4587-a01d-6263799e1394 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:38.773638 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd198aa-3fcb-4587-a01d-6263799e1394 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:38.774160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd198aa-3fcb-4587-a01d-6263799e1394 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:38.775614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd198aa-3fcb-4587-a01d-6263799e1394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:38.775946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ff59d-e81b-49c3-a896-ef88b202cbf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:38.776392 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd198aa-3fcb-4587-a01d-6263799e1394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:38.777828 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ff59d-e81b-49c3-a896-ef88b202cbf1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:38.779366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd198aa-3fcb-4587-a01d-6263799e1394 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:38.779829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:38.795781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-ad9ff59d-e81b-49c3-a896-ef88b202cbf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:38.795781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:38.795781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:38.795781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:38.795781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:38.795781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:38.795781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:38.795781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:38.795781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:38.795781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:38.795781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:38.795781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:38.795781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:38.795781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:38.795781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:38.797546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:38.799745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:38.799745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:38.799745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:38.799745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:38.799745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:38.799745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:38.799745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:38.799745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:38.799745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 342/696] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:38.799745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ff59d-e81b-49c3-a896-ef88b202cbf1 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:38.813225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 355/697] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:38.816092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd198aa-3fcb-4587-a01d-6263799e1394 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:38.868785 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:38.913657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ff59d-e81b-49c3-a896-ef88b202cbf1 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:38.938024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd198aa-3fcb-4587-a01d-6263799e1394 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:38.953321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a962592-7cbe-44e8-a1a5-33676ccf4f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:38.954389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a962592-7cbe-44e8-a1a5-33676ccf4f04 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:38.955474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a962592-7cbe-44e8-a1a5-33676ccf4f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:38.955931 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a962592-7cbe-44e8-a1a5-33676ccf4f04 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:38.956902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a962592-7cbe-44e8-a1a5-33676ccf4f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:38.957409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a962592-7cbe-44e8-a1a5-33676ccf4f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:38.959205 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a962592-7cbe-44e8-a1a5-33676ccf4f04 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:38.973029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 343/698] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:38.974165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a962592-7cbe-44e8-a1a5-33676ccf4f04 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:38.978733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c820f-6674-4783-a8a2-34efcafe82d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:38.979192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c820f-6674-4783-a8a2-34efcafe82d1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:38.979479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c820f-6674-4783-a8a2-34efcafe82d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:38.979755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c820f-6674-4783-a8a2-34efcafe82d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:38.980586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c820f-6674-4783-a8a2-34efcafe82d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:38.980896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c820f-6674-4783-a8a2-34efcafe82d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:38.982350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c820f-6674-4783-a8a2-34efcafe82d1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:38.997645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 356/699] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:38.998612 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c820f-6674-4783-a8a2-34efcafe82d1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:39.044216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:39.092925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a962592-7cbe-44e8-a1a5-33676ccf4f04 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:39.131522 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f2550-bb83-4895-ac8d-3b8271758d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:39.132700 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f2550-bb83-4895-ac8d-3b8271758d6a None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:39.133184 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:39.133682 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f2550-bb83-4895-ac8d-3b8271758d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:39.134841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f2550-bb83-4895-ac8d-3b8271758d6a None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:39.135934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f2550-bb83-4895-ac8d-3b8271758d6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:39.136069 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c820f-6674-4783-a8a2-34efcafe82d1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:39.138421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f2550-bb83-4895-ac8d-3b8271758d6a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:39.165776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 344/700] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:05:38 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:05:39.167321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f2550-bb83-4895-ac8d-3b8271758d6a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:39.184304 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e51858-0f0f-46a8-ac17-5620e80eb6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:39.185209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e51858-0f0f-46a8-ac17-5620e80eb6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:39.185499 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e51858-0f0f-46a8-ac17-5620e80eb6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:39.185776 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e51858-0f0f-46a8-ac17-5620e80eb6e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:39.195049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e51858-0f0f-46a8-ac17-5620e80eb6e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:39.196584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e51858-0f0f-46a8-ac17-5620e80eb6e0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:39.214098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-94e51858-0f0f-46a8-ac17-5620e80eb6e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:05:39.214098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:39.214098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:39.214098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:39.214098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:39.214098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:39.214098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:39.214098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:39.214098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:39.214098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:39.214098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:39.214098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:39.214098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:39.214098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:39.214098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:39.214098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:39.215078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:39.215975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:39.215975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:39.215975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:39.215975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:39.215975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:39.215975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:39.215975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:39.215975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:39.215975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:05:39.215975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:39.215975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 357/701] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 25 16:05:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:39.221678 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e51858-0f0f-46a8-ac17-5620e80eb6e0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:39.304074 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f2550-bb83-4895-ac8d-3b8271758d6a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:39.320681 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:39.346865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4af9b-a3c4-4259-9814-f0eaa72779eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:39.347913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4af9b-a3c4-4259-9814-f0eaa72779eb None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:39.348445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4af9b-a3c4-4259-9814-f0eaa72779eb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:39.348915 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4af9b-a3c4-4259-9814-f0eaa72779eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:39.349971 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4af9b-a3c4-4259-9814-f0eaa72779eb None admin] RBAC: Adding query filter params (role.id=276de082c6c04d08a38361e8fea28a9a, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=4dbc2609b13f45dc883ae18d3d056e76) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:39.350507 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4af9b-a3c4-4259-9814-f0eaa72779eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:39.352142 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4af9b-a3c4-4259-9814-f0eaa72779eb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:39.354622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e51858-0f0f-46a8-ac17-5620e80eb6e0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:39.359775 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 345/702] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:05:39 2022] GET /identity/v3/role_assignments?user.id=4dbc2609b13f45dc883ae18d3d056e76&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=276de082c6c04d08a38361e8fea28a9a => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:39.398980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b4910-1017-42ca-b97d-0076f88c763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:39.399624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b4910-1017-42ca-b97d-0076f88c763b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:39.399912 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b4910-1017-42ca-b97d-0076f88c763b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:39.400192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b4910-1017-42ca-b97d-0076f88c763b None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:39.401136 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b4910-1017-42ca-b97d-0076f88c763b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:39.401450 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b4910-1017-42ca-b97d-0076f88c763b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:39.403351 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b4910-1017-42ca-b97d-0076f88c763b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:39.426165 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 358/703] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 25 16:05:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:39.432387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4af9b-a3c4-4259-9814-f0eaa72779eb None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:39.612370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4af9b-a3c4-4259-9814-f0eaa72779eb None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:39.660643 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf720d88-010d-49d7-b4df-6f2717ae952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:39.661287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf720d88-010d-49d7-b4df-6f2717ae952c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:39.661578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf720d88-010d-49d7-b4df-6f2717ae952c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:39.661853 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf720d88-010d-49d7-b4df-6f2717ae952c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:39.727456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:39.771434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf720d88-010d-49d7-b4df-6f2717ae952c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:39.773015 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf720d88-010d-49d7-b4df-6f2717ae952c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:39.803817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cffd9-efda-41fa-a9af-9f4c77ae148e None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:39.803817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cffd9-efda-41fa-a9af-9f4c77ae148e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:39.803817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cffd9-efda-41fa-a9af-9f4c77ae148e None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:39.804590 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 359/704] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:39.809405 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c68e4-afdf-4866-b170-959415bc2831 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:39.809993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c68e4-afdf-4866-b170-959415bc2831 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:39.810495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c68e4-afdf-4866-b170-959415bc2831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:39.840541 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f29c68e4-afdf-4866-b170-959415bc2831 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:39.841880 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f29c68e4-afdf-4866-b170-959415bc2831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:39.864767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:39.905583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 346/705] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:39.911354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf720d88-010d-49d7-b4df-6f2717ae952c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:39.939188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 360/706] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:39.963874 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c68e4-afdf-4866-b170-959415bc2831 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:40.003465 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:40.028107 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf720d88-010d-49d7-b4df-6f2717ae952c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:40.067701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e3e93-c18d-44bc-93a2-ffc661032627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:40.068561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e3e93-c18d-44bc-93a2-ffc661032627 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:40.068848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e3e93-c18d-44bc-93a2-ffc661032627 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:40.069131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e3e93-c18d-44bc-93a2-ffc661032627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:40.081887 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e3e93-c18d-44bc-93a2-ffc661032627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:40.083623 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e3e93-c18d-44bc-93a2-ffc661032627 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:40.093584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c68e4-afdf-4866-b170-959415bc2831 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:40.105206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-555e3e93-c18d-44bc-93a2-ffc661032627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:40.105206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:40.105206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:40.105206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:40.105206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:40.105206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:40.105206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:40.105206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:40.105206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:40.105206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:40.105206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:40.105206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:40.105206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:40.105206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:40.105206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:40.106196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:40.107109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:40.107109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:40.107109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:40.107109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:40.107109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 347/707] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:05:40.112595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e3e93-c18d-44bc-93a2-ffc661032627 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:40.148386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3957ca-e1da-4786-819c-95c2c0c6943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:40.149776 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3957ca-e1da-4786-819c-95c2c0c6943e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:40.150270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3957ca-e1da-4786-819c-95c2c0c6943e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:40.150770 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3957ca-e1da-4786-819c-95c2c0c6943e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:40.151900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3957ca-e1da-4786-819c-95c2c0c6943e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:40.153685 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3957ca-e1da-4786-819c-95c2c0c6943e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:40.183127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-4b3957ca-e1da-4786-819c-95c2c0c6943e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 16:05:40.183127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:40.183127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:05:40.183127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:05:40.183127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:05:40.183127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:05:40.183127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:05:40.183127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:05:40.183127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 16:05:40.183127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:40.183127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:05:40.183127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:40.183127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:40.183127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:40.183127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:40.183127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:40.184178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:40.184178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:40.184178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:40.184178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:40.184178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:40.184178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:40.184178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:40.184178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:05:40.184178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:05:40.184178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:05:40.184178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:05:40.184178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:40.184178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:40.184178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:40.184178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:40.184178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:40.185053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:40.185053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:40.185053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:40.185053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:40.185053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:40.185053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:40.185053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:40.185053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:40.185053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:40.185053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:40.185053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:40.185053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:05:40.185053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:05:40.185053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 16:05:40.185053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:40.188245 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 361/708] 10.222.0.70 () {56 vars in 1129 bytes} [Mon Jul 25 16:05:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:40.195155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3957ca-e1da-4786-819c-95c2c0c6943e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:40.220622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:40.228486 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e3e93-c18d-44bc-93a2-ffc661032627 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:40.262629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:40.269681 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571700a-3455-4b57-a9a2-8561c3bc9497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:40.270761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571700a-3455-4b57-a9a2-8561c3bc9497 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:40.271270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571700a-3455-4b57-a9a2-8561c3bc9497 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:40.271757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571700a-3455-4b57-a9a2-8561c3bc9497 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:40.272734 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571700a-3455-4b57-a9a2-8561c3bc9497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:40.273249 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571700a-3455-4b57-a9a2-8561c3bc9497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:40.274850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571700a-3455-4b57-a9a2-8561c3bc9497 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:40.289190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 348/709] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:40.294965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571700a-3455-4b57-a9a2-8561c3bc9497 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:40.405062 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571700a-3455-4b57-a9a2-8561c3bc9497 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:40.414405 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3957ca-e1da-4786-819c-95c2c0c6943e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:40.451519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d59bc-82fd-4a30-830d-dbb2ceb67822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:40.452605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d59bc-82fd-4a30-830d-dbb2ceb67822 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:40.456277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d59bc-82fd-4a30-830d-dbb2ceb67822 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:40.456277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d59bc-82fd-4a30-830d-dbb2ceb67822 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:40.456277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d59bc-82fd-4a30-830d-dbb2ceb67822 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:40.456277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d59bc-82fd-4a30-830d-dbb2ceb67822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:40.457199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d59bc-82fd-4a30-830d-dbb2ceb67822 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:40.463466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 362/710] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jul 25 16:05:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:40.475626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d59bc-82fd-4a30-830d-dbb2ceb67822 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:40.496439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e81b87-e8f0-4ac1-a980-7be5b58c9333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:40.497500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e81b87-e8f0-4ac1-a980-7be5b58c9333 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:40.497934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e81b87-e8f0-4ac1-a980-7be5b58c9333 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:40.498380 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e81b87-e8f0-4ac1-a980-7be5b58c9333 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:40.515610 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e81b87-e8f0-4ac1-a980-7be5b58c9333 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:40.519202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e81b87-e8f0-4ac1-a980-7be5b58c9333 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:40.545455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-90e81b87-e8f0-4ac1-a980-7be5b58c9333 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:40.545455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:40.545455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:40.545455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:40.545455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:40.545455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:40.545455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:40.545455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:40.545455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:40.545455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:40.545455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:40.545455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:40.545455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:40.545455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:40.545455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:40.546626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:40.547597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:40.547597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:40.547597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:40.547597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:40.547597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:40.547597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:40.547597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:40.547597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:40.555859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 349/711] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:05:40.562175 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e81b87-e8f0-4ac1-a980-7be5b58c9333 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:40.664640 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:40.676684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:40.701189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d59bc-82fd-4a30-830d-dbb2ceb67822 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:40.752678 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2731a-c571-4b0f-84ab-d78d4ad654f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:40.753888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2731a-c571-4b0f-84ab-d78d4ad654f4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:40.754388 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2731a-c571-4b0f-84ab-d78d4ad654f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:40.754884 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2731a-c571-4b0f-84ab-d78d4ad654f4 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:40.755792 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2731a-c571-4b0f-84ab-d78d4ad654f4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:40.756337 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2731a-c571-4b0f-84ab-d78d4ad654f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:40.757916 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2731a-c571-4b0f-84ab-d78d4ad654f4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:40.760877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e81b87-e8f0-4ac1-a980-7be5b58c9333 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:40.764772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 363/712] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jul 25 16:05:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:40.766447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57562f6-c6d4-4a1f-be2c-f956343d7d01 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:40.767060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57562f6-c6d4-4a1f-be2c-f956343d7d01 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:40.768088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57562f6-c6d4-4a1f-be2c-f956343d7d01 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:40.773965 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 364/713] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:40.776149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8074d4-37a7-44c9-bb18-164bb0df785f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:40.776466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8074d4-37a7-44c9-bb18-164bb0df785f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:40.776999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8074d4-37a7-44c9-bb18-164bb0df785f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:40.812509 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4d8074d4-37a7-44c9-bb18-164bb0df785f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:40.814255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4d8074d4-37a7-44c9-bb18-164bb0df785f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:40.832370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f176c8-79cb-4bc9-be4c-b5498cdccce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:40.833058 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f176c8-79cb-4bc9-be4c-b5498cdccce6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:40.833339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f176c8-79cb-4bc9-be4c-b5498cdccce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:40.833615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f176c8-79cb-4bc9-be4c-b5498cdccce6 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:40.834415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f176c8-79cb-4bc9-be4c-b5498cdccce6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:40.834724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f176c8-79cb-4bc9-be4c-b5498cdccce6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:40.836184 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f176c8-79cb-4bc9-be4c-b5498cdccce6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:40.868312 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 350/714] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:40.874405 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f176c8-79cb-4bc9-be4c-b5498cdccce6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:40.944302 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 365/715] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:40.979591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8074d4-37a7-44c9-bb18-164bb0df785f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:41.072831 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f176c8-79cb-4bc9-be4c-b5498cdccce6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:41.080085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:41.096711 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:41.112343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8074d4-37a7-44c9-bb18-164bb0df785f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:41.150454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3ec21-d9ff-4288-a1e1-d6ecf5e2153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:41.151256 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3ec21-d9ff-4288-a1e1-d6ecf5e2153d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:41.151532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3ec21-d9ff-4288-a1e1-d6ecf5e2153d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:41.152067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3ec21-d9ff-4288-a1e1-d6ecf5e2153d None admin] PATH_INFO: `/v3/services/network` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:41.152745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3ec21-d9ff-4288-a1e1-d6ecf5e2153d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:41.154108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3ec21-d9ff-4288-a1e1-d6ecf5e2153d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:41.156515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231d784-bedf-43ee-9c42-40b9bea18fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:41.157292 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231d784-bedf-43ee-9c42-40b9bea18fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:41.158194 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231d784-bedf-43ee-9c42-40b9bea18fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:41.158482 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231d784-bedf-43ee-9c42-40b9bea18fc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:41.159323 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231d784-bedf-43ee-9c42-40b9bea18fc6 None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=c455f8d340444b068249213ff504895e) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:41.159637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231d784-bedf-43ee-9c42-40b9bea18fc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:41.161094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231d784-bedf-43ee-9c42-40b9bea18fc6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-93e3ec21-d9ff-4288-a1e1-d6ecf5e2153d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:41.167014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:41.167966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:41.167966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:41.167966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:41.167966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:41.167966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:41.167966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:41.167966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:05:41.167966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:05:41.167966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:05:41.167966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:05:41.167966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:41.167966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:41.167966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:41.167966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:41.167966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:41.167966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:41.168790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:41.168790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:41.168790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:41.168790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:41.168790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:41.168790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:41.168790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:41.168790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:41.168790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:41.168790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:41.168790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:05:41.168790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:05:41.168790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 16:05:41.168790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:41.168790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 366/716] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:40 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:05:41.177366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3ec21-d9ff-4288-a1e1-d6ecf5e2153d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:41.182090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 351/717] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:05:40 2022] GET /identity/v3/role_assignments?user.id=c455f8d340444b068249213ff504895e&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:41.339398 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3ec21-d9ff-4288-a1e1-d6ecf5e2153d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:41.402101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b21fcd-9340-452b-9878-fe3dc8bd3e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:41.402101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b21fcd-9340-452b-9878-fe3dc8bd3e30 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:41.402101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b21fcd-9340-452b-9878-fe3dc8bd3e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:41.402101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b21fcd-9340-452b-9878-fe3dc8bd3e30 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:41.402517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b21fcd-9340-452b-9878-fe3dc8bd3e30 None admin] RBAC: Adding query filter params (name=network) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:41.402517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b21fcd-9340-452b-9878-fe3dc8bd3e30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:41.402517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b21fcd-9340-452b-9878-fe3dc8bd3e30 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:41.402517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:41.407696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 367/718] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 25 16:05:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:41.417449 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231d784-bedf-43ee-9c42-40b9bea18fc6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:41.543060 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231d784-bedf-43ee-9c42-40b9bea18fc6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:41.581041 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43a96f-9284-423d-9fa4-e8c5603be55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:41.582108 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43a96f-9284-423d-9fa4-e8c5603be55c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:41.582590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43a96f-9284-423d-9fa4-e8c5603be55c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:41.583080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43a96f-9284-423d-9fa4-e8c5603be55c None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:41.584072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43a96f-9284-423d-9fa4-e8c5603be55c None admin] RBAC: Adding query filter params (type=network) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:41.584602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43a96f-9284-423d-9fa4-e8c5603be55c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:41.586229 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43a96f-9284-423d-9fa4-e8c5603be55c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:41.593487 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 352/719] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 25 16:05:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:42.108200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53b4c3-9862-4fc4-a92a-c47365a14c82 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:42.108827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53b4c3-9862-4fc4-a92a-c47365a14c82 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:42.108827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53b4c3-9862-4fc4-a92a-c47365a14c82 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:42.111188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 368/720] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:42.117346 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b38b4-430a-456c-bbc8-2b7e7f4ad32c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:42.117874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b38b4-430a-456c-bbc8-2b7e7f4ad32c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:42.117874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b38b4-430a-456c-bbc8-2b7e7f4ad32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:42.146383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-0c3b38b4-430a-456c-bbc8-2b7e7f4ad32c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:42.147598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0c3b38b4-430a-456c-bbc8-2b7e7f4ad32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:42.153388 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb80b68-369f-4995-a01a-e36fd8a1a75c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:42.153702 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb80b68-369f-4995-a01a-e36fd8a1a75c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:42.153913 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb80b68-369f-4995-a01a-e36fd8a1a75c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:42.155545 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 369/721] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:42.161780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0620ae-202a-4272-be05-f69da06f60d9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:42.162073 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0620ae-202a-4272-be05-f69da06f60d9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:42.162710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0620ae-202a-4272-be05-f69da06f60d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:42.181571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1d0620ae-202a-4272-be05-f69da06f60d9 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:42.182769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1d0620ae-202a-4272-be05-f69da06f60d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:42.206608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:42.292607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 353/722] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:05:42.311839 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 370/723] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 16:05:42.336274 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b38b4-430a-456c-bbc8-2b7e7f4ad32c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:42.355637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0620ae-202a-4272-be05-f69da06f60d9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:42.465496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0620ae-202a-4272-be05-f69da06f60d9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:42.494596 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:42.508845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2c5d2-1bda-4671-923c-b489cc9ba330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:42.510108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2c5d2-1bda-4671-923c-b489cc9ba330 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:42.510601 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2c5d2-1bda-4671-923c-b489cc9ba330 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:42.511096 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2c5d2-1bda-4671-923c-b489cc9ba330 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:42.537305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2c5d2-1bda-4671-923c-b489cc9ba330 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:42.548852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b38b4-430a-456c-bbc8-2b7e7f4ad32c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:42.553547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6eb2c5d2-1bda-4671-923c-b489cc9ba330 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:42.553547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:42.553547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:42.553547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:42.553547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:42.553547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:42.553547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:42.553547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:42.553547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:42.553547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:42.553547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:42.553547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:42.553547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:42.553547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:42.553547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:42.553547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:42.554445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:42.554445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:42.554445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:42.554445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:42.554445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:42.554445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:42.554445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:42.554445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:42.554445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:42.554445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:42.554445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:42.554445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:42.554445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:42.554445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:42.554445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:42.554445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:42.555331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:42.555331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:42.555331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:42.555331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:42.555331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:42.555331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:42.555331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:42.555331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:42.555331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:42.555331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:42.555331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:42.555331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:42.564197 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 371/724] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:05:42.570265 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2c5d2-1bda-4671-923c-b489cc9ba330 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:42.598844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f2700-bcc8-4929-a838-274b255ac458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:42.599868 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f2700-bcc8-4929-a838-274b255ac458 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:42.600052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f2700-bcc8-4929-a838-274b255ac458 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:42.600330 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f2700-bcc8-4929-a838-274b255ac458 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:42.611636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f2700-bcc8-4929-a838-274b255ac458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:42.621492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-a84f2700-bcc8-4929-a838-274b255ac458 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:42.621492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:42.621492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:42.621492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:42.621492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:42.621492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:42.621492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:42.621492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:42.621492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:42.621492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:42.621492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:42.621492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:42.621492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:42.621492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:42.621492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:42.621492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:42.622591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:42.622591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:42.622591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:42.622591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:42.622591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:42.622591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:42.622591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:42.622591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:42.622591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:42.622591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:42.622591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:42.622591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:42.622591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:42.622591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:42.622591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:42.622591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:42.623434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:42.623434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:42.623434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:42.623434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:42.623434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:42.623434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:42.623434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:42.623434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:42.623434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:42.623434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:42.623434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:42.623434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:42.623434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 354/725] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:05:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:42.632172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f2700-bcc8-4929-a838-274b255ac458 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:42.683463 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:42.764085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2c5d2-1bda-4671-923c-b489cc9ba330 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:42.823155 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f2700-bcc8-4929-a838-274b255ac458 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:42.838066 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208da81-3579-4827-b740-f661b69ba0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:42.838751 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208da81-3579-4827-b740-f661b69ba0da None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:42.839035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208da81-3579-4827-b740-f661b69ba0da None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:42.839311 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208da81-3579-4827-b740-f661b69ba0da None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:42.840160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208da81-3579-4827-b740-f661b69ba0da None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:42.840496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208da81-3579-4827-b740-f661b69ba0da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:42.841870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208da81-3579-4827-b740-f661b69ba0da None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:42.864496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 372/726] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:42.867073 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208da81-3579-4827-b740-f661b69ba0da None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:42.897787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f578239-6751-40bf-bba3-2d9bd2339d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:42.898503 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f578239-6751-40bf-bba3-2d9bd2339d2f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:42.898788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f578239-6751-40bf-bba3-2d9bd2339d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:42.900131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f578239-6751-40bf-bba3-2d9bd2339d2f None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:42.900960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f578239-6751-40bf-bba3-2d9bd2339d2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:42.901282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f578239-6751-40bf-bba3-2d9bd2339d2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:42.906984 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f578239-6751-40bf-bba3-2d9bd2339d2f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:42.919696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 355/727] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:42.926293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f578239-6751-40bf-bba3-2d9bd2339d2f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:42.962018 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:43.063050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208da81-3579-4827-b740-f661b69ba0da None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:43.106545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:43.128432 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f578239-6751-40bf-bba3-2d9bd2339d2f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:43.138138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b3d39-43c1-4772-948e-af0cd3d8e30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:43.138965 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b3d39-43c1-4772-948e-af0cd3d8e30d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:43.139295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b3d39-43c1-4772-948e-af0cd3d8e30d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:43.139573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b3d39-43c1-4772-948e-af0cd3d8e30d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:43.156172 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b3d39-43c1-4772-948e-af0cd3d8e30d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:43.160092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b3d39-43c1-4772-948e-af0cd3d8e30d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:43.187648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d15b3d39-43c1-4772-948e-af0cd3d8e30d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:43.187648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:43.187648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:43.187648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:43.187648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:43.187648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:43.187648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:43.187648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:43.187648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:43.187648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:43.187648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:43.187648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:43.187648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:43.187648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:43.187648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:43.189139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:43.189995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:43.189995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:43.189995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:43.189995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:43.203574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 373/728] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:43.208744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51caf71-3062-4b3f-a02e-1e4254fbe5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:43.209747 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51caf71-3062-4b3f-a02e-1e4254fbe5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:43.210032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51caf71-3062-4b3f-a02e-1e4254fbe5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:43.210310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51caf71-3062-4b3f-a02e-1e4254fbe5a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:43.211172 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b3d39-43c1-4772-948e-af0cd3d8e30d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:43.234243 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51caf71-3062-4b3f-a02e-1e4254fbe5a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:43.235765 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51caf71-3062-4b3f-a02e-1e4254fbe5a0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:43.270885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-d51caf71-3062-4b3f-a02e-1e4254fbe5a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:43.270885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:43.270885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:43.270885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:43.270885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:43.270885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:43.270885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:43.270885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:43.270885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:43.270885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:43.270885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:43.270885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:43.270885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:43.270885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:43.270885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:43.271812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:43.272728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:43.272728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:43.272728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:43.272728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:43.272728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 356/729] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:43.278985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51caf71-3062-4b3f-a02e-1e4254fbe5a0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:43.389512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b3d39-43c1-4772-948e-af0cd3d8e30d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:43.391936 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:43.423803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51caf71-3062-4b3f-a02e-1e4254fbe5a0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:43.447887 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16871bde-3042-475b-9a19-02a3ddbacbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:43.448995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16871bde-3042-475b-9a19-02a3ddbacbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:43.449537 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16871bde-3042-475b-9a19-02a3ddbacbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:43.450014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16871bde-3042-475b-9a19-02a3ddbacbe7 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:43.451325 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16871bde-3042-475b-9a19-02a3ddbacbe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:43.451855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16871bde-3042-475b-9a19-02a3ddbacbe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:43.454350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16871bde-3042-475b-9a19-02a3ddbacbe7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:43.480386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 374/730] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:43.482623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9da68-ecfd-4ce4-8bbe-f5d81df588ad None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:43.483124 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9da68-ecfd-4ce4-8bbe-f5d81df588ad None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:43.483746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9da68-ecfd-4ce4-8bbe-f5d81df588ad None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:43.486585 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 375/731] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:43.493040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9da68-ecfd-4ce4-8bbe-f5d81df588ad None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:43.494608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff20eb4-eee3-44a9-9877-2114c9008279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:43.495524 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff20eb4-eee3-44a9-9877-2114c9008279 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:43.496233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff20eb4-eee3-44a9-9877-2114c9008279 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:43.496737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff20eb4-eee3-44a9-9877-2114c9008279 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:43.498536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff20eb4-eee3-44a9-9877-2114c9008279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:43.499083 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff20eb4-eee3-44a9-9877-2114c9008279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:43.500716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff20eb4-eee3-44a9-9877-2114c9008279 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:43.516150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 357/732] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:43.518097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2382-8bfc-4b35-ac5a-002359cfb4cc None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:43.519029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2382-8bfc-4b35-ac5a-002359cfb4cc None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:43.519322 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2382-8bfc-4b35-ac5a-002359cfb4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:43.528022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:43.547184 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ff7c2382-8bfc-4b35-ac5a-002359cfb4cc None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:43.548988 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ff7c2382-8bfc-4b35-ac5a-002359cfb4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:43.616971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9da68-ecfd-4ce4-8bbe-f5d81df588ad None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:43.632472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 358/733] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:43.633393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c2382-8bfc-4b35-ac5a-002359cfb4cc None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:43.656288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bde94e-6627-4ce3-ae6f-fb0fed8c0cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:43.657066 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bde94e-6627-4ce3-ae6f-fb0fed8c0cdf None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:43.657380 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bde94e-6627-4ce3-ae6f-fb0fed8c0cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:43.657699 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bde94e-6627-4ce3-ae6f-fb0fed8c0cdf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:43.665337 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bde94e-6627-4ce3-ae6f-fb0fed8c0cdf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:43.666797 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bde94e-6627-4ce3-ae6f-fb0fed8c0cdf None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:43.683028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-00bde94e-6627-4ce3-ae6f-fb0fed8c0cdf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 16:05:43.683028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:43.683028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:43.683028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:43.683028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:43.683028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:43.683028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:43.683028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:43.683028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:43.683028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:43.683028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:43.683028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:43.683028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:43.683028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:43.683028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:43.683028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:43.684033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:43.684988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:43.684988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:43.684988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:43.684988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:43.684988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:43.684988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:43.684988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:43.684988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:43.684988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 16:05:43.684988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:43.688445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 376/734] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 25 16:05:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:43.689278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bde94e-6627-4ce3-ae6f-fb0fed8c0cdf None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:43.716135 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:43.756343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c2382-8bfc-4b35-ac5a-002359cfb4cc None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:43.790580 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:43.796894 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cab5b1-5fde-4a2d-a2de-89f604de1169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:43.797828 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cab5b1-5fde-4a2d-a2de-89f604de1169 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:43.798087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cab5b1-5fde-4a2d-a2de-89f604de1169 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:43.798356 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cab5b1-5fde-4a2d-a2de-89f604de1169 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:43.804516 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bde94e-6627-4ce3-ae6f-fb0fed8c0cdf None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:43.806182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cab5b1-5fde-4a2d-a2de-89f604de1169 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:43.807659 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cab5b1-5fde-4a2d-a2de-89f604de1169 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:43.823153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-47cab5b1-5fde-4a2d-a2de-89f604de1169 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 16:05:43.823153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:43.823153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:43.823153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:43.823153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:43.823153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:43.823153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:43.823153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:43.823153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:43.823153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:43.823153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:43.823153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:43.823153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:43.823153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:43.823153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:43.823153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:43.824097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:43.825054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:43.825054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:43.825054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:43.825054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:43.825054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:43.825054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:43.825054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:43.825054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:43.825054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 16:05:43.825054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:43.825054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 359/735] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:05:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:43.825639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70c237-0134-47f6-8218-56acce3c6077 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:43.826479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70c237-0134-47f6-8218-56acce3c6077 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:43.826479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70c237-0134-47f6-8218-56acce3c6077 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:43.832022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 360/736] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:43.832022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70c237-0134-47f6-8218-56acce3c6077 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:43.848815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b3c54-979a-4589-8898-90dd2cde0e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:43.849737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b3c54-979a-4589-8898-90dd2cde0e3f None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:43.850055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b3c54-979a-4589-8898-90dd2cde0e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:43.850394 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b3c54-979a-4589-8898-90dd2cde0e3f None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:43.851334 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b3c54-979a-4589-8898-90dd2cde0e3f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:43.853236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b3c54-979a-4589-8898-90dd2cde0e3f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:43.873808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 377/737] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 25 16:05:43 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:05:43.874967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b3c54-979a-4589-8898-90dd2cde0e3f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:43.986886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:43.998794 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70c237-0134-47f6-8218-56acce3c6077 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:44.016232 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b3c54-979a-4589-8898-90dd2cde0e3f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:44.043154 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bed7cc-c8a3-46d9-8247-6bf8c7e3bab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:44.044209 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bed7cc-c8a3-46d9-8247-6bf8c7e3bab1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:44.044738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bed7cc-c8a3-46d9-8247-6bf8c7e3bab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:44.045348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bed7cc-c8a3-46d9-8247-6bf8c7e3bab1 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:44.046247 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bed7cc-c8a3-46d9-8247-6bf8c7e3bab1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:44.046574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bed7cc-c8a3-46d9-8247-6bf8c7e3bab1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:44.048164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bed7cc-c8a3-46d9-8247-6bf8c7e3bab1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:44.061736 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce038a6b-a2e7-4489-aa49-508fc93986ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:44.062445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce038a6b-a2e7-4489-aa49-508fc93986ea None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:44.062733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce038a6b-a2e7-4489-aa49-508fc93986ea None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:44.063010 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce038a6b-a2e7-4489-aa49-508fc93986ea None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:44.065121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce038a6b-a2e7-4489-aa49-508fc93986ea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:44.065121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce038a6b-a2e7-4489-aa49-508fc93986ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:44.066273 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce038a6b-a2e7-4489-aa49-508fc93986ea None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:44.067554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 361/738] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jul 25 16:05:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:44.068890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b52c0-f007-483e-9cac-17c1acaed718 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:44.069182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b52c0-f007-483e-9cac-17c1acaed718 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:44.069470 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b52c0-f007-483e-9cac-17c1acaed718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:44.087497 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 378/739] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jul 25 16:05:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:44.089205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bafa7-7690-40e8-97c6-545ec58ec3aa None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:44.089205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bafa7-7690-40e8-97c6-545ec58ec3aa None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:44.089393 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bafa7-7690-40e8-97c6-545ec58ec3aa None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:44.090720 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 379/740] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:44.094237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bafa7-7690-40e8-97c6-545ec58ec3aa None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:44.094421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d82b52c0-f007-483e-9cac-17c1acaed718 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:44.094421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d82b52c0-f007-483e-9cac-17c1acaed718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:44.140607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:44.169160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 362/741] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:44.169855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b52c0-f007-483e-9cac-17c1acaed718 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:44.215442 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bafa7-7690-40e8-97c6-545ec58ec3aa None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:44.263471 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790da00d-0acf-4938-afce-01af5bed9070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:44.264060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790da00d-0acf-4938-afce-01af5bed9070 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:44.264427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790da00d-0acf-4938-afce-01af5bed9070 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:44.264712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790da00d-0acf-4938-afce-01af5bed9070 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:44.280766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:44.293845 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b52c0-f007-483e-9cac-17c1acaed718 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:44.331526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f0068-1ec7-4299-bd95-db40f0565c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:44.332197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f0068-1ec7-4299-bd95-db40f0565c37 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:44.332508 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f0068-1ec7-4299-bd95-db40f0565c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:44.332784 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f0068-1ec7-4299-bd95-db40f0565c37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:44.349573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790da00d-0acf-4938-afce-01af5bed9070 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:44.351044 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790da00d-0acf-4938-afce-01af5bed9070 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:44.394286 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:44.421805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f0068-1ec7-4299-bd95-db40f0565c37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:44.424001 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f0068-1ec7-4299-bd95-db40f0565c37 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:44.465361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 380/742] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:44 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:44.465361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e045d-4b95-4cc1-9dfd-47ad55739cc5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:44.465361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e045d-4b95-4cc1-9dfd-47ad55739cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:44.465361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e045d-4b95-4cc1-9dfd-47ad55739cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:44.481944 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-296e045d-4b95-4cc1-9dfd-47ad55739cc5 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:44.483141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-296e045d-4b95-4cc1-9dfd-47ad55739cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:44.521194 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:44.536435 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 363/743] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:44 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 16:05:44.536435 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f0068-1ec7-4299-bd95-db40f0565c37 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:44.564837 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 381/744] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 16:05:44.566085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e045d-4b95-4cc1-9dfd-47ad55739cc5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:44.626926 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:44.652705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f0068-1ec7-4299-bd95-db40f0565c37 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:44.676955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e045d-4b95-4cc1-9dfd-47ad55739cc5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:44.690726 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a9fc3-f0b8-48be-ad3b-adf27de7ee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:44.691651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a9fc3-f0b8-48be-ad3b-adf27de7ee8b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:44.691936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a9fc3-f0b8-48be-ad3b-adf27de7ee8b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:44.692211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a9fc3-f0b8-48be-ad3b-adf27de7ee8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:44.709087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a9fc3-f0b8-48be-ad3b-adf27de7ee8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:44.717333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-388a9fc3-f0b8-48be-ad3b-adf27de7ee8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:44.717333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:44.717333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:44.717333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:44.717333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:44.717333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:44.717333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:44.717333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:44.717333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:44.717333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:44.717333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:44.717333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:44.717333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:44.717333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:44.717333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:44.717333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:44.718424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:44.718424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:44.718424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:44.718424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:44.718424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:44.718424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:44.718424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:44.718424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:44.718424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:44.718424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:44.718424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:44.718424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:44.718424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:44.718424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:44.718424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:44.718424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:44.719245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:44.719245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:44.719245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:44.719245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:44.719245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:44.719245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:44.719245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:44.719245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:44.719245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:44.719245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:44.719245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:44.719245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:44.721074 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2970b-f8b8-412e-bc5c-e266f32fcefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:44.721181 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 364/745] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:05:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:44.721254 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2970b-f8b8-412e-bc5c-e266f32fcefa None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:44.721254 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2970b-f8b8-412e-bc5c-e266f32fcefa None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:44.721254 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2970b-f8b8-412e-bc5c-e266f32fcefa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:44.721427 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a9fc3-f0b8-48be-ad3b-adf27de7ee8b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:44.733182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2970b-f8b8-412e-bc5c-e266f32fcefa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:44.734658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2970b-f8b8-412e-bc5c-e266f32fcefa None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:44.757707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-75e2970b-f8b8-412e-bc5c-e266f32fcefa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:44.757707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:44.757707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:44.757707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:44.757707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:44.757707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:44.757707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:44.757707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:44.757707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:44.757707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:44.757707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:44.757707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:44.757707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:44.757707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:44.757707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:44.758647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:44.759520 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:44.759520 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:44.759520 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:44.759520 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:44.761536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 382/746] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:44.762645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2970b-f8b8-412e-bc5c-e266f32fcefa None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:44.794984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:44.841150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a9fc3-f0b8-48be-ad3b-adf27de7ee8b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:44.887494 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970ef37-722a-423b-bf15-317a041f205b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:44.888959 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ef37-722a-423b-bf15-317a041f205b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:44.889467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ef37-722a-423b-bf15-317a041f205b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:44.889962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ef37-722a-423b-bf15-317a041f205b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:44.893341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2970b-f8b8-412e-bc5c-e266f32fcefa None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:44.895203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:44.915135 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970ef37-722a-423b-bf15-317a041f205b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:44.918132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970ef37-722a-423b-bf15-317a041f205b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:44.938121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-3970ef37-722a-423b-bf15-317a041f205b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:44.938121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:44.938121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:44.938121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:44.938121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:44.938121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:44.938121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:44.938121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:44.938121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:44.938121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:44.938121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:44.938121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:44.938121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:44.938121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:44.938121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:44.939140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:44.940476 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:44.940476 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:44.940476 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:44.940476 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:44.942028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba7c47-50f0-4ccd-ad63-951ae230a4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:44.942896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba7c47-50f0-4ccd-ad63-951ae230a4c5 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:44.943315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba7c47-50f0-4ccd-ad63-951ae230a4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:44.943946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 365/747] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:44.944327 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba7c47-50f0-4ccd-ad63-951ae230a4c5 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:44.944917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970ef37-722a-423b-bf15-317a041f205b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:44.945569 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba7c47-50f0-4ccd-ad63-951ae230a4c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:44.947180 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba7c47-50f0-4ccd-ad63-951ae230a4c5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:44.967571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 383/748] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 25 16:05:44 2022] POST /identity/v3/services => generated 240 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:05:44.968871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba7c47-50f0-4ccd-ad63-951ae230a4c5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:45.085429 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970ef37-722a-423b-bf15-317a041f205b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:45.118514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:45.139177 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cbf05-09a9-4525-b410-181d8d065f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:45.140127 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cbf05-09a9-4525-b410-181d8d065f64 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:45.140598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cbf05-09a9-4525-b410-181d8d065f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:45.141080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cbf05-09a9-4525-b410-181d8d065f64 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:45.142603 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cbf05-09a9-4525-b410-181d8d065f64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:45.143095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cbf05-09a9-4525-b410-181d8d065f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:45.144677 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cbf05-09a9-4525-b410-181d8d065f64 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:45.145141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba7c47-50f0-4ccd-ad63-951ae230a4c5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:45.157695 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 366/749] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:45.159480 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cbf05-09a9-4525-b410-181d8d065f64 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:45.199196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8556490-9651-4452-a6cf-be55d81b81af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:45.199886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8556490-9651-4452-a6cf-be55d81b81af None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:45.200329 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8556490-9651-4452-a6cf-be55d81b81af None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:45.200523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8556490-9651-4452-a6cf-be55d81b81af None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:45.201215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8556490-9651-4452-a6cf-be55d81b81af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:45.201534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8556490-9651-4452-a6cf-be55d81b81af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:45.202897 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8556490-9651-4452-a6cf-be55d81b81af None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:45.214501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:45.218027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 384/750] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:45.219377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8556490-9651-4452-a6cf-be55d81b81af None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:45.290292 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cbf05-09a9-4525-b410-181d8d065f64 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:45.330582 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a0514-e87b-439b-9bca-4596793fa7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:45.331501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a0514-e87b-439b-9bca-4596793fa7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:45.332027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a0514-e87b-439b-9bca-4596793fa7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:45.332512 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a0514-e87b-439b-9bca-4596793fa7f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:45.333379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a0514-e87b-439b-9bca-4596793fa7f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:45.333934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a0514-e87b-439b-9bca-4596793fa7f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:45.335667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a0514-e87b-439b-9bca-4596793fa7f3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:45.350478 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 367/751] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:45.355855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a0514-e87b-439b-9bca-4596793fa7f3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:45.361555 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8556490-9651-4452-a6cf-be55d81b81af None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:45.404145 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c32d9-83ae-483f-9151-db18692d38cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:45.406176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c32d9-83ae-483f-9151-db18692d38cd None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:45.406617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c32d9-83ae-483f-9151-db18692d38cd None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:45.407120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c32d9-83ae-483f-9151-db18692d38cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:45.425342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c32d9-83ae-483f-9151-db18692d38cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:45.427885 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c32d9-83ae-483f-9151-db18692d38cd None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:45.431103 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:45.454440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-700c32d9-83ae-483f-9151-db18692d38cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:45.454440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:45.454440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:45.454440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:45.454440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:45.454440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:45.454440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:45.454440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:45.454440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:45.454440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:45.454440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:45.454440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:45.454440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:45.454440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:45.454440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:45.455578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:45.456530 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:45.456530 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:45.456530 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:45.456530 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:45.458771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 385/752] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:45.460489 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c32d9-83ae-483f-9151-db18692d38cd None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:45.499400 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a0514-e87b-439b-9bca-4596793fa7f3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:45.511524 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:45.554846 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3983f5-9aa4-4023-b9e1-842fdd313a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:45.556001 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3983f5-9aa4-4023-b9e1-842fdd313a06 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:45.556512 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3983f5-9aa4-4023-b9e1-842fdd313a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:45.556993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3983f5-9aa4-4023-b9e1-842fdd313a06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:45.566329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3983f5-9aa4-4023-b9e1-842fdd313a06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:45.568761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3983f5-9aa4-4023-b9e1-842fdd313a06 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:45.589536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-db3983f5-9aa4-4023-b9e1-842fdd313a06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:45.589536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:45.589536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:45.589536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:45.589536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:45.589536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:45.589536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:45.589536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:45.589536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:45.589536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:45.589536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:45.589536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:45.589536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:45.589536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:45.589536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:45.590628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:45.591709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:45.591709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:45.591709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:45.591709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:45.591709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:45.591709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:45.591709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:45.591709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:45.598976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 368/753] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:45.598976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3983f5-9aa4-4023-b9e1-842fdd313a06 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:45.606456 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c32d9-83ae-483f-9151-db18692d38cd None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:45.655007 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd62046-f287-4662-8423-914523d162bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:45.656435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd62046-f287-4662-8423-914523d162bf None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:45.657168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd62046-f287-4662-8423-914523d162bf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:45.658251 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd62046-f287-4662-8423-914523d162bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:45.668583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd62046-f287-4662-8423-914523d162bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:45.671241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd62046-f287-4662-8423-914523d162bf None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:45.691984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-ebd62046-f287-4662-8423-914523d162bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:45.691984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:45.691984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:45.691984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:45.691984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:45.691984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:45.691984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:45.691984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:45.691984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:45.691984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:45.691984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:45.691984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:45.691984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:45.691984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:45.691984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:45.693098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:45.693985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:45.693985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:45.693985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:45.693985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:45.693985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:45.693985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:45.693985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:45.693985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:45.697409 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 386/754] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:45.698441 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd62046-f287-4662-8423-914523d162bf None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:45.714127 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3983f5-9aa4-4023-b9e1-842fdd313a06 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:45.751341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcac49b-828a-409b-989e-c9168585de1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:45.752153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcac49b-828a-409b-989e-c9168585de1a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:45.752550 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcac49b-828a-409b-989e-c9168585de1a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:45.752917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcac49b-828a-409b-989e-c9168585de1a None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:45.753715 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcac49b-828a-409b-989e-c9168585de1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:45.754087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcac49b-828a-409b-989e-c9168585de1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:45.755544 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcac49b-828a-409b-989e-c9168585de1a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:45.769251 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 369/755] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:45.770207 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcac49b-828a-409b-989e-c9168585de1a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:45.776553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:45.808076 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:45.828593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd62046-f287-4662-8423-914523d162bf None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:45.865058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409cfb6-af89-466b-89c8-faa4692e9f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:45.865760 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409cfb6-af89-466b-89c8-faa4692e9f94 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:45.866114 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409cfb6-af89-466b-89c8-faa4692e9f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:45.866457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409cfb6-af89-466b-89c8-faa4692e9f94 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:45.867392 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409cfb6-af89-466b-89c8-faa4692e9f94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:45.867768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409cfb6-af89-466b-89c8-faa4692e9f94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:45.869443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409cfb6-af89-466b-89c8-faa4692e9f94 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:45.892856 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 387/756] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:45.894599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409cfb6-af89-466b-89c8-faa4692e9f94 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:45.909079 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcac49b-828a-409b-989e-c9168585de1a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:45.947190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5b4cd-6a2f-4b58-885d-b766e45a7d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:45.947883 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5b4cd-6a2f-4b58-885d-b766e45a7d4a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:45.948221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5b4cd-6a2f-4b58-885d-b766e45a7d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:45.948529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5b4cd-6a2f-4b58-885d-b766e45a7d4a None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:45.949359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5b4cd-6a2f-4b58-885d-b766e45a7d4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:45.949704 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5b4cd-6a2f-4b58-885d-b766e45a7d4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:45.951407 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5b4cd-6a2f-4b58-885d-b766e45a7d4a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:45.969041 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 370/757] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:45.970041 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5b4cd-6a2f-4b58-885d-b766e45a7d4a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:46.029637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409cfb6-af89-466b-89c8-faa4692e9f94 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:46.044198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:46.065575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:46.069088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa8c1e-7303-42a0-92f8-9d4c126cc9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:46.069634 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa8c1e-7303-42a0-92f8-9d4c126cc9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:46.069926 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa8c1e-7303-42a0-92f8-9d4c126cc9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:46.070295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa8c1e-7303-42a0-92f8-9d4c126cc9b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:46.078073 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa8c1e-7303-42a0-92f8-9d4c126cc9b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:46.079571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa8c1e-7303-42a0-92f8-9d4c126cc9b8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:46.082415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5b4cd-6a2f-4b58-885d-b766e45a7d4a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:46.093758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6daa8c1e-7303-42a0-92f8-9d4c126cc9b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:05:46.093758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:46.093758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:46.093758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:46.093758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:46.093758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:46.093758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:46.093758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:46.093758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:46.093758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:46.093758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:46.093758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:46.093758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:46.093758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:46.093758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:46.093758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:46.095428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:46.096358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:46.096358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:46.096358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:46.096358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:46.096358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:46.096358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:46.096358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:46.096358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:46.096358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:05:46.096358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:46.096358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 388/758] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 25 16:05:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:46.096358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa8c1e-7303-42a0-92f8-9d4c126cc9b8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:46.128433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f593c8-0b3a-4dc7-b37a-d4c88ec372d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:46.129017 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f593c8-0b3a-4dc7-b37a-d4c88ec372d6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:46.129303 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f593c8-0b3a-4dc7-b37a-d4c88ec372d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:46.129583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f593c8-0b3a-4dc7-b37a-d4c88ec372d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:46.130418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f593c8-0b3a-4dc7-b37a-d4c88ec372d6 None admin] RBAC: Adding query filter params (role.id=276de082c6c04d08a38361e8fea28a9a, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=ea56b6a25f8e46949e6deb8443b20673) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:46.130736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f593c8-0b3a-4dc7-b37a-d4c88ec372d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:46.132199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f593c8-0b3a-4dc7-b37a-d4c88ec372d6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:46.138195 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 371/759] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:05:45 2022] GET /identity/v3/role_assignments?user.id=ea56b6a25f8e46949e6deb8443b20673&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=276de082c6c04d08a38361e8fea28a9a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:46.139567 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56c43a-1eb1-4270-bbdc-4c230d4cfd78 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:46.139857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56c43a-1eb1-4270-bbdc-4c230d4cfd78 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:46.140134 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56c43a-1eb1-4270-bbdc-4c230d4cfd78 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:46.141810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 372/760] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:46.142575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56c43a-1eb1-4270-bbdc-4c230d4cfd78 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:46.239188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa8c1e-7303-42a0-92f8-9d4c126cc9b8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:46.290388 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d21f1-54c6-4620-a198-dc918559a1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:46.291685 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d21f1-54c6-4620-a198-dc918559a1ee None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:46.292348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d21f1-54c6-4620-a198-dc918559a1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:46.292732 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d21f1-54c6-4620-a198-dc918559a1ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:46.293676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d21f1-54c6-4620-a198-dc918559a1ee None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=4dbc2609b13f45dc883ae18d3d056e76) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:46.294093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d21f1-54c6-4620-a198-dc918559a1ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:46.295632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56c43a-1eb1-4270-bbdc-4c230d4cfd78 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:46.295843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d21f1-54c6-4620-a198-dc918559a1ee None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:46.304718 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 389/761] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:05:46 2022] GET /identity/v3/role_assignments?user.id=4dbc2609b13f45dc883ae18d3d056e76&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:46.306188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1c45f-a186-4724-a74e-3aee29e61d5e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:46.306579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1c45f-a186-4724-a74e-3aee29e61d5e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:46.306955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1c45f-a186-4724-a74e-3aee29e61d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:46.335782 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-85d1c45f-a186-4724-a74e-3aee29e61d5e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:46.338449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-85d1c45f-a186-4724-a74e-3aee29e61d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:46.341366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc86840-e595-4d27-9f50-8535e7483508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:46.342276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc86840-e595-4d27-9f50-8535e7483508 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:46.342765 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc86840-e595-4d27-9f50-8535e7483508 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:46.343226 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc86840-e595-4d27-9f50-8535e7483508 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:46.344446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc86840-e595-4d27-9f50-8535e7483508 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:46.345041 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc86840-e595-4d27-9f50-8535e7483508 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:46.346881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc86840-e595-4d27-9f50-8535e7483508 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:46.367801 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 373/762] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 25 16:05:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:46.373242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc86840-e595-4d27-9f50-8535e7483508 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:46.384938 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:46.391697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:46.431111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 390/763] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:05:46.506348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1c45f-a186-4724-a74e-3aee29e61d5e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:46.529768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc86840-e595-4d27-9f50-8535e7483508 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:46.586270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f531f83-150e-487c-ac28-41ca243193d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:46.587453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f531f83-150e-487c-ac28-41ca243193d4 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:46.587952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f531f83-150e-487c-ac28-41ca243193d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:46.588394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f531f83-150e-487c-ac28-41ca243193d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:46.614400 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f531f83-150e-487c-ac28-41ca243193d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:46.619151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f531f83-150e-487c-ac28-41ca243193d4 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:46.669329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-0f531f83-150e-487c-ac28-41ca243193d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:46.669329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:46.669329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:46.669329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:46.669329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:46.669329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:46.669329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:46.669329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:46.669329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:46.669329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:46.669329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:46.669329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:46.669329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:46.669329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:46.669329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:46.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:46.671943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:46.671943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:46.671943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:46.671943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:46.679216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 374/764] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:05:46.685463 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f531f83-150e-487c-ac28-41ca243193d4 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:46.704893 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1c45f-a186-4724-a74e-3aee29e61d5e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:46.760195 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46d807-658d-49b4-b88f-9e6baf2b8edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:46.763097 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46d807-658d-49b4-b88f-9e6baf2b8edf None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:46.763097 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46d807-658d-49b4-b88f-9e6baf2b8edf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:46.763403 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46d807-658d-49b4-b88f-9e6baf2b8edf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:46.764023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46d807-658d-49b4-b88f-9e6baf2b8edf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:46.765505 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46d807-658d-49b4-b88f-9e6baf2b8edf None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:46.782973 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:46.793200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-4a46d807-658d-49b4-b88f-9e6baf2b8edf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 16:05:46.793200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:46.793200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:05:46.793200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:05:46.793200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:05:46.793200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:05:46.793200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:05:46.793200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:05:46.793200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 16:05:46.793200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:46.793200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:05:46.793200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:46.793200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:46.793200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:46.793200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:46.793200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:46.795003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:46.795003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:46.795003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:46.795003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:46.795003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:46.795003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:46.795003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:46.795003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:05:46.795003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:05:46.795003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:05:46.795003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:05:46.795003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:46.795003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:46.795003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:46.795003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:46.795003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:46.797071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:46.797071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:46.797071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:46.797071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:46.797071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:46.797071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:46.797071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:46.797071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:46.797071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:46.797071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:46.797071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:46.797071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:05:46.797071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:05:46.797071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 16:05:46.797071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:46.797071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 391/765] 10.222.0.70 () {56 vars in 1129 bytes} [Mon Jul 25 16:05:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:46.805479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46d807-658d-49b4-b88f-9e6baf2b8edf None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:46.872180 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:46.881077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f531f83-150e-487c-ac28-41ca243193d4 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:46.925596 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da4df0-98a1-4d3d-b5e3-f452994a4650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:46.926191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da4df0-98a1-4d3d-b5e3-f452994a4650 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:46.926479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da4df0-98a1-4d3d-b5e3-f452994a4650 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:46.926757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da4df0-98a1-4d3d-b5e3-f452994a4650 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:46.927490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da4df0-98a1-4d3d-b5e3-f452994a4650 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:46.927798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da4df0-98a1-4d3d-b5e3-f452994a4650 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:46.929210 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da4df0-98a1-4d3d-b5e3-f452994a4650 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:46.964464 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 375/766] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:46.967680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da4df0-98a1-4d3d-b5e3-f452994a4650 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:47.014756 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46d807-658d-49b4-b88f-9e6baf2b8edf None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:47.083706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781277c6-3dcc-4965-a5b9-533621b22247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:47.084433 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781277c6-3dcc-4965-a5b9-533621b22247 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:47.084722 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781277c6-3dcc-4965-a5b9-533621b22247 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:47.085006 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781277c6-3dcc-4965-a5b9-533621b22247 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:47.086062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781277c6-3dcc-4965-a5b9-533621b22247 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:47.086604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781277c6-3dcc-4965-a5b9-533621b22247 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:47.089619 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781277c6-3dcc-4965-a5b9-533621b22247 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:47.095777 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 392/767] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jul 25 16:05:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:47.101251 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781277c6-3dcc-4965-a5b9-533621b22247 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:47.176954 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da4df0-98a1-4d3d-b5e3-f452994a4650 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:47.217691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:47.246326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791c436-69d8-4f32-9762-8d474c362bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:47.246762 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791c436-69d8-4f32-9762-8d474c362bcb None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:47.247053 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791c436-69d8-4f32-9762-8d474c362bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:47.247333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791c436-69d8-4f32-9762-8d474c362bcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:47.254923 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791c436-69d8-4f32-9762-8d474c362bcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:47.256593 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791c436-69d8-4f32-9762-8d474c362bcb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:47.272629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:47.273110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-0791c436-69d8-4f32-9762-8d474c362bcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:47.273110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:47.273110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:47.273110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:47.273110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:47.273110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:47.273110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:47.273110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:47.273110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:47.273110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:47.273110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:47.273110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:47.273110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:47.273110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:47.273110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:47.273908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:47.274764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:47.274764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:47.274764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:47.274764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:47.274764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:47.274764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:47.274764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:47.274764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:47.279277 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 376/768] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:05:47.281637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df85e62-b412-446b-9069-069a645476ae None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:47.282181 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df85e62-b412-446b-9069-069a645476ae None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:47.282529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df85e62-b412-446b-9069-069a645476ae None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:47.283412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781277c6-3dcc-4965-a5b9-533621b22247 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:47.288324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 377/769] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:47.288324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df85e62-b412-446b-9069-069a645476ae None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:47.323172 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a5cd6-7883-4cb1-ac07-78310d5cb805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:47.324231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a5cd6-7883-4cb1-ac07-78310d5cb805 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:47.324741 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a5cd6-7883-4cb1-ac07-78310d5cb805 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:47.325214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a5cd6-7883-4cb1-ac07-78310d5cb805 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:47.326100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a5cd6-7883-4cb1-ac07-78310d5cb805 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:47.326605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a5cd6-7883-4cb1-ac07-78310d5cb805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:47.328171 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a5cd6-7883-4cb1-ac07-78310d5cb805 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:47.338812 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 393/770] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jul 25 16:05:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:47.340378 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc79f1-4e1e-45fd-844d-8043e3061498 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:47.340813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc79f1-4e1e-45fd-844d-8043e3061498 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:47.341234 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc79f1-4e1e-45fd-844d-8043e3061498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:47.359468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0dcc79f1-4e1e-45fd-844d-8043e3061498 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:47.361453 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0dcc79f1-4e1e-45fd-844d-8043e3061498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:47.407879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df85e62-b412-446b-9069-069a645476ae None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:47.436407 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 394/771] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:05:47.437714 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc79f1-4e1e-45fd-844d-8043e3061498 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:47.450788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ea0f8-a45f-41da-9fcd-7c77510f8a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:47.451790 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ea0f8-a45f-41da-9fcd-7c77510f8a27 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:47.452343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ea0f8-a45f-41da-9fcd-7c77510f8a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:47.452856 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ea0f8-a45f-41da-9fcd-7c77510f8a27 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:47.453694 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ea0f8-a45f-41da-9fcd-7c77510f8a27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:47.454031 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ea0f8-a45f-41da-9fcd-7c77510f8a27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:47.455780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ea0f8-a45f-41da-9fcd-7c77510f8a27 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:47.482635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 378/772] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:47.487668 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ea0f8-a45f-41da-9fcd-7c77510f8a27 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:47.536676 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:47.541630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:47.551929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc79f1-4e1e-45fd-844d-8043e3061498 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:47.589617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56bd29-4a56-4668-8034-18f1ed1bc370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:47.590536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56bd29-4a56-4668-8034-18f1ed1bc370 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:47.590967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56bd29-4a56-4668-8034-18f1ed1bc370 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:47.591382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56bd29-4a56-4668-8034-18f1ed1bc370 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:47.592363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56bd29-4a56-4668-8034-18f1ed1bc370 None admin] RBAC: Adding query filter params (interface=public, service_id=bb504de7e28e469e9d7fc0edacf640f7, region_id=RegionOne) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:47.592835 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56bd29-4a56-4668-8034-18f1ed1bc370 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:47.594347 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56bd29-4a56-4668-8034-18f1ed1bc370 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:47.603513 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 395/773] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jul 25 16:05:47 2022] GET /identity/v3/endpoints?service_id=bb504de7e28e469e9d7fc0edacf640f7&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:47.608030 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ea0f8-a45f-41da-9fcd-7c77510f8a27 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:47.609122 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56bd29-4a56-4668-8034-18f1ed1bc370 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:47.645542 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0f475-4bac-404f-ad36-088c3c1cc09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:47.646466 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0f475-4bac-404f-ad36-088c3c1cc09a None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:47.646752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0f475-4bac-404f-ad36-088c3c1cc09a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:47.647028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0f475-4bac-404f-ad36-088c3c1cc09a None admin] PATH_INFO: `/v3/projects/0c9d252e2e0347029d58192fab233f09/users/c455f8d340444b068249213ff504895e/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:47.649054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0f475-4bac-404f-ad36-088c3c1cc09a None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9d252e2e0347029d58192fab233f09, user_id=c455f8d340444b068249213ff504895e, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:47.650621 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0f475-4bac-404f-ad36-088c3c1cc09a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:47.672457 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 379/774] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:05:47 2022] PUT /identity/v3/projects/0c9d252e2e0347029d58192fab233f09/users/c455f8d340444b068249213ff504895e/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:05:47.673715 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0f475-4bac-404f-ad36-088c3c1cc09a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:47.717116 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56bd29-4a56-4668-8034-18f1ed1bc370 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:47.761600 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a96c5-a25a-43c8-afd6-b03a27b5e281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:47.762677 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a96c5-a25a-43c8-afd6-b03a27b5e281 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:47.763104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a96c5-a25a-43c8-afd6-b03a27b5e281 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:47.763520 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a96c5-a25a-43c8-afd6-b03a27b5e281 None admin] PATH_INFO: `/v3/services/network` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:47.764371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a96c5-a25a-43c8-afd6-b03a27b5e281 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:47.765898 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a96c5-a25a-43c8-afd6-b03a27b5e281 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-977a96c5-a25a-43c8-afd6-b03a27b5e281 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:47.784438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:47.785676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:47.785676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:47.785676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:47.785676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:47.785676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:47.785676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:47.785676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:05:47.785676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:05:47.785676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:05:47.785676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:05:47.785676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:47.785676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:47.785676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:47.785676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:47.785676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:47.785676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:47.786604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:47.786604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:47.786604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:47.786604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:47.786604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:47.786604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:47.786604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:47.786604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:47.786604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:47.786604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:47.786604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:05:47.786604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:05:47.786604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 16:05:47.786604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:47.789024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 396/775] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:47 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:47.795313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a96c5-a25a-43c8-afd6-b03a27b5e281 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:47.840750 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:47.917614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:47.923493 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0f475-4bac-404f-ad36-088c3c1cc09a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:47.961033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a96c5-a25a-43c8-afd6-b03a27b5e281 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:47.991741 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483d2cb-5256-4c02-aa2f-eda47bb22e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:47.992902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483d2cb-5256-4c02-aa2f-eda47bb22e0e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:47.993338 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483d2cb-5256-4c02-aa2f-eda47bb22e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:47.993833 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483d2cb-5256-4c02-aa2f-eda47bb22e0e None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:47.995137 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483d2cb-5256-4c02-aa2f-eda47bb22e0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:47.997605 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483d2cb-5256-4c02-aa2f-eda47bb22e0e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:48.004374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b520a11-6b9b-4540-aaae-72e8fbb66976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:48.005263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b520a11-6b9b-4540-aaae-72e8fbb66976 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:48.005732 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b520a11-6b9b-4540-aaae-72e8fbb66976 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:48.006148 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b520a11-6b9b-4540-aaae-72e8fbb66976 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:48.007082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b520a11-6b9b-4540-aaae-72e8fbb66976 None admin] RBAC: Adding query filter params (name=network) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:48.007610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b520a11-6b9b-4540-aaae-72e8fbb66976 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:48.008509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 380/776] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 25 16:05:47 2022] GET /identity/v3/services => generated 772 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:48.009330 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b520a11-6b9b-4540-aaae-72e8fbb66976 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:48.027272 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 397/777] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 25 16:05:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:48.029034 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483d2cb-5256-4c02-aa2f-eda47bb22e0e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:48.205344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483d2cb-5256-4c02-aa2f-eda47bb22e0e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:48.256743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a0b85-f7b7-401a-be07-d03b32178261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:48.257440 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a0b85-f7b7-401a-be07-d03b32178261 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:48.257798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a0b85-f7b7-401a-be07-d03b32178261 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:48.258129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a0b85-f7b7-401a-be07-d03b32178261 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:48.258880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a0b85-f7b7-401a-be07-d03b32178261 None admin] RBAC: Adding query filter params (type=network) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:48.259190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a0b85-f7b7-401a-be07-d03b32178261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:48.260605 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a0b85-f7b7-401a-be07-d03b32178261 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:48.267262 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 381/778] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 25 16:05:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:48.272646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b520a11-6b9b-4540-aaae-72e8fbb66976 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:48.369141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:48.396081 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b520a11-6b9b-4540-aaae-72e8fbb66976 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:48.456087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3a3b2-6e38-4ffb-a73b-807aeb50ab44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:48.456798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3a3b2-6e38-4ffb-a73b-807aeb50ab44 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:48.457080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3a3b2-6e38-4ffb-a73b-807aeb50ab44 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:48.457354 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3a3b2-6e38-4ffb-a73b-807aeb50ab44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:48.458147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3a3b2-6e38-4ffb-a73b-807aeb50ab44 None admin] RBAC: Adding query filter params (interface=public, service_id=e7024a26db824754bb5c60ec5cfdcaeb, region_id=RegionOne) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:48.458457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3a3b2-6e38-4ffb-a73b-807aeb50ab44 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:48.459825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3a3b2-6e38-4ffb-a73b-807aeb50ab44 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:48.465975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 398/779] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jul 25 16:05:48 2022] GET /identity/v3/endpoints?service_id=e7024a26db824754bb5c60ec5cfdcaeb&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:48.472535 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a0b85-f7b7-401a-be07-d03b32178261 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:48.521637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:48.534016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305307e-34c5-456e-8e43-f55e46f10734 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:48.534345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305307e-34c5-456e-8e43-f55e46f10734 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:48.534580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305307e-34c5-456e-8e43-f55e46f10734 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:48.536319 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 399/780] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:48.546716 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8b507-d6bf-4dd7-a3bf-9206c1b06d38 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:48.547612 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8b507-d6bf-4dd7-a3bf-9206c1b06d38 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:48.548154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8b507-d6bf-4dd7-a3bf-9206c1b06d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:48.567496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e2c8b507-d6bf-4dd7-a3bf-9206c1b06d38 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:48.569047 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e2c8b507-d6bf-4dd7-a3bf-9206c1b06d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:48.648564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 400/781] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:05:48.650697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a0b85-f7b7-401a-be07-d03b32178261 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:48.679176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8b507-d6bf-4dd7-a3bf-9206c1b06d38 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:48.695823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14643b2-d8e3-4acf-b1f2-e17b5301658f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:48.697343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14643b2-d8e3-4acf-b1f2-e17b5301658f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:48.697859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14643b2-d8e3-4acf-b1f2-e17b5301658f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:48.698722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14643b2-d8e3-4acf-b1f2-e17b5301658f None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:48.700042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14643b2-d8e3-4acf-b1f2-e17b5301658f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:48.703261 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14643b2-d8e3-4acf-b1f2-e17b5301658f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:48.724284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 382/782] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 25 16:05:48 2022] GET /identity/v3/services => generated 772 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:48.724284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db39ad-2605-493b-834a-516b3bb38886 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:48.724284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db39ad-2605-493b-834a-516b3bb38886 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:48.724284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db39ad-2605-493b-834a-516b3bb38886 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:48.724971 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 383/783] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:48.745201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101538c-0de1-4363-a4fe-2aa9351af03a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:48.745714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101538c-0de1-4363-a4fe-2aa9351af03a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:48.746595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101538c-0de1-4363-a4fe-2aa9351af03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:48.782247 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e101538c-0de1-4363-a4fe-2aa9351af03a None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:48.783420 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e101538c-0de1-4363-a4fe-2aa9351af03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:48.840179 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:48.885516 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8b507-d6bf-4dd7-a3bf-9206c1b06d38 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:48.926761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0b5a7-67d8-4c09-baea-13d2e70411fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:48.927609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0b5a7-67d8-4c09-baea-13d2e70411fc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:48.927851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0b5a7-67d8-4c09-baea-13d2e70411fc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:48.929985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0b5a7-67d8-4c09-baea-13d2e70411fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:48.930215 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 384/784] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:05:48.951120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0b5a7-67d8-4c09-baea-13d2e70411fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:48.958939 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101538c-0de1-4363-a4fe-2aa9351af03a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:48.959639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-8be0b5a7-67d8-4c09-baea-13d2e70411fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:48.959639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:48.959639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:48.959639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:48.959639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:48.959639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:48.959639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:48.959639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:48.959639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:48.959639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:48.959639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:48.959639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:48.959639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:48.959639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:48.959639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:48.959639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:48.960876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:48.960876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:48.960876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:48.960876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:48.960876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:48.960876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:48.960876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:48.960876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:48.960876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:48.960876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:48.960876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:48.960876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:48.960876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:48.960876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:48.960876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:48.960876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:48.962064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:48.962064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:48.962064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:48.962064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:48.962064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:48.962064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:48.962064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:48.962064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:48.962064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:48.962064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:48.962064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:48.962064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:48.962064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 401/785] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:48.971322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0b5a7-67d8-4c09-baea-13d2e70411fc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:48.992601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:49.123861 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0b5a7-67d8-4c09-baea-13d2e70411fc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:49.124272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101538c-0de1-4363-a4fe-2aa9351af03a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:49.185737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c0cf7-fe58-4cc8-8746-8c505b2d83f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:49.187089 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c0cf7-fe58-4cc8-8746-8c505b2d83f3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:49.187582 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c0cf7-fe58-4cc8-8746-8c505b2d83f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:49.188059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c0cf7-fe58-4cc8-8746-8c505b2d83f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:49.205754 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb6949-f4f7-4d52-b896-86ed329b1001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:49.206461 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb6949-f4f7-4d52-b896-86ed329b1001 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:49.206729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb6949-f4f7-4d52-b896-86ed329b1001 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:49.207004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb6949-f4f7-4d52-b896-86ed329b1001 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:49.207752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb6949-f4f7-4d52-b896-86ed329b1001 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:49.208061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb6949-f4f7-4d52-b896-86ed329b1001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:49.209518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb6949-f4f7-4d52-b896-86ed329b1001 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:49.212935 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c0cf7-fe58-4cc8-8746-8c505b2d83f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:49.217570 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:49.236802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-d28c0cf7-fe58-4cc8-8746-8c505b2d83f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:49.236802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:49.236802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:49.236802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:49.236802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:49.236802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:49.236802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:49.236802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:49.236802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:49.236802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:49.236802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:49.236802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:49.236802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:49.236802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:49.236802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:49.236802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:49.238619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:49.238619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:49.238619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:49.238619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:49.238619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:49.238619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:49.238619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:49.238619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:49.238619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:49.238619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:49.238619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:49.238619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:49.238619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:49.238619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:49.238619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:49.238619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:49.240173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:49.240173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:49.240173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:49.240173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:49.240173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:49.240173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:49.240173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:49.240173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:49.240173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:49.240173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:49.240173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:49.240173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:49.241460 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 402/786] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:49.241597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb6949-f4f7-4d52-b896-86ed329b1001 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:49.245131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 385/787] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:05:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:05:49.252415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c0cf7-fe58-4cc8-8746-8c505b2d83f3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:49.424693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:49.457310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb6949-f4f7-4d52-b896-86ed329b1001 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:49.479137 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c0cf7-fe58-4cc8-8746-8c505b2d83f3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:49.510303 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355b3d0-506f-40d5-a7f7-b50c676c29b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:49.511120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355b3d0-506f-40d5-a7f7-b50c676c29b0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:49.511404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355b3d0-506f-40d5-a7f7-b50c676c29b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:49.511685 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355b3d0-506f-40d5-a7f7-b50c676c29b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:49.536220 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355b3d0-506f-40d5-a7f7-b50c676c29b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:49.537729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355b3d0-506f-40d5-a7f7-b50c676c29b0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:49.560075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b796-496a-4ca4-960b-ab351d9a9574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:49.560787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b796-496a-4ca4-960b-ab351d9a9574 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:49.561069 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b796-496a-4ca4-960b-ab351d9a9574 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:49.561437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023b796-496a-4ca4-960b-ab351d9a9574 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:49.562204 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023b796-496a-4ca4-960b-ab351d9a9574 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:49.562512 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023b796-496a-4ca4-960b-ab351d9a9574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:49.564044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023b796-496a-4ca4-960b-ab351d9a9574 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:49.578165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 386/788] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:49.580096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b796-496a-4ca4-960b-ab351d9a9574 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:49.580464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b355b3d0-506f-40d5-a7f7-b50c676c29b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:49.580464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:49.580464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:49.580464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:49.580464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:49.580464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:49.580464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:49.580464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:49.580464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:49.580464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:49.580464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:49.580464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:49.580464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:49.580464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:49.580464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:49.581305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:49.582152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:49.582152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:49.582152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:49.582152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:49.582152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 403/789] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:49.589361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355b3d0-506f-40d5-a7f7-b50c676c29b0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:49.694160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023b796-496a-4ca4-960b-ab351d9a9574 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:49.715811 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:49.732415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407b86f-e8bc-407b-9ea1-1bd60f8a1a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:49.733219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407b86f-e8bc-407b-9ea1-1bd60f8a1a5c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:49.733503 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407b86f-e8bc-407b-9ea1-1bd60f8a1a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:49.733777 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407b86f-e8bc-407b-9ea1-1bd60f8a1a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:49.745596 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407b86f-e8bc-407b-9ea1-1bd60f8a1a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:49.747124 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407b86f-e8bc-407b-9ea1-1bd60f8a1a5c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:49.749856 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:49.768570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-3407b86f-e8bc-407b-9ea1-1bd60f8a1a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:49.768570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:49.768570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:49.768570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:49.768570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:49.768570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:49.768570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:49.768570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:49.768570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:49.768570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:49.768570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:49.768570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:49.768570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:49.768570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:49.768570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:49.769545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:49.770409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:49.770409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:49.770409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:49.770409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:49.774825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 387/790] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:49.776140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407b86f-e8bc-407b-9ea1-1bd60f8a1a5c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:49.794511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355b3d0-506f-40d5-a7f7-b50c676c29b0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:49.829635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd436b-8394-4b61-a3da-d9c6482b073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:49.830473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd436b-8394-4b61-a3da-d9c6482b073b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:49.830851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd436b-8394-4b61-a3da-d9c6482b073b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:49.831228 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd436b-8394-4b61-a3da-d9c6482b073b None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:49.832051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd436b-8394-4b61-a3da-d9c6482b073b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:49.832484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd436b-8394-4b61-a3da-d9c6482b073b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:49.834061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd436b-8394-4b61-a3da-d9c6482b073b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:49.847021 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 404/791] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:49.853263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd436b-8394-4b61-a3da-d9c6482b073b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:49.889733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407b86f-e8bc-407b-9ea1-1bd60f8a1a5c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:49.928585 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c87f1-9307-4324-b60b-b1e7e741990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:49.929258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c87f1-9307-4324-b60b-b1e7e741990a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:49.929543 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c87f1-9307-4324-b60b-b1e7e741990a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:49.929821 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c87f1-9307-4324-b60b-b1e7e741990a None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:49.930546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c87f1-9307-4324-b60b-b1e7e741990a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:49.930966 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c87f1-9307-4324-b60b-b1e7e741990a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:49.932377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c87f1-9307-4324-b60b-b1e7e741990a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:49.950575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 388/792] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:49.951860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c87f1-9307-4324-b60b-b1e7e741990a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:50.013699 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:50.050463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd436b-8394-4b61-a3da-d9c6482b073b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:50.064743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c87f1-9307-4324-b60b-b1e7e741990a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:50.067124 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:50.104120 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e3b06-e9c6-4edd-a79e-0dc0e4bd4a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:50.105165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e3b06-e9c6-4edd-a79e-0dc0e4bd4a7e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:50.105450 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e3b06-e9c6-4edd-a79e-0dc0e4bd4a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:50.105729 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e3b06-e9c6-4edd-a79e-0dc0e4bd4a7e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:50.106772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a846a9-73f8-4fdb-ab93-e7f3c725df2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:50.107817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a846a9-73f8-4fdb-ab93-e7f3c725df2d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:50.108350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a846a9-73f8-4fdb-ab93-e7f3c725df2d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:50.108837 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a846a9-73f8-4fdb-ab93-e7f3c725df2d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:50.114344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e3b06-e9c6-4edd-a79e-0dc0e4bd4a7e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:50.115943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e3b06-e9c6-4edd-a79e-0dc0e4bd4a7e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:50.118103 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a846a9-73f8-4fdb-ab93-e7f3c725df2d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:50.119847 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a846a9-73f8-4fdb-ab93-e7f3c725df2d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:50.131881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-948e3b06-e9c6-4edd-a79e-0dc0e4bd4a7e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 16:05:50.131881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:50.131881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:50.131881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:50.131881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:50.131881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:50.131881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:50.131881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:50.131881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:50.131881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:50.131881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:50.131881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:50.131881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:50.131881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:50.131881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:50.131881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:50.132843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:50.133745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:50.133745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:50.133745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:50.133745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:50.133745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:50.133745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:50.133745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:50.133745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:50.133745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 16:05:50.133745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:50.137797 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 389/793] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:05:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:50.138968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e0a846a9-73f8-4fdb-ab93-e7f3c725df2d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 16:05:50.138968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:50.138968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:50.138968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:50.138968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:50.138968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:50.138968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:50.138968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:50.138968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:50.138968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:50.138968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:50.138968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:50.138968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:50.138968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:50.138968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:50.138968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:50.139830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:50.140791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:50.140791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:50.140791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:50.140791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:50.140791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:50.140791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:50.140791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:50.140791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:50.140791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 16:05:50.140791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:50.141295 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e3b06-e9c6-4edd-a79e-0dc0e4bd4a7e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:50.143994 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 405/794] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 25 16:05:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:50.149298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a846a9-73f8-4fdb-ab93-e7f3c725df2d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:50.262801 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e3b06-e9c6-4edd-a79e-0dc0e4bd4a7e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:50.304087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a846a9-73f8-4fdb-ab93-e7f3c725df2d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:50.306432 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:50.347622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f545aa4-b1ea-43c9-8751-0167db7eb273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:50.348319 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f545aa4-b1ea-43c9-8751-0167db7eb273 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:50.348599 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f545aa4-b1ea-43c9-8751-0167db7eb273 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:50.348870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f545aa4-b1ea-43c9-8751-0167db7eb273 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:50.349709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f545aa4-b1ea-43c9-8751-0167db7eb273 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:50.350011 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f545aa4-b1ea-43c9-8751-0167db7eb273 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:50.351453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f545aa4-b1ea-43c9-8751-0167db7eb273 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:50.363600 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f1194-5b70-4e9e-ba56-148c68e66fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:50.364310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f1194-5b70-4e9e-ba56-148c68e66fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:50.364591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f1194-5b70-4e9e-ba56-148c68e66fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:50.364865 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f1194-5b70-4e9e-ba56-148c68e66fe2 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:50.365704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f1194-5b70-4e9e-ba56-148c68e66fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:50.366013 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f1194-5b70-4e9e-ba56-148c68e66fe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:50.367426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f1194-5b70-4e9e-ba56-148c68e66fe2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:50.393780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 390/795] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jul 25 16:05:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:50.397521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 406/796] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jul 25 16:05:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:50.403395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f545aa4-b1ea-43c9-8751-0167db7eb273 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:50.407435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f1194-5b70-4e9e-ba56-148c68e66fe2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:50.464616 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:50.550459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f1194-5b70-4e9e-ba56-148c68e66fe2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:50.587137 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a66eeb-c562-44df-81c4-38532382b5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:50.587961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a66eeb-c562-44df-81c4-38532382b5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:50.588396 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a66eeb-c562-44df-81c4-38532382b5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:50.588673 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a66eeb-c562-44df-81c4-38532382b5e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:50.600431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a66eeb-c562-44df-81c4-38532382b5e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:50.601900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a66eeb-c562-44df-81c4-38532382b5e3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:50.616459 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f545aa4-b1ea-43c9-8751-0167db7eb273 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:50.619742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a6a66eeb-c562-44df-81c4-38532382b5e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:50.619742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:50.619742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:50.619742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:50.619742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:50.619742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:50.619742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:50.619742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:50.619742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:50.619742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:50.619742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:50.619742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:50.619742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:50.619742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:50.619742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:50.620629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:50.622526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:50.622526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:50.622526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:50.622526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:50.622526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 407/797] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:50.622526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407059b-9071-412a-9a0f-e6333bfffc16 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:50.622859 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407059b-9071-412a-9a0f-e6333bfffc16 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:50.622929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407059b-9071-412a-9a0f-e6333bfffc16 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:50.633055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 408/798] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:50.633055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407059b-9071-412a-9a0f-e6333bfffc16 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:50.664709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf676c-1fc0-40d2-9763-cf6c6ec0d94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:50.665518 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf676c-1fc0-40d2-9763-cf6c6ec0d94c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:50.665802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf676c-1fc0-40d2-9763-cf6c6ec0d94c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:50.666078 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf676c-1fc0-40d2-9763-cf6c6ec0d94c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:50.677539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf676c-1fc0-40d2-9763-cf6c6ec0d94c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:50.679008 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf676c-1fc0-40d2-9763-cf6c6ec0d94c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:50.697254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-23bf676c-1fc0-40d2-9763-cf6c6ec0d94c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:50.697254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:50.697254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:50.697254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:50.697254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:50.697254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:50.697254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:50.697254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:50.697254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:50.697254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:50.697254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:50.697254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:50.697254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:50.697254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:50.697254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:50.698258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:50.699372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:50.699372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:50.699372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:50.699372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:50.699372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 391/799] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:50.700167 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a3b9c-4357-4e65-81c9-b13b66290f75 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:50.700167 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a3b9c-4357-4e65-81c9-b13b66290f75 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:50.700342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a3b9c-4357-4e65-81c9-b13b66290f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:50.721493 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-159a3b9c-4357-4e65-81c9-b13b66290f75 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:50.723748 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-159a3b9c-4357-4e65-81c9-b13b66290f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:50.742407 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:50.756385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:50.767368 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407059b-9071-412a-9a0f-e6333bfffc16 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:50.807488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 392/800] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:05:50.809315 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfbc2c-eb7e-4680-9b5d-474baf2d8fe6 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:50.809617 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfbc2c-eb7e-4680-9b5d-474baf2d8fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:50.809868 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfbc2c-eb7e-4680-9b5d-474baf2d8fe6 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:50.811339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 393/801] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:50.811936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfbc2c-eb7e-4680-9b5d-474baf2d8fe6 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:50.823088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5ccfa-a9c0-4366-be1b-107d64c137ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:50.824669 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5ccfa-a9c0-4366-be1b-107d64c137ba None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:50.825166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5ccfa-a9c0-4366-be1b-107d64c137ba None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:50.826085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5ccfa-a9c0-4366-be1b-107d64c137ba None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:50.827363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5ccfa-a9c0-4366-be1b-107d64c137ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:50.827880 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5ccfa-a9c0-4366-be1b-107d64c137ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:50.830822 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5ccfa-a9c0-4366-be1b-107d64c137ba None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:50.845275 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 409/802] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:50.847013 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc455483-cdff-4eb0-bdbe-3f8e788ae7b8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:50.847583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc455483-cdff-4eb0-bdbe-3f8e788ae7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:50.847935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc455483-cdff-4eb0-bdbe-3f8e788ae7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:50.867676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bc455483-cdff-4eb0-bdbe-3f8e788ae7b8 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:50.869031 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bc455483-cdff-4eb0-bdbe-3f8e788ae7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:50.935419 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfbc2c-eb7e-4680-9b5d-474baf2d8fe6 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:50.945804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 410/803] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:05:50.947039 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc455483-cdff-4eb0-bdbe-3f8e788ae7b8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:50.972025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3439391-29eb-4f54-8dac-eb059535320f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:50.972743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3439391-29eb-4f54-8dac-eb059535320f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:50.973064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3439391-29eb-4f54-8dac-eb059535320f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:50.973344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3439391-29eb-4f54-8dac-eb059535320f None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:50.974079 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3439391-29eb-4f54-8dac-eb059535320f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:50.974388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3439391-29eb-4f54-8dac-eb059535320f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:50.975818 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3439391-29eb-4f54-8dac-eb059535320f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:50.989923 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 394/804] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:50.990952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3439391-29eb-4f54-8dac-eb059535320f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:51.011709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:51.044627 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:51.082170 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc455483-cdff-4eb0-bdbe-3f8e788ae7b8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:51.112355 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3439391-29eb-4f54-8dac-eb059535320f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:51.121132 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006a90d-a466-4828-b800-d33c09e44f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:51.121944 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006a90d-a466-4828-b800-d33c09e44f46 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:51.122230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006a90d-a466-4828-b800-d33c09e44f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:51.122517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006a90d-a466-4828-b800-d33c09e44f46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:51.133657 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006a90d-a466-4828-b800-d33c09e44f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:51.143065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-9006a90d-a466-4828-b800-d33c09e44f46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:51.143065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:51.143065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:51.143065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:51.143065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:51.143065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:51.143065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:51.143065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:51.143065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:51.143065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:51.143065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:51.143065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:51.143065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:51.143065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:51.143065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:51.143065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:51.144654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:51.144654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:51.144654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:51.144654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:51.144654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:51.144654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:51.144654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:51.144654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:51.144654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:51.144654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:51.144654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:51.144654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:51.144654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:51.144654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:51.144654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:51.144654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:51.145626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:51.145626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:51.145626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:51.145626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:51.145626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:51.145626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:51.145626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:51.145626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:51.145626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:51.145626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:51.145626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:51.145626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:51.145626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 411/805] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:05:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:51.150008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006a90d-a466-4828-b800-d33c09e44f46 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:51.162706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93b37b-80dd-4cb3-b708-3691799db8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:51.163519 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93b37b-80dd-4cb3-b708-3691799db8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:51.163812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93b37b-80dd-4cb3-b708-3691799db8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:51.164090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93b37b-80dd-4cb3-b708-3691799db8f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:51.171612 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93b37b-80dd-4cb3-b708-3691799db8f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:51.173658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93b37b-80dd-4cb3-b708-3691799db8f2 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:51.192752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-9a93b37b-80dd-4cb3-b708-3691799db8f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:51.192752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:51.192752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:51.192752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:51.192752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:51.192752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:51.192752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:51.192752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:51.192752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:51.192752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:51.192752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:51.192752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:51.192752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:51.192752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:51.192752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:51.193721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:51.194595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:51.194595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:51.194595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:51.194595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:51.194595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:51.194595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:51.194595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:51.194595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:51.194595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 395/806] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:51.195559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93b37b-80dd-4cb3-b708-3691799db8f2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:51.279764 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006a90d-a466-4828-b800-d33c09e44f46 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:51.300515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:51.327715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:51.330165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93b37b-80dd-4cb3-b708-3691799db8f2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:51.335504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49558b69-c00d-4e31-a7fe-df72553a2101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:51.336235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49558b69-c00d-4e31-a7fe-df72553a2101 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:51.336553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49558b69-c00d-4e31-a7fe-df72553a2101 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:51.336843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49558b69-c00d-4e31-a7fe-df72553a2101 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:51.337505 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49558b69-c00d-4e31-a7fe-df72553a2101 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:51.338914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49558b69-c00d-4e31-a7fe-df72553a2101 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:51.352922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-49558b69-c00d-4e31-a7fe-df72553a2101 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 16:05:51.352922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:51.352922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:05:51.352922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:05:51.352922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:05:51.352922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:05:51.352922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:05:51.352922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:05:51.352922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 16:05:51.352922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:51.352922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:05:51.352922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:51.352922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:51.352922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:51.352922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:51.352922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:51.353955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:51.353955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:51.353955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:51.353955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:51.353955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:51.353955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:51.353955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:51.353955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:05:51.353955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:05:51.353955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:05:51.353955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:05:51.353955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:51.353955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:51.353955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:51.353955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:51.353955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:51.354768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:51.354768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:51.354768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:51.354768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:51.354768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:51.354768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:51.354768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:51.354768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:51.354768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:51.354768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:51.354768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:51.354768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:05:51.354768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:05:51.354768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 16:05:51.354768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:51.354768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 412/807] 10.222.0.70 () {56 vars in 1129 bytes} [Mon Jul 25 16:05:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:51.356306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49558b69-c00d-4e31-a7fe-df72553a2101 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:51.394255 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1094b-ba18-4640-b231-7d7f060ef5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:51.395078 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1094b-ba18-4640-b231-7d7f060ef5cd None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:51.395381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1094b-ba18-4640-b231-7d7f060ef5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:51.395689 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1094b-ba18-4640-b231-7d7f060ef5cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:51.403288 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1094b-ba18-4640-b231-7d7f060ef5cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:51.404796 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1094b-ba18-4640-b231-7d7f060ef5cd None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:51.419964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-86f1094b-ba18-4640-b231-7d7f060ef5cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:51.419964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:51.419964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:51.419964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:51.419964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:51.419964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:51.419964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:51.419964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:51.419964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:51.419964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:51.419964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:51.419964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:51.419964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:51.419964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:51.419964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:51.420960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:51.421803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:51.421803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:51.421803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:51.421803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:51.421803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:51.421803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:51.421803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:51.421803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:51.421803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 396/808] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:51.422270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1094b-ba18-4640-b231-7d7f060ef5cd None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:51.492718 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49558b69-c00d-4e31-a7fe-df72553a2101 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:51.538549 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ee759-ac5b-4249-99b0-f1f62a91fd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:51.539270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee759-ac5b-4249-99b0-f1f62a91fd41 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:51.539511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee759-ac5b-4249-99b0-f1f62a91fd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:51.539783 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee759-ac5b-4249-99b0-f1f62a91fd41 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:51.540558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ee759-ac5b-4249-99b0-f1f62a91fd41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:51.540859 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ee759-ac5b-4249-99b0-f1f62a91fd41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:51.542304 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ee759-ac5b-4249-99b0-f1f62a91fd41 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:51.552373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 413/809] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:51.553713 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3655bd-a5c6-4c18-8f81-db7123f255a7 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:51.553848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1094b-ba18-4640-b231-7d7f060ef5cd None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:51.554009 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3655bd-a5c6-4c18-8f81-db7123f255a7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:51.554272 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3655bd-a5c6-4c18-8f81-db7123f255a7 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:51.555655 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 414/810] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:51.556195 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3655bd-a5c6-4c18-8f81-db7123f255a7 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:51.592340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169f1ca-721a-40ef-9e1f-8b081d5cbef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:51.593022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169f1ca-721a-40ef-9e1f-8b081d5cbef0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:51.593374 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169f1ca-721a-40ef-9e1f-8b081d5cbef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:51.593657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169f1ca-721a-40ef-9e1f-8b081d5cbef0 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:51.594434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169f1ca-721a-40ef-9e1f-8b081d5cbef0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:51.595359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169f1ca-721a-40ef-9e1f-8b081d5cbef0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:51.596916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169f1ca-721a-40ef-9e1f-8b081d5cbef0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:51.599504 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:51.610305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 397/811] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:51.611128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169f1ca-721a-40ef-9e1f-8b081d5cbef0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:51.614286 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:51.663461 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3655bd-a5c6-4c18-8f81-db7123f255a7 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:51.697532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc2e60-2184-4e9e-acc5-dc0373a8bd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:51.698204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2e60-2184-4e9e-acc5-dc0373a8bd69 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:51.698494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2e60-2184-4e9e-acc5-dc0373a8bd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:51.698774 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2e60-2184-4e9e-acc5-dc0373a8bd69 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:51.699476 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc2e60-2184-4e9e-acc5-dc0373a8bd69 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:51.699781 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc2e60-2184-4e9e-acc5-dc0373a8bd69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:51.701175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc2e60-2184-4e9e-acc5-dc0373a8bd69 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:51.705915 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 415/812] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jul 25 16:05:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:51.706523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc2e60-2184-4e9e-acc5-dc0373a8bd69 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:51.717876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169f1ca-721a-40ef-9e1f-8b081d5cbef0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:51.751899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0e8c6-5634-4c77-95d4-1f25d2032d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:51.752611 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0e8c6-5634-4c77-95d4-1f25d2032d0f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:51.752895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0e8c6-5634-4c77-95d4-1f25d2032d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:51.753173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0e8c6-5634-4c77-95d4-1f25d2032d0f None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:51.753962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0e8c6-5634-4c77-95d4-1f25d2032d0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:51.754269 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0e8c6-5634-4c77-95d4-1f25d2032d0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:51.755713 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0e8c6-5634-4c77-95d4-1f25d2032d0f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:51.768493 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 398/813] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:51.769702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d346e6-e67a-40a4-bb92-e0a0c1f7a925 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:51.769995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d346e6-e67a-40a4-bb92-e0a0c1f7a925 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:51.770279 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d346e6-e67a-40a4-bb92-e0a0c1f7a925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:51.793430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-38d346e6-e67a-40a4-bb92-e0a0c1f7a925 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:51.793704 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-38d346e6-e67a-40a4-bb92-e0a0c1f7a925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:51.820060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc2e60-2184-4e9e-acc5-dc0373a8bd69 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:51.847444 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:51.850902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:51.862353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8f605-1a8f-4faa-ba3b-59a8e06bc23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:51.863186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8f605-1a8f-4faa-ba3b-59a8e06bc23d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:51.863510 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8f605-1a8f-4faa-ba3b-59a8e06bc23d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:51.863720 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8f605-1a8f-4faa-ba3b-59a8e06bc23d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:51.870995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 399/814] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:05:51.871637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d346e6-e67a-40a4-bb92-e0a0c1f7a925 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:51.876353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8f605-1a8f-4faa-ba3b-59a8e06bc23d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:51.881065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8f605-1a8f-4faa-ba3b-59a8e06bc23d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:51.902177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b3a8f605-1a8f-4faa-ba3b-59a8e06bc23d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:51.902177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:51.902177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:51.902177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:51.902177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:51.902177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:51.902177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:51.902177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:51.902177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:51.902177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:51.902177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:51.902177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:51.902177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:51.902177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:51.902177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:51.903377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:51.904242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:51.904242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:51.904242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:51.904242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:51.904242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 416/815] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:51.904242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8f605-1a8f-4faa-ba3b-59a8e06bc23d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:52.001441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d346e6-e67a-40a4-bb92-e0a0c1f7a925 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:52.007088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8f605-1a8f-4faa-ba3b-59a8e06bc23d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:52.038994 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f08c7-d75d-415e-9972-15e34745ac2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:52.039881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f08c7-d75d-415e-9972-15e34745ac2c None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:52.040165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f08c7-d75d-415e-9972-15e34745ac2c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:52.040469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f08c7-d75d-415e-9972-15e34745ac2c None admin] PATH_INFO: `/v3/projects/0c9d252e2e0347029d58192fab233f09/users/ea56b6a25f8e46949e6deb8443b20673/roles/276de082c6c04d08a38361e8fea28a9a` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:52.042001 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ef0a9-6916-44a4-a66f-b8309cf81045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:52.042675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ef0a9-6916-44a4-a66f-b8309cf81045 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:52.042953 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ef0a9-6916-44a4-a66f-b8309cf81045 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:52.043226 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ef0a9-6916-44a4-a66f-b8309cf81045 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:52.043923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ef0a9-6916-44a4-a66f-b8309cf81045 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:52.044230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ef0a9-6916-44a4-a66f-b8309cf81045 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:52.045611 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ef0a9-6916-44a4-a66f-b8309cf81045 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:52.050922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 417/816] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Jul 25 16:05:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:52.051623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ef0a9-6916-44a4-a66f-b8309cf81045 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:52.058007 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f08c7-d75d-415e-9972-15e34745ac2c None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9d252e2e0347029d58192fab233f09, user_id=ea56b6a25f8e46949e6deb8443b20673, role_id=276de082c6c04d08a38361e8fea28a9a)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:52.059462 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f08c7-d75d-415e-9972-15e34745ac2c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:52.072695 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 400/817] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:05:51 2022] PUT /identity/v3/projects/0c9d252e2e0347029d58192fab233f09/users/ea56b6a25f8e46949e6deb8443b20673/roles/276de082c6c04d08a38361e8fea28a9a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:05:52.073525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f08c7-d75d-415e-9972-15e34745ac2c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:52.090138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:52.126743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:52.169965 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ef0a9-6916-44a4-a66f-b8309cf81045 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:52.201295 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f08c7-d75d-415e-9972-15e34745ac2c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:52.210279 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f85f4-77cd-4aa1-bf21-7800946aa1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:52.211911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f85f4-77cd-4aa1-bf21-7800946aa1e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:52.212274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f85f4-77cd-4aa1-bf21-7800946aa1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:52.212653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f85f4-77cd-4aa1-bf21-7800946aa1e3 None admin] PATH_INFO: `/v3/projects/0c9d252e2e0347029d58192fab233f09/users/4dbc2609b13f45dc883ae18d3d056e76/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:52.215998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f85f4-77cd-4aa1-bf21-7800946aa1e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9d252e2e0347029d58192fab233f09, user_id=4dbc2609b13f45dc883ae18d3d056e76, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:52.218430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f85f4-77cd-4aa1-bf21-7800946aa1e3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:52.242782 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 418/818] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:05:52 2022] PUT /identity/v3/projects/0c9d252e2e0347029d58192fab233f09/users/4dbc2609b13f45dc883ae18d3d056e76/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:05:52.243651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f85f4-77cd-4aa1-bf21-7800946aa1e3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:52.250517 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720d1ed-ac4b-4fe9-9ba2-4273a6d0b398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:52.251881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720d1ed-ac4b-4fe9-9ba2-4273a6d0b398 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:52.252164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720d1ed-ac4b-4fe9-9ba2-4273a6d0b398 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:52.252472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720d1ed-ac4b-4fe9-9ba2-4273a6d0b398 None admin] PATH_INFO: `/v3/services/network` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:52.253146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720d1ed-ac4b-4fe9-9ba2-4273a6d0b398 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:52.254560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720d1ed-ac4b-4fe9-9ba2-4273a6d0b398 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-0720d1ed-ac4b-4fe9-9ba2-4273a6d0b398 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:52.273445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:52.274554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:52.274554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:52.274554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:52.274554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:52.274554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:52.274554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:52.274554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:05:52.274554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:05:52.274554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:05:52.274554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:05:52.274554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:52.274554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:52.274554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:52.274554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:52.274554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:52.274554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:52.275495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:52.275495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:52.275495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:52.275495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:52.275495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:52.275495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:52.275495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:52.275495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:52.275495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:52.275495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:52.275495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:05:52.275495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:05:52.275495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 16:05:52.275495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:52.276226 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 401/819] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:52 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:52.280776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720d1ed-ac4b-4fe9-9ba2-4273a6d0b398 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:52.366374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:52.375216 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f85f4-77cd-4aa1-bf21-7800946aa1e3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:52.392796 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:52.396924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720d1ed-ac4b-4fe9-9ba2-4273a6d0b398 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:52.424761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4896ea9-08ca-4cc4-be2d-612b5222e9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:52.425957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4896ea9-08ca-4cc4-be2d-612b5222e9af None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:52.426424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4896ea9-08ca-4cc4-be2d-612b5222e9af None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:52.426901 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4896ea9-08ca-4cc4-be2d-612b5222e9af None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:52.427803 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4896ea9-08ca-4cc4-be2d-612b5222e9af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:52.428427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4896ea9-08ca-4cc4-be2d-612b5222e9af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:52.430068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4896ea9-08ca-4cc4-be2d-612b5222e9af None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:52.441481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0735ab-c88b-4601-a4e2-d74be00bc1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:52.442262 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0735ab-c88b-4601-a4e2-d74be00bc1ca None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:52.442560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0735ab-c88b-4601-a4e2-d74be00bc1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:52.442817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0735ab-c88b-4601-a4e2-d74be00bc1ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:52.443558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0735ab-c88b-4601-a4e2-d74be00bc1ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:52.445134 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0735ab-c88b-4601-a4e2-d74be00bc1ca None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:52.445572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 419/820] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:52.446651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4896ea9-08ca-4cc4-be2d-612b5222e9af None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:52.477929 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 402/821] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:05:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:05:52.478993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0735ab-c88b-4601-a4e2-d74be00bc1ca None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:52.618471 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4896ea9-08ca-4cc4-be2d-612b5222e9af None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:52.676319 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0735ab-c88b-4601-a4e2-d74be00bc1ca None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:52.679817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a324ca9-a409-4598-b626-58cc9c175629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:52.680916 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324ca9-a409-4598-b626-58cc9c175629 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:52.681523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324ca9-a409-4598-b626-58cc9c175629 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:52.682004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324ca9-a409-4598-b626-58cc9c175629 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:52.682971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a324ca9-a409-4598-b626-58cc9c175629 None admin] RBAC: Adding query filter params (name=network) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:52.683508 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a324ca9-a409-4598-b626-58cc9c175629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:52.685151 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a324ca9-a409-4598-b626-58cc9c175629 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:52.691114 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 420/822] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 25 16:05:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:52.701350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a324ca9-a409-4598-b626-58cc9c175629 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:52.717988 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2e163-e362-4249-8e04-206dd2464bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:52.718794 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2e163-e362-4249-8e04-206dd2464bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:52.719104 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2e163-e362-4249-8e04-206dd2464bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:52.720482 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2e163-e362-4249-8e04-206dd2464bd9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:52.728803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2e163-e362-4249-8e04-206dd2464bd9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:52.730288 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2e163-e362-4249-8e04-206dd2464bd9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:52.732427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:52.751774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f0a2e163-e362-4249-8e04-206dd2464bd9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:05:52.751774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:52.751774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:52.751774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:52.751774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:52.751774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:52.751774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:52.751774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:52.751774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:52.751774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:52.751774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:52.751774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:52.751774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:52.751774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:52.751774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:52.751774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:52.752865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:52.753898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:52.753898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:52.753898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:52.753898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:52.753898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:52.753898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:52.753898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:52.753898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:52.753898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:05:52.753898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:52.758011 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 403/823] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 25 16:05:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:52.759472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2e163-e362-4249-8e04-206dd2464bd9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:52.776115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:52.847794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a324ca9-a409-4598-b626-58cc9c175629 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:52.897644 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2e163-e362-4249-8e04-206dd2464bd9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:52.900445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef3f85-f841-4188-9517-aa6b31b1b3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:52.901134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3f85-f841-4188-9517-aa6b31b1b3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:52.901421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3f85-f841-4188-9517-aa6b31b1b3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:52.901957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3f85-f841-4188-9517-aa6b31b1b3c9 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:52.902676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef3f85-f841-4188-9517-aa6b31b1b3c9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:52.902987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef3f85-f841-4188-9517-aa6b31b1b3c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:52.904759 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef3f85-f841-4188-9517-aa6b31b1b3c9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:52.910390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 421/824] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 25 16:05:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:52.917312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef3f85-f841-4188-9517-aa6b31b1b3c9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:52.944169 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ea6f1-03dc-4d9b-ba07-d1e46062920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:52.945082 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ea6f1-03dc-4d9b-ba07-d1e46062920f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:52.945461 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ea6f1-03dc-4d9b-ba07-d1e46062920f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:52.945834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ea6f1-03dc-4d9b-ba07-d1e46062920f None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:52.946737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ea6f1-03dc-4d9b-ba07-d1e46062920f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:52.947112 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ea6f1-03dc-4d9b-ba07-d1e46062920f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:52.948663 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ea6f1-03dc-4d9b-ba07-d1e46062920f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:52.972692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 404/825] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 25 16:05:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:52.975080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ea6f1-03dc-4d9b-ba07-d1e46062920f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:53.048729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:53.064990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:53.078257 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef3f85-f841-4188-9517-aa6b31b1b3c9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:53.130415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ea6f1-03dc-4d9b-ba07-d1e46062920f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:53.154017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97074183-2cae-415d-b902-566269fa1eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:53.155374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97074183-2cae-415d-b902-566269fa1eaf None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:53.156048 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97074183-2cae-415d-b902-566269fa1eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:53.156579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97074183-2cae-415d-b902-566269fa1eaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:53.158353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97074183-2cae-415d-b902-566269fa1eaf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:53.159924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97074183-2cae-415d-b902-566269fa1eaf None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:53.203137 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 422/826] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:05:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:05:53.217172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787bd44-ed25-4444-99ac-f956e61d9803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:53.218240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787bd44-ed25-4444-99ac-f956e61d9803 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:53.218820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787bd44-ed25-4444-99ac-f956e61d9803 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:53.219556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787bd44-ed25-4444-99ac-f956e61d9803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:53.339068 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787bd44-ed25-4444-99ac-f956e61d9803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:53.342232 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787bd44-ed25-4444-99ac-f956e61d9803 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:53.438683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:53.489958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 405/827] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:05:53.491584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97074183-2cae-415d-b902-566269fa1eaf None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:53.640675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97074183-2cae-415d-b902-566269fa1eaf None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:53.680763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff08c1f-9248-4f5f-b572-1171ec9b6d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:53.681590 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff08c1f-9248-4f5f-b572-1171ec9b6d3f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:53.681878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff08c1f-9248-4f5f-b572-1171ec9b6d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:53.682155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff08c1f-9248-4f5f-b572-1171ec9b6d3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:53.692598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:53.695062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff08c1f-9248-4f5f-b572-1171ec9b6d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:53.696585 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff08c1f-9248-4f5f-b572-1171ec9b6d3f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:53.715921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-7ff08c1f-9248-4f5f-b572-1171ec9b6d3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:53.715921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:53.715921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:53.715921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:53.715921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:53.715921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:53.715921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:53.715921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:53.715921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:53.715921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:53.715921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:53.715921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:53.715921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:53.715921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:53.715921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:53.717404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:53.719204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:53.719204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:53.719204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:53.719204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:53.719204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 423/828] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:53.726552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787bd44-ed25-4444-99ac-f956e61d9803 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:53.846868 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787bd44-ed25-4444-99ac-f956e61d9803 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:53.883372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b192c-53bf-4837-af04-8a74e8c29033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:53.884049 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b192c-53bf-4837-af04-8a74e8c29033 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:53.884354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b192c-53bf-4837-af04-8a74e8c29033 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:53.884645 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b192c-53bf-4837-af04-8a74e8c29033 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:53.885348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b192c-53bf-4837-af04-8a74e8c29033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:53.885719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b192c-53bf-4837-af04-8a74e8c29033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:53.887165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b192c-53bf-4837-af04-8a74e8c29033 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:53.903011 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 406/829] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:53.910001 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff08c1f-9248-4f5f-b572-1171ec9b6d3f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:54.030335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff08c1f-9248-4f5f-b572-1171ec9b6d3f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:54.067996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33066e58-9728-47ed-9723-4ae8745c9505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:54.068900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33066e58-9728-47ed-9723-4ae8745c9505 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:54.069238 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33066e58-9728-47ed-9723-4ae8745c9505 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:54.069528 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33066e58-9728-47ed-9723-4ae8745c9505 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:54.077201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33066e58-9728-47ed-9723-4ae8745c9505 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:54.078730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33066e58-9728-47ed-9723-4ae8745c9505 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:54.096999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-33066e58-9728-47ed-9723-4ae8745c9505 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:54.096999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:54.096999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:54.096999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:54.096999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:54.096999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:54.096999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:54.096999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:54.096999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:54.096999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:54.096999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:54.096999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:54.096999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:54.096999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:54.096999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:54.098147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:54.099526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:54.099526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:54.099526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:54.099526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:54.099526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:54.099526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:54.099526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:54.099526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:54.099526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 424/830] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:54.108624 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b192c-53bf-4837-af04-8a74e8c29033 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:54.148493 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:54.235584 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b192c-53bf-4837-af04-8a74e8c29033 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:54.273340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2704f-5ef6-42ef-8557-063e885e91c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:54.274025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2704f-5ef6-42ef-8557-063e885e91c1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:54.274312 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2704f-5ef6-42ef-8557-063e885e91c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:54.274594 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2704f-5ef6-42ef-8557-063e885e91c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:54.275449 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2704f-5ef6-42ef-8557-063e885e91c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:54.275769 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2704f-5ef6-42ef-8557-063e885e91c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:54.277672 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2704f-5ef6-42ef-8557-063e885e91c1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:54.293277 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 407/831] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:54.299541 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33066e58-9728-47ed-9723-4ae8745c9505 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:54.369413 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:54.442617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33066e58-9728-47ed-9723-4ae8745c9505 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:54.479759 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6f44c-bd50-4048-9e21-50fda6faa5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:54.480465 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6f44c-bd50-4048-9e21-50fda6faa5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:54.480743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6f44c-bd50-4048-9e21-50fda6faa5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:54.481023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6f44c-bd50-4048-9e21-50fda6faa5f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:54.482606 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5b11b-ce3f-4eec-8507-af3321abd62f None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:54.483391 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5b11b-ce3f-4eec-8507-af3321abd62f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:54.483391 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5b11b-ce3f-4eec-8507-af3321abd62f None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:54.484825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 408/832] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:05:54.486211 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6f44c-bd50-4048-9e21-50fda6faa5f5 None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=c455f8d340444b068249213ff504895e) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:54.486833 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6f44c-bd50-4048-9e21-50fda6faa5f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:54.488902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6f44c-bd50-4048-9e21-50fda6faa5f5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:54.499424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 425/833] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:05:54 2022] GET /identity/v3/role_assignments?user.id=c455f8d340444b068249213ff504895e&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:54.499608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf2d5f-d92f-4fa7-94d0-5b0e85c9452c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:54.499897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf2d5f-d92f-4fa7-94d0-5b0e85c9452c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:54.500447 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf2d5f-d92f-4fa7-94d0-5b0e85c9452c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:54.526244 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-93cf2d5f-d92f-4fa7-94d0-5b0e85c9452c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:54.528118 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-93cf2d5f-d92f-4fa7-94d0-5b0e85c9452c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:54.614720 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 409/834] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:05:54.637509 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6f44c-bd50-4048-9e21-50fda6faa5f5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:54.661706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16642ac0-1343-4a73-a121-3f2fe2b34b13 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:54.662432 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16642ac0-1343-4a73-a121-3f2fe2b34b13 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:54.663142 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16642ac0-1343-4a73-a121-3f2fe2b34b13 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:54.665700 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 410/835] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:05:54.674506 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d041e-7e5e-43ee-b6ce-d6c7127ffa3f None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:54.675266 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d041e-7e5e-43ee-b6ce-d6c7127ffa3f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:54.675782 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d041e-7e5e-43ee-b6ce-d6c7127ffa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:54.702155 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7e0d041e-7e5e-43ee-b6ce-d6c7127ffa3f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:54.703510 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7e0d041e-7e5e-43ee-b6ce-d6c7127ffa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:54.717319 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:54.813007 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6f44c-bd50-4048-9e21-50fda6faa5f5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:54.813829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 411/836] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:05:54.837150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d041e-7e5e-43ee-b6ce-d6c7127ffa3f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:54.864688 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:54.869595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f3dd9-f149-4cbc-9740-a60cf1ef008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:54.870404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f3dd9-f149-4cbc-9740-a60cf1ef008c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:54.870682 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f3dd9-f149-4cbc-9740-a60cf1ef008c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:54.871029 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f3dd9-f149-4cbc-9740-a60cf1ef008c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:54.890290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f3dd9-f149-4cbc-9740-a60cf1ef008c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:54.902521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f37f3dd9-f149-4cbc-9740-a60cf1ef008c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:54.902521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:54.902521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:54.902521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:54.902521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:54.902521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:54.902521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:54.902521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:54.902521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:54.902521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:54.902521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:54.902521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:54.902521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:54.902521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:54.902521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:54.902521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:54.903538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:54.903538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:54.903538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:54.903538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:54.903538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:54.903538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:54.903538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:54.903538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:54.903538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:54.903538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:54.903538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:54.903538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:54.903538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:54.903538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:54.903538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:54.903538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:54.904367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:54.904367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:54.904367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:54.904367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:54.904367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:54.904367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:54.904367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:54.904367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:54.904367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:54.904367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:54.904367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:05:54.904367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:54.906661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 426/837] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:05:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:54.913542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f3dd9-f149-4cbc-9740-a60cf1ef008c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:54.964477 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d041e-7e5e-43ee-b6ce-d6c7127ffa3f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:55.005520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bc6f2-c419-488c-9309-e56c15504305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:55.006579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bc6f2-c419-488c-9309-e56c15504305 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:55.007004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bc6f2-c419-488c-9309-e56c15504305 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:55.007449 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bc6f2-c419-488c-9309-e56c15504305 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:55.019588 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bc6f2-c419-488c-9309-e56c15504305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:05:55.028687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-4a4bc6f2-c419-488c-9309-e56c15504305 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:55.028687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:55.028687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:55.028687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:55.028687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:55.028687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:55.028687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:55.028687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:55.028687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:55.028687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:55.028687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:55.028687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:55.028687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:05:55.028687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:05:55.028687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:05:55.028687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:05:55.029744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:05:55.029744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:05:55.029744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:05:55.029744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:05:55.029744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:55.029744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:55.029744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:55.029744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:55.029744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:55.029744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:55.029744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:55.029744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:55.029744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:55.029744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:55.029744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:55.029744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:55.030551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:55.030551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:55.030551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:55.030551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:55.030551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:05:55.030551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:05:55.030551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:05:55.030551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:05:55.030551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:05:55.030551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:05:55.030551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:05:55.030551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:55.038720 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 412/838] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:05:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:05:55.039941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bc6f2-c419-488c-9309-e56c15504305 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:55.045658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f3dd9-f149-4cbc-9740-a60cf1ef008c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:55.051143 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:55.099135 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa957173-9f91-4f92-8eeb-828e80767791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:55.100242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa957173-9f91-4f92-8eeb-828e80767791 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:55.100788 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa957173-9f91-4f92-8eeb-828e80767791 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:55.101262 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa957173-9f91-4f92-8eeb-828e80767791 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:55.102302 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa957173-9f91-4f92-8eeb-828e80767791 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:55.102823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa957173-9f91-4f92-8eeb-828e80767791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:55.104533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa957173-9f91-4f92-8eeb-828e80767791 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:55.116801 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 427/839] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:05:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:55.122966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa957173-9f91-4f92-8eeb-828e80767791 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:55.169162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:55.176077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bc6f2-c419-488c-9309-e56c15504305 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:55.216262 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3a7ea-6262-4cef-96cb-a88891df9e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:55.216973 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3a7ea-6262-4cef-96cb-a88891df9e2c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:55.217258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3a7ea-6262-4cef-96cb-a88891df9e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:55.217545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3a7ea-6262-4cef-96cb-a88891df9e2c None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:55.218292 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3a7ea-6262-4cef-96cb-a88891df9e2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:55.218603 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3a7ea-6262-4cef-96cb-a88891df9e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:55.220063 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3a7ea-6262-4cef-96cb-a88891df9e2c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:55.236438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 413/840] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:05:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:55.236438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969cc96-57a1-46c5-a01a-1845ca549b77 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:55.236438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969cc96-57a1-46c5-a01a-1845ca549b77 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:55.236438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969cc96-57a1-46c5-a01a-1845ca549b77 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:55.236438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 414/841] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:55.241085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa849ffc-a143-485f-b468-148d21b1a418 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:55.241340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa849ffc-a143-485f-b468-148d21b1a418 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:55.241630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa849ffc-a143-485f-b468-148d21b1a418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:55.260768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-fa849ffc-a143-485f-b468-148d21b1a418 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:55.261995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-fa849ffc-a143-485f-b468-148d21b1a418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:55.267770 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa957173-9f91-4f92-8eeb-828e80767791 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:55.310753 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfe8db-5a3a-47ea-996c-caf47ba7ac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:55.311568 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfe8db-5a3a-47ea-996c-caf47ba7ac7c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:55.311860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfe8db-5a3a-47ea-996c-caf47ba7ac7c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:55.312137 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfe8db-5a3a-47ea-996c-caf47ba7ac7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:55.323994 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfe8db-5a3a-47ea-996c-caf47ba7ac7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:55.325620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfe8db-5a3a-47ea-996c-caf47ba7ac7c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:55.341556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:55.346729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-31dfe8db-5a3a-47ea-996c-caf47ba7ac7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:55.346729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:55.346729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:55.346729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:55.346729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:55.346729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:55.346729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:55.346729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:55.346729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:55.346729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:55.346729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:55.346729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:55.346729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:55.346729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:55.346729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:55.347771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:55.354485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:55.354485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:55.354485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:55.354485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:55.354485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 428/842] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:55.354767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 415/843] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:05:55.354767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa849ffc-a143-485f-b468-148d21b1a418 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:55.357502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfe8db-5a3a-47ea-996c-caf47ba7ac7c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:55.468285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:55.475148 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa849ffc-a143-485f-b468-148d21b1a418 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:55.480968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfe8db-5a3a-47ea-996c-caf47ba7ac7c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:55.518264 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da275cc5-d8ac-4736-8dbc-f5bdd4e8aa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:55.518930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da275cc5-d8ac-4736-8dbc-f5bdd4e8aa22 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:55.519298 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da275cc5-d8ac-4736-8dbc-f5bdd4e8aa22 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:55.519498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da275cc5-d8ac-4736-8dbc-f5bdd4e8aa22 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:55.520219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da275cc5-d8ac-4736-8dbc-f5bdd4e8aa22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:55.520930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da275cc5-d8ac-4736-8dbc-f5bdd4e8aa22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:55.521760 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc11dd0-6bc9-4667-99e8-54a80a888c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:55.522078 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da275cc5-d8ac-4736-8dbc-f5bdd4e8aa22 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:55.522880 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11dd0-6bc9-4667-99e8-54a80a888c5e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:55.523335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11dd0-6bc9-4667-99e8-54a80a888c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:55.523693 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11dd0-6bc9-4667-99e8-54a80a888c5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:55.536290 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 416/844] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:05:55.537152 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da275cc5-d8ac-4736-8dbc-f5bdd4e8aa22 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:55.546118 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc11dd0-6bc9-4667-99e8-54a80a888c5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:55.548303 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc11dd0-6bc9-4667-99e8-54a80a888c5e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:55.573635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-7bc11dd0-6bc9-4667-99e8-54a80a888c5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:55.573635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:55.573635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:55.573635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:55.573635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:55.573635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:55.573635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:55.573635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:55.573635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:55.573635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:55.573635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:55.573635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:55.573635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:55.573635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:55.573635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:55.574598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:55.575451 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:55.575451 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:55.575451 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:55.575451 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:55.582474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 429/845] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:55.582474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc11dd0-6bc9-4667-99e8-54a80a888c5e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:55.606160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:55.655911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da275cc5-d8ac-4736-8dbc-f5bdd4e8aa22 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:55.698129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f7a0d-d6fc-4515-b34e-4ad87bfc099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:55.698945 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f7a0d-d6fc-4515-b34e-4ad87bfc099a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:55.699227 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f7a0d-d6fc-4515-b34e-4ad87bfc099a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:55.699498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f7a0d-d6fc-4515-b34e-4ad87bfc099a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:55.700398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f7a0d-d6fc-4515-b34e-4ad87bfc099a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:55.701581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f7a0d-d6fc-4515-b34e-4ad87bfc099a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-485f7a0d-d6fc-4515-b34e-4ad87bfc099a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:55.714198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:55.715616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:55.715616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:55.715616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:55.715616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:55.715616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:55.715616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:55.715616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:05:55.715616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:05:55.715616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:05:55.715616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:05:55.715616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:55.715616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:55.715616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:55.715616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:55.715616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:55.715616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:55.717388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:55.717388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:55.717388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:55.717388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:55.717388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:55.717388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:55.717388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:55.717388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:55.717388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:55.717388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:55.717388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:05:55.717388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:05:55.717388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 16:05:55.717388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:55.717388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 417/846] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:05:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:55.718162 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f7a0d-d6fc-4515-b34e-4ad87bfc099a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:55.742289 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc11dd0-6bc9-4667-99e8-54a80a888c5e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:55.782865 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fb196-2056-4e8e-9896-e4f099d9a4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:55.783705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fb196-2056-4e8e-9896-e4f099d9a4ce None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:55.783998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fb196-2056-4e8e-9896-e4f099d9a4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:55.784388 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fb196-2056-4e8e-9896-e4f099d9a4ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:55.792919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fb196-2056-4e8e-9896-e4f099d9a4ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:55.794392 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fb196-2056-4e8e-9896-e4f099d9a4ce None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:55.810676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e29fb196-2056-4e8e-9896-e4f099d9a4ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 16:05:55.810676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:55.810676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:55.810676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:55.810676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:55.810676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:55.810676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:55.810676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:55.810676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:55.810676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:55.810676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:55.810676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:55.810676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:55.810676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:55.810676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:55.810676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:55.811749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:55.812689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:55.812689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:55.812689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:55.812689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:55.812689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:55.812689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:55.812689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:55.812689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:55.812689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 16:05:55.812689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:55.812689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 430/847] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 25 16:05:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:55.813772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fb196-2056-4e8e-9896-e4f099d9a4ce None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:55.817361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:55.846217 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f7a0d-d6fc-4515-b34e-4ad87bfc099a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:55.877058 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:55.897626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e144d-305f-461c-a333-83d3c8c2e41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:55.898917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e144d-305f-461c-a333-83d3c8c2e41f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:55.899199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e144d-305f-461c-a333-83d3c8c2e41f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:55.899474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e144d-305f-461c-a333-83d3c8c2e41f None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:55.900202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e144d-305f-461c-a333-83d3c8c2e41f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:55.900911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e144d-305f-461c-a333-83d3c8c2e41f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:55.902922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e144d-305f-461c-a333-83d3c8c2e41f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:55.925270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 418/848] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:55.925270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e144d-305f-461c-a333-83d3c8c2e41f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:55.925746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fb196-2056-4e8e-9896-e4f099d9a4ce None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:55.965699 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47421a1-b06a-44f8-ae72-523c966a1e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:55.966376 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47421a1-b06a-44f8-ae72-523c966a1e0a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:55.966663 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47421a1-b06a-44f8-ae72-523c966a1e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:55.967390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47421a1-b06a-44f8-ae72-523c966a1e0a None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:55.968121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47421a1-b06a-44f8-ae72-523c966a1e0a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:55.968466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47421a1-b06a-44f8-ae72-523c966a1e0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:55.970688 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47421a1-b06a-44f8-ae72-523c966a1e0a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:55.976065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 431/849] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:05:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:55.976896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47421a1-b06a-44f8-ae72-523c966a1e0a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:56.050394 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:56.054624 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e144d-305f-461c-a333-83d3c8c2e41f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:56.103687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1b85a-0352-4381-836c-7454f36a0e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:56.104395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1b85a-0352-4381-836c-7454f36a0e8f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:56.104680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1b85a-0352-4381-836c-7454f36a0e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:56.104951 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1b85a-0352-4381-836c-7454f36a0e8f None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:56.105113 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47421a1-b06a-44f8-ae72-523c966a1e0a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:56.105798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1b85a-0352-4381-836c-7454f36a0e8f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:56.106102 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1b85a-0352-4381-836c-7454f36a0e8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:56.108543 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1b85a-0352-4381-836c-7454f36a0e8f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:56.134735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 419/850] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jul 25 16:05:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:56.134735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1b85a-0352-4381-836c-7454f36a0e8f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:56.168986 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b37dc-95bf-474f-a720-041200434849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:56.169875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b37dc-95bf-474f-a720-041200434849 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:56.170196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b37dc-95bf-474f-a720-041200434849 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:56.170642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b37dc-95bf-474f-a720-041200434849 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:56.180874 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b37dc-95bf-474f-a720-041200434849 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:56.182374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b37dc-95bf-474f-a720-041200434849 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:56.186780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:56.198173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6b1b37dc-95bf-474f-a720-041200434849 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 16:05:56.198173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:56.198173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:56.198173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:56.198173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:56.198173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:56.198173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:56.198173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:56.198173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:56.198173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:56.198173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:56.198173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:56.198173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:05:56.198173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:05:56.198173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:05:56.198173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:56.199177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:56.200105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:56.200105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:56.200105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:05:56.200105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:05:56.200105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:05:56.200105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:05:56.200105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:05:56.200105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:05:56.200105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 16:05:56.200105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:56.200105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 432/851] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:05:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:56.200714 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b37dc-95bf-474f-a720-041200434849 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:56.282270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1b85a-0352-4381-836c-7454f36a0e8f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:56.320781 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b37dc-95bf-474f-a720-041200434849 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:56.324036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d30d46-9151-4026-9f1f-2ee44ca7549f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:56.325003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d30d46-9151-4026-9f1f-2ee44ca7549f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:56.325271 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d30d46-9151-4026-9f1f-2ee44ca7549f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:56.325547 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d30d46-9151-4026-9f1f-2ee44ca7549f None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:56.326260 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d30d46-9151-4026-9f1f-2ee44ca7549f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:56.326559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d30d46-9151-4026-9f1f-2ee44ca7549f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:56.327958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d30d46-9151-4026-9f1f-2ee44ca7549f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:56.334193 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 420/852] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:05:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:56.335064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d30d46-9151-4026-9f1f-2ee44ca7549f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:56.368852 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:56.386443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904d340-5d0b-4536-8d5a-721115a55214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:56.387139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d340-5d0b-4536-8d5a-721115a55214 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:56.387422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d340-5d0b-4536-8d5a-721115a55214 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:56.387698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d340-5d0b-4536-8d5a-721115a55214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:56.485675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904d340-5d0b-4536-8d5a-721115a55214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:56.487394 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904d340-5d0b-4536-8d5a-721115a55214 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:56.502895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d30d46-9151-4026-9f1f-2ee44ca7549f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:56.506907 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:56.573969 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72685572-418c-44db-840a-68a709db728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:56.574856 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72685572-418c-44db-840a-68a709db728c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:56.575594 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72685572-418c-44db-840a-68a709db728c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:56.575882 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72685572-418c-44db-840a-68a709db728c None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:56.576788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72685572-418c-44db-840a-68a709db728c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:56.577258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72685572-418c-44db-840a-68a709db728c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:56.579432 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72685572-418c-44db-840a-68a709db728c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:56.613490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 421/853] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Jul 25 16:05:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:56.620306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72685572-418c-44db-840a-68a709db728c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:56.662005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 433/854] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:56 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:05:56.667358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904d340-5d0b-4536-8d5a-721115a55214 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:56.717777 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:56.779557 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72685572-418c-44db-840a-68a709db728c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:56.830659 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904d340-5d0b-4536-8d5a-721115a55214 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:56.832683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560726bb-6f97-49b9-bdca-2eea2b63b2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:56.833842 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560726bb-6f97-49b9-bdca-2eea2b63b2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:56.834358 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560726bb-6f97-49b9-bdca-2eea2b63b2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:56.834859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560726bb-6f97-49b9-bdca-2eea2b63b2d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:56.877152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cf4eb-a589-4a11-af51-73ec52373b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:56.878058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cf4eb-a589-4a11-af51-73ec52373b20 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:56.878480 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cf4eb-a589-4a11-af51-73ec52373b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:56.878910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cf4eb-a589-4a11-af51-73ec52373b20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:56.879711 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:56.893061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cf4eb-a589-4a11-af51-73ec52373b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:56.894558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cf4eb-a589-4a11-af51-73ec52373b20 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:56.914984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f28cf4eb-a589-4a11-af51-73ec52373b20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:56.914984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:56.914984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:56.914984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:56.914984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:56.914984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:56.914984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:56.914984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:56.914984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:56.914984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:56.914984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:56.914984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:56.914984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:56.914984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:56.914984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:56.916053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:56.925100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:56.925100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:56.925100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:56.925100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:56.925100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 434/855] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:05:56.925100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c143d-3202-44e9-8403-ecb3e58a8404 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:56.925100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c143d-3202-44e9-8403-ecb3e58a8404 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:56.925100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c143d-3202-44e9-8403-ecb3e58a8404 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:56.925100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 435/856] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:05:56.925844 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c143d-3202-44e9-8403-ecb3e58a8404 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:56.940095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560726bb-6f97-49b9-bdca-2eea2b63b2d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:56.942219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560726bb-6f97-49b9-bdca-2eea2b63b2d7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:57.024126 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:57.053001 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c143d-3202-44e9-8403-ecb3e58a8404 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:57.095076 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1fde7-28e4-47d1-8bae-87802f43bab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:57.095641 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1fde7-28e4-47d1-8bae-87802f43bab3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:57.095922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1fde7-28e4-47d1-8bae-87802f43bab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:57.096201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1fde7-28e4-47d1-8bae-87802f43bab3 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:57.096969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1fde7-28e4-47d1-8bae-87802f43bab3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:57.097283 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1fde7-28e4-47d1-8bae-87802f43bab3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:57.098807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1fde7-28e4-47d1-8bae-87802f43bab3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:57.104545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 422/857] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:05:56 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:05:57.105828 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec927eb-b007-45f0-8f7a-a0f125576484 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:57.106116 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec927eb-b007-45f0-8f7a-a0f125576484 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:57.106395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec927eb-b007-45f0-8f7a-a0f125576484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:57.118643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 436/858] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:57.118643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1fde7-28e4-47d1-8bae-87802f43bab3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:57.138635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-bec927eb-b007-45f0-8f7a-a0f125576484 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:57.140088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bec927eb-b007-45f0-8f7a-a0f125576484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:57.238009 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1fde7-28e4-47d1-8bae-87802f43bab3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:57.253525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:57.273291 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 423/859] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:05:57.275227 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec927eb-b007-45f0-8f7a-a0f125576484 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:57.289504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a2307-a647-452a-ba6b-ad753161193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:57.290579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a2307-a647-452a-ba6b-ad753161193e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:57.291004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a2307-a647-452a-ba6b-ad753161193e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:57.291422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a2307-a647-452a-ba6b-ad753161193e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:57.300767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:57.306284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a2307-a647-452a-ba6b-ad753161193e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:57.308111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a2307-a647-452a-ba6b-ad753161193e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:57.332023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-8e1a2307-a647-452a-ba6b-ad753161193e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:57.332023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:57.332023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:57.332023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:57.332023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:57.332023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:57.332023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:57.332023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:57.332023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:57.332023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:57.332023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:57.332023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:57.332023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:05:57.332023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:05:57.332023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:57.333422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:57.341111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:05:57.341111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:05:57.341111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:05:57.341111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:57.341111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 437/860] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:57.341111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a2307-a647-452a-ba6b-ad753161193e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:57.423601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec927eb-b007-45f0-8f7a-a0f125576484 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:57.462554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a2307-a647-452a-ba6b-ad753161193e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:57.469622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ce2a2-0a5c-46a8-b2e5-414b6177ef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:57.470538 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce2a2-0a5c-46a8-b2e5-414b6177ef38 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:57.470895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce2a2-0a5c-46a8-b2e5-414b6177ef38 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:57.471320 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce2a2-0a5c-46a8-b2e5-414b6177ef38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:57.482212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ce2a2-0a5c-46a8-b2e5-414b6177ef38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:57.483874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ce2a2-0a5c-46a8-b2e5-414b6177ef38 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:57.498832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-872ce2a2-0a5c-46a8-b2e5-414b6177ef38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:57.498832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:57.498832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:57.498832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:57.498832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:57.498832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:57.498832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:57.498832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:57.498832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:57.498832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:57.498832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:57.498832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:57.498832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:57.498832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:57.498832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:57.499962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:57.501760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:57.501760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:57.501760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:57.501760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:57.501760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:57.501760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:57.501760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:57.501760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:05:57.506391 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 424/861] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:57.506814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ce2a2-0a5c-46a8-b2e5-414b6177ef38 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:57.507964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915fbf5-eb1f-4ba8-b9a9-55d0d15204d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:57.508963 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915fbf5-eb1f-4ba8-b9a9-55d0d15204d4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:57.509349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915fbf5-eb1f-4ba8-b9a9-55d0d15204d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:57.509826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915fbf5-eb1f-4ba8-b9a9-55d0d15204d4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:57.510605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915fbf5-eb1f-4ba8-b9a9-55d0d15204d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:57.512131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915fbf5-eb1f-4ba8-b9a9-55d0d15204d4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:57.525491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-8915fbf5-eb1f-4ba8-b9a9-55d0d15204d4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 16:05:57.525491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:57.525491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:05:57.525491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:05:57.525491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:05:57.525491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:05:57.525491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:05:57.525491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:05:57.525491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 16:05:57.525491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:57.525491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:05:57.525491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:57.525491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:57.525491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:57.525491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:57.525491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:57.526921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:57.526921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:57.526921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:57.526921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:57.526921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:57.526921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:57.526921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:57.526921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:05:57.526921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:05:57.526921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:05:57.526921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:05:57.526921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:57.526921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:57.526921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:57.526921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:57.526921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:57.527951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:57.527951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:57.527951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:57.527951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:57.527951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:57.527951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:57.527951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:57.527951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:57.527951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:57.527951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:57.527951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:57.527951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:05:57.527951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:05:57.527951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 16:05:57.527951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:57.527951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 438/862] 10.222.0.70 () {56 vars in 1132 bytes} [Mon Jul 25 16:05:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:57.528975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915fbf5-eb1f-4ba8-b9a9-55d0d15204d4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:57.570510 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:57.597692 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:57.624890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ce2a2-0a5c-46a8-b2e5-414b6177ef38 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:57.654112 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915fbf5-eb1f-4ba8-b9a9-55d0d15204d4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:57.675348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae6af9-b24e-416a-a240-9aee8cec8ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:57.676712 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6af9-b24e-416a-a240-9aee8cec8ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:57.677339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6af9-b24e-416a-a240-9aee8cec8ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:57.677960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6af9-b24e-416a-a240-9aee8cec8ee8 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:57.679662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae6af9-b24e-416a-a240-9aee8cec8ee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:57.680328 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae6af9-b24e-416a-a240-9aee8cec8ee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:57.683644 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae6af9-b24e-416a-a240-9aee8cec8ee8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:57.696296 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5857eb-3ef8-4e25-b92a-bc9758e71184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:57.697075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5857eb-3ef8-4e25-b92a-bc9758e71184 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:57.697429 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5857eb-3ef8-4e25-b92a-bc9758e71184 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:57.698253 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5857eb-3ef8-4e25-b92a-bc9758e71184 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:57.699200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5857eb-3ef8-4e25-b92a-bc9758e71184 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:57.699584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5857eb-3ef8-4e25-b92a-bc9758e71184 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:57.701184 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5857eb-3ef8-4e25-b92a-bc9758e71184 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:57.707166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 425/863] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:57.707948 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae6af9-b24e-416a-a240-9aee8cec8ee8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:57.722281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 439/864] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:57.722281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5857eb-3ef8-4e25-b92a-bc9758e71184 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:57.850084 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae6af9-b24e-416a-a240-9aee8cec8ee8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:57.866418 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5857eb-3ef8-4e25-b92a-bc9758e71184 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:57.880568 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:57.892903 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:57.913581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9073b6-59a5-48f2-96b9-a8e284240623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:57.914703 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9073b6-59a5-48f2-96b9-a8e284240623 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:57.915123 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9073b6-59a5-48f2-96b9-a8e284240623 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:57.915603 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9073b6-59a5-48f2-96b9-a8e284240623 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:57.916505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9073b6-59a5-48f2-96b9-a8e284240623 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:57.917028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9073b6-59a5-48f2-96b9-a8e284240623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:57.918822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9073b6-59a5-48f2-96b9-a8e284240623 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:57.932387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 426/865] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 25 16:05:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:57.932387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9073b6-59a5-48f2-96b9-a8e284240623 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:57.937813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e52b41-d7c1-4306-bcd7-6b923dcaa6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:57.939974 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e52b41-d7c1-4306-bcd7-6b923dcaa6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:57.940614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e52b41-d7c1-4306-bcd7-6b923dcaa6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:57.941107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e52b41-d7c1-4306-bcd7-6b923dcaa6f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:57.954308 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e52b41-d7c1-4306-bcd7-6b923dcaa6f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:57.957057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e52b41-d7c1-4306-bcd7-6b923dcaa6f7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:57.980609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e7e52b41-d7c1-4306-bcd7-6b923dcaa6f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:57.980609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:05:57.980609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:05:57.980609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:05:57.980609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:05:57.980609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:05:57.980609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:05:57.980609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:05:57.980609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:05:57.980609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:05:57.980609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:05:57.980609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:05:57.980609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:05:57.980609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:05:57.980609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:05:57.982373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:05:57.984996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:05:57.984996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:05:57.984996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:05:57.984996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:05:57.984996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:05:57.984996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:05:57.984996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:05:57.984996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:05:57.984996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 440/866] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:05:57.984996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e52b41-d7c1-4306-bcd7-6b923dcaa6f7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:58.071320 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9073b6-59a5-48f2-96b9-a8e284240623 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:58.112476 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e52b41-d7c1-4306-bcd7-6b923dcaa6f7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:58.115149 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42274189-cbfe-477f-a71e-78870907bfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:58.115918 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42274189-cbfe-477f-a71e-78870907bfc1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:58.116215 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42274189-cbfe-477f-a71e-78870907bfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:58.116540 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42274189-cbfe-477f-a71e-78870907bfc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:58.117375 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42274189-cbfe-477f-a71e-78870907bfc1 None admin] RBAC: Adding query filter params (role.id=276de082c6c04d08a38361e8fea28a9a, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=ea56b6a25f8e46949e6deb8443b20673) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:58.117692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42274189-cbfe-477f-a71e-78870907bfc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:58.119177 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42274189-cbfe-477f-a71e-78870907bfc1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:58.136352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 427/867] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:05:57 2022] GET /identity/v3/role_assignments?user.id=ea56b6a25f8e46949e6deb8443b20673&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=276de082c6c04d08a38361e8fea28a9a => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:58.136352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42274189-cbfe-477f-a71e-78870907bfc1 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:58.169068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83958efc-0e5a-4dfc-a9d5-1d048544a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:58.169886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83958efc-0e5a-4dfc-a9d5-1d048544a308 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:58.170249 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83958efc-0e5a-4dfc-a9d5-1d048544a308 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:58.170588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83958efc-0e5a-4dfc-a9d5-1d048544a308 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:58.171406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83958efc-0e5a-4dfc-a9d5-1d048544a308 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:58.171782 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83958efc-0e5a-4dfc-a9d5-1d048544a308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:58.173442 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83958efc-0e5a-4dfc-a9d5-1d048544a308 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:58.184989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 441/868] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 25 16:05:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:58.241091 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:58.320436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42274189-cbfe-477f-a71e-78870907bfc1 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:58.382029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b800de-a8f9-4d31-abee-471b6efc97cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:58.382262 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b800de-a8f9-4d31-abee-471b6efc97cf None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:58.382546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b800de-a8f9-4d31-abee-471b6efc97cf None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:58.382773 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b800de-a8f9-4d31-abee-471b6efc97cf None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:58.383584 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b800de-a8f9-4d31-abee-471b6efc97cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:58.383893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b800de-a8f9-4d31-abee-471b6efc97cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:58.385409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b800de-a8f9-4d31-abee-471b6efc97cf None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:58.402308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 428/869] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:05:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:58.408310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83958efc-0e5a-4dfc-a9d5-1d048544a308 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:58.466439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:58.495981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003cb0a-fd13-43ef-b648-3fbc94b6dd5e None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:58.496691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003cb0a-fd13-43ef-b648-3fbc94b6dd5e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:58.497069 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003cb0a-fd13-43ef-b648-3fbc94b6dd5e None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:58.499702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 429/870] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:05:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:05:58.505649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa6bf-5f8a-424d-a985-1f8be485936e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:58.505924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa6bf-5f8a-424d-a985-1f8be485936e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:58.506258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caa6bf-5f8a-424d-a985-1f8be485936e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:58.537165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-99caa6bf-5f8a-424d-a985-1f8be485936e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:05:58.538641 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-99caa6bf-5f8a-424d-a985-1f8be485936e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:05:58.560592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83958efc-0e5a-4dfc-a9d5-1d048544a308 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:58.626897 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd327df-65d8-41cd-b0d0-92af83396f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:58.628040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd327df-65d8-41cd-b0d0-92af83396f1e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:58.629444 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd327df-65d8-41cd-b0d0-92af83396f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:58.636406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 430/871] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:05:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:05:58.637271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd327df-65d8-41cd-b0d0-92af83396f1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:58.637271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd327df-65d8-41cd-b0d0-92af83396f1e None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=4dbc2609b13f45dc883ae18d3d056e76) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:05:58.637271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd327df-65d8-41cd-b0d0-92af83396f1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:58.637271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd327df-65d8-41cd-b0d0-92af83396f1e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:58.650327 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 442/872] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:05:58 2022] GET /identity/v3/role_assignments?user.id=4dbc2609b13f45dc883ae18d3d056e76&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:05:58.666309 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caa6bf-5f8a-424d-a985-1f8be485936e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:05:58.723844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:05:58.811538 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caa6bf-5f8a-424d-a985-1f8be485936e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:05:58.855274 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce82bf9-79fe-481e-9dff-62c2f3de4ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:05:58.856795 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82bf9-79fe-481e-9dff-62c2f3de4ba5 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:05:58.857301 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82bf9-79fe-481e-9dff-62c2f3de4ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:05:58.857779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce82bf9-79fe-481e-9dff-62c2f3de4ba5 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:05:58.858812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce82bf9-79fe-481e-9dff-62c2f3de4ba5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:05:58.860716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce82bf9-79fe-481e-9dff-62c2f3de4ba5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:05:58.888477 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 431/873] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 25 16:05:58 2022] POST /identity/v3/services => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:06:00.399256 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dac19-0970-40b8-bac2-7a9e42d31cbe None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:00.399806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dac19-0970-40b8-bac2-7a9e42d31cbe None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:00.399806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dac19-0970-40b8-bac2-7a9e42d31cbe None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:00.401524 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 443/874] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:00.408177 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df5a03-5b21-4be7-87cf-d6748bef74cd None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:00.409186 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df5a03-5b21-4be7-87cf-d6748bef74cd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:00.409682 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df5a03-5b21-4be7-87cf-d6748bef74cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:00.429921 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-87df5a03-5b21-4be7-87cf-d6748bef74cd None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:00.431523 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-87df5a03-5b21-4be7-87cf-d6748bef74cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:00.518911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 432/875] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:00 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:00.541890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dac19-0970-40b8-bac2-7a9e42d31cbe None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:00.697816 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9dac19-0970-40b8-bac2-7a9e42d31cbe None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:00.700028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:00.764872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265aeea-eb4f-4690-8ec7-0e8ba883d00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:00.767098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265aeea-eb4f-4690-8ec7-0e8ba883d00c None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:00.767925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265aeea-eb4f-4690-8ec7-0e8ba883d00c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:00.768860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265aeea-eb4f-4690-8ec7-0e8ba883d00c None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:00.770677 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265aeea-eb4f-4690-8ec7-0e8ba883d00c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:00.773778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265aeea-eb4f-4690-8ec7-0e8ba883d00c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:00.802122 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 444/876] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 25 16:06:00 2022] POST /identity/v3/services => generated 269 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:06:00.942020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d8099-6cfe-4b13-9c38-a1ed7735ecac None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:00.942527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d8099-6cfe-4b13-9c38-a1ed7735ecac None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:00.942708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d8099-6cfe-4b13-9c38-a1ed7735ecac None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:00.944451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 433/877] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:00.950374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bafd1-b91e-4ef0-952b-35e73ab54a06 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:00.950714 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bafd1-b91e-4ef0-952b-35e73ab54a06 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:00.950932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bafd1-b91e-4ef0-952b-35e73ab54a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:00.972171 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9e7bafd1-b91e-4ef0-952b-35e73ab54a06 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:00.973434 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9e7bafd1-b91e-4ef0-952b-35e73ab54a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:01.101838 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 445/878] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:01.113382 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fa2a9-e547-40d5-8bab-e7e2949975d6 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:01.113662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fa2a9-e547-40d5-8bab-e7e2949975d6 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:01.113988 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fa2a9-e547-40d5-8bab-e7e2949975d6 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:01.115710 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 434/879] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:06:01.122589 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77d6c8-cd5e-4bbf-a80e-600d3cd69a71 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:01.123095 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77d6c8-cd5e-4bbf-a80e-600d3cd69a71 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:01.123602 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77d6c8-cd5e-4bbf-a80e-600d3cd69a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:01.134876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fa2a9-e547-40d5-8bab-e7e2949975d6 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:01.148384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2e77d6c8-cd5e-4bbf-a80e-600d3cd69a71 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:01.149636 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2e77d6c8-cd5e-4bbf-a80e-600d3cd69a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:01.167559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:01.266564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 446/880] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:01.269042 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edec33-70e2-4a3a-bed9-352844b81f8b None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:01.269518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edec33-70e2-4a3a-bed9-352844b81f8b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:01.270106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edec33-70e2-4a3a-bed9-352844b81f8b None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:01.272726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 447/881] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:01.279294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f26ac0-7605-4b5e-9cdb-9c64ba3c4e61 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:01.279889 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f26ac0-7605-4b5e-9cdb-9c64ba3c4e61 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:01.280379 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f26ac0-7605-4b5e-9cdb-9c64ba3c4e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:01.301867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fa2a9-e547-40d5-8bab-e7e2949975d6 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:01.305030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d9f26ac0-7605-4b5e-9cdb-9c64ba3c4e61 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:01.306702 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d9f26ac0-7605-4b5e-9cdb-9c64ba3c4e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:01.323082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:01.345553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604a0fa-ecb6-4bc1-b94c-e5dbffbc5fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:01.346720 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604a0fa-ecb6-4bc1-b94c-e5dbffbc5fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:01.347149 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604a0fa-ecb6-4bc1-b94c-e5dbffbc5fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:01.347425 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604a0fa-ecb6-4bc1-b94c-e5dbffbc5fd1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:01.361077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604a0fa-ecb6-4bc1-b94c-e5dbffbc5fd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:06:01.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-1604a0fa-ecb6-4bc1-b94c-e5dbffbc5fd1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 16:06:01.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:01.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:01.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:01.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:01.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:01.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:01.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:01.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:01.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:01.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:01.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:01.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:06:01.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:06:01.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:06:01.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:06:01.371716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:06:01.371716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:06:01.371716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:06:01.371716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:06:01.371716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:01.371716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:01.371716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:01.371716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:01.371716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:01.371716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:01.371716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:01.371716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:01.371716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:01.371716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:01.371716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:01.371716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:01.372911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:01.372911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:01.372911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:01.372911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:01.372911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:06:01.372911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:06:01.372911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:06:01.372911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:06:01.372911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:06:01.372911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:06:01.372911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 16:06:01.372911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:01.372911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 435/882] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jul 25 16:06:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:01.372911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604a0fa-ecb6-4bc1-b94c-e5dbffbc5fd1 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:01.398626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 448/883] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:06:01.399597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f26ac0-7605-4b5e-9cdb-9c64ba3c4e61 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:01.496567 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:01.526045 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f26ac0-7605-4b5e-9cdb-9c64ba3c4e61 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:01.533351 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604a0fa-ecb6-4bc1-b94c-e5dbffbc5fd1 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:01.568151 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a948fa-9ebb-4ed4-88c2-f887d46a22fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:01.568864 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a948fa-9ebb-4ed4-88c2-f887d46a22fd None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:01.569152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a948fa-9ebb-4ed4-88c2-f887d46a22fd None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:01.569462 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a948fa-9ebb-4ed4-88c2-f887d46a22fd None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:01.570212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a948fa-9ebb-4ed4-88c2-f887d46a22fd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:01.570523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a948fa-9ebb-4ed4-88c2-f887d46a22fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:01.571936 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a948fa-9ebb-4ed4-88c2-f887d46a22fd None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:01.575150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d0d81-7cc1-4ebf-863c-891838783a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:01.575968 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d0d81-7cc1-4ebf-863c-891838783a70 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:01.576374 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d0d81-7cc1-4ebf-863c-891838783a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:01.576548 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d0d81-7cc1-4ebf-863c-891838783a70 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:01.577297 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d0d81-7cc1-4ebf-863c-891838783a70 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:01.579204 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d0d81-7cc1-4ebf-863c-891838783a70 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:01.583306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 449/884] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jul 25 16:06:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:01.584534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a948fa-9ebb-4ed4-88c2-f887d46a22fd None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-e24d0d81-7cc1-4ebf-863c-891838783a70 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:01.597336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:01.598446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:01.598446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:01.598446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:01.598446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:01.598446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:01.598446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:01.598446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:06:01.598446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:06:01.598446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:06:01.598446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:06:01.598446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:01.598446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:01.598446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:01.598446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:01.598446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:01.598446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:01.599293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:01.599293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:01.599293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:01.599293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:01.599293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:01.599293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:01.599293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:01.599293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:01.599293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:01.599293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:01.599293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:06:01.599293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:01.599293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 16:06:01.599293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:01.602569 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:01.603825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 436/885] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:06:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:01.604707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d0d81-7cc1-4ebf-863c-891838783a70 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:01.728575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a948fa-9ebb-4ed4-88c2-f887d46a22fd None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:01.741845 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d0d81-7cc1-4ebf-863c-891838783a70 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:01.774721 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736c8ba-3b4f-43c3-8d4e-3827bf426224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:01.775557 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736c8ba-3b4f-43c3-8d4e-3827bf426224 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:01.775849 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736c8ba-3b4f-43c3-8d4e-3827bf426224 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:01.776135 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736c8ba-3b4f-43c3-8d4e-3827bf426224 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:01.777092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736c8ba-3b4f-43c3-8d4e-3827bf426224 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:01.778484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736c8ba-3b4f-43c3-8d4e-3827bf426224 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:01.778778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75db8f6-b841-47c1-99a5-3edbb69f4ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:01.779679 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75db8f6-b841-47c1-99a5-3edbb69f4ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:01.779970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75db8f6-b841-47c1-99a5-3edbb69f4ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:01.780242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75db8f6-b841-47c1-99a5-3edbb69f4ed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:01.792623 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:01.795190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75db8f6-b841-47c1-99a5-3edbb69f4ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:01.797046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75db8f6-b841-47c1-99a5-3edbb69f4ed2 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-2736c8ba-3b4f-43c3-8d4e-3827bf426224 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:01.806940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:01.808008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:01.808008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:01.808008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:01.808008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:01.808008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:01.808008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:01.808008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:06:01.808008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:06:01.808008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:06:01.808008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:06:01.808008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:01.808008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:01.808008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:01.808008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:01.808008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:01.808008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:01.809062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:01.809062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:01.809062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:01.809062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:01.809062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:01.809062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:01.809062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:01.809062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:01.809062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:01.809062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:01.809062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:06:01.809062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:01.809062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 16:06:01.809062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:01.812427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 450/886] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 25 16:06:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:01.813605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736c8ba-3b4f-43c3-8d4e-3827bf426224 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:01.818851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-f75db8f6-b841-47c1-99a5-3edbb69f4ed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:01.818851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:01.818851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:01.818851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:01.818851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:01.818851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:01.818851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:01.818851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:01.818851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:01.818851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:01.818851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:01.818851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:01.818851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:06:01.818851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:06:01.818851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:01.819788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:01.820755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:06:01.820755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:06:01.820755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:01.820755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:01.820755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 437/887] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:01.821283 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75db8f6-b841-47c1-99a5-3edbb69f4ed2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:01.911431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:01.947524 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736c8ba-3b4f-43c3-8d4e-3827bf426224 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:01.956770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75db8f6-b841-47c1-99a5-3edbb69f4ed2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:01.995657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17acb08-3fa3-4818-8bc2-55684748db97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:01.996386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17acb08-3fa3-4818-8bc2-55684748db97 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:01.996701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17acb08-3fa3-4818-8bc2-55684748db97 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:01.996966 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17acb08-3fa3-4818-8bc2-55684748db97 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:01.997688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17acb08-3fa3-4818-8bc2-55684748db97 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:01.997995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17acb08-3fa3-4818-8bc2-55684748db97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:01.999389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17acb08-3fa3-4818-8bc2-55684748db97 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:02.005111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 438/888] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 25 16:06:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:02.005949 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17acb08-3fa3-4818-8bc2-55684748db97 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:02.006079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f042407-0a60-4840-a2d0-09f6280736b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:02.006729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f042407-0a60-4840-a2d0-09f6280736b1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:02.007084 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f042407-0a60-4840-a2d0-09f6280736b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:02.007424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f042407-0a60-4840-a2d0-09f6280736b1 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:02.008210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f042407-0a60-4840-a2d0-09f6280736b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:02.008632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f042407-0a60-4840-a2d0-09f6280736b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:02.010191 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f042407-0a60-4840-a2d0-09f6280736b1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:02.016689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 451/889] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:06:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:02.017635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f042407-0a60-4840-a2d0-09f6280736b1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:02.092665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:02.165213 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f042407-0a60-4840-a2d0-09f6280736b1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:02.175806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17acb08-3fa3-4818-8bc2-55684748db97 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:02.202533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8899c-b4df-47f7-80b6-aca7a9277e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:02.203206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8899c-b4df-47f7-80b6-aca7a9277e34 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:02.203504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8899c-b4df-47f7-80b6-aca7a9277e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:02.203900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8899c-b4df-47f7-80b6-aca7a9277e34 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:02.204646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8899c-b4df-47f7-80b6-aca7a9277e34 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:02.204958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8899c-b4df-47f7-80b6-aca7a9277e34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:02.206340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8899c-b4df-47f7-80b6-aca7a9277e34 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:02.211428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 452/890] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 25 16:06:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:02.212294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8899c-b4df-47f7-80b6-aca7a9277e34 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:02.219371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:02.252342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d9a3e-58ca-4757-a62b-36d7532b13e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:02.253509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9a3e-58ca-4757-a62b-36d7532b13e6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:02.254022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9a3e-58ca-4757-a62b-36d7532b13e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:02.254610 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9a3e-58ca-4757-a62b-36d7532b13e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:02.255544 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d9a3e-58ca-4757-a62b-36d7532b13e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:02.256050 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d9a3e-58ca-4757-a62b-36d7532b13e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:02.257692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d9a3e-58ca-4757-a62b-36d7532b13e6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:02.280342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 439/891] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:02.286339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d9a3e-58ca-4757-a62b-36d7532b13e6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:02.408997 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8899c-b4df-47f7-80b6-aca7a9277e34 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:02.459803 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e2017-f7cc-4c02-9878-a673932bbe08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:02.461102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e2017-f7cc-4c02-9878-a673932bbe08 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:02.461573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e2017-f7cc-4c02-9878-a673932bbe08 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:02.462020 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e2017-f7cc-4c02-9878-a673932bbe08 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:02.463110 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e2017-f7cc-4c02-9878-a673932bbe08 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:02.463592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e2017-f7cc-4c02-9878-a673932bbe08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:02.465597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e2017-f7cc-4c02-9878-a673932bbe08 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:02.473720 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 453/892] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:06:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:02.480574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d9a3e-58ca-4757-a62b-36d7532b13e6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:02.480839 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e2017-f7cc-4c02-9878-a673932bbe08 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:02.500841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:02.524521 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebe24e-fbce-40ac-b7b3-a93e42b9ed38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:02.526431 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebe24e-fbce-40ac-b7b3-a93e42b9ed38 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:02.527254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebe24e-fbce-40ac-b7b3-a93e42b9ed38 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:02.527933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebe24e-fbce-40ac-b7b3-a93e42b9ed38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:02.543621 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebe24e-fbce-40ac-b7b3-a93e42b9ed38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:02.547518 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebe24e-fbce-40ac-b7b3-a93e42b9ed38 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:02.578041 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:02.580767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-cdebe24e-fbce-40ac-b7b3-a93e42b9ed38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 16:06:02.580767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:02.580767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:02.580767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:02.580767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:02.580767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:02.580767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:02.580767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:02.580767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:02.580767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:02.580767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:02.580767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:02.580767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:06:02.580767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:06:02.580767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:06:02.580767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:02.581810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:02.582837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:02.582837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:02.582837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:06:02.582837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:06:02.582837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:06:02.582837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:06:02.582837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:06:02.582837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:06:02.582837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 16:06:02.582837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:02.586336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 440/893] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 25 16:06:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:02.594886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebe24e-fbce-40ac-b7b3-a93e42b9ed38 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:02.662731 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e2017-f7cc-4c02-9878-a673932bbe08 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:02.724117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebe24e-fbce-40ac-b7b3-a93e42b9ed38 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:02.741305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8308b9-4e07-4ea8-9a5b-8bf5b9697e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:02.742008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8308b9-4e07-4ea8-9a5b-8bf5b9697e07 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:02.742300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8308b9-4e07-4ea8-9a5b-8bf5b9697e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:02.742587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8308b9-4e07-4ea8-9a5b-8bf5b9697e07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:02.743406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8308b9-4e07-4ea8-9a5b-8bf5b9697e07 None admin] RBAC: Adding query filter params (interface=public, service_id=bc113b9c40b44cc0bf759ae8c03a195d, region_id=RegionOne) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:02.743730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8308b9-4e07-4ea8-9a5b-8bf5b9697e07 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:02.745267 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8308b9-4e07-4ea8-9a5b-8bf5b9697e07 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:02.752227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 454/894] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jul 25 16:06:02 2022] GET /identity/v3/endpoints?service_id=bc113b9c40b44cc0bf759ae8c03a195d&interface=public®ion_id=RegionOne => generated 194 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:02.765644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8308b9-4e07-4ea8-9a5b-8bf5b9697e07 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:02.772294 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679326dd-d918-49b8-ace0-c6bcfdbda367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:02.773054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679326dd-d918-49b8-ace0-c6bcfdbda367 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:02.773365 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679326dd-d918-49b8-ace0-c6bcfdbda367 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:02.773666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679326dd-d918-49b8-ace0-c6bcfdbda367 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:02.774619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679326dd-d918-49b8-ace0-c6bcfdbda367 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:02.774877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679326dd-d918-49b8-ace0-c6bcfdbda367 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:02.777323 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679326dd-d918-49b8-ace0-c6bcfdbda367 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:02.804217 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 441/895] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jul 25 16:06:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:02.814065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679326dd-d918-49b8-ace0-c6bcfdbda367 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:02.875708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:02.952897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679326dd-d918-49b8-ace0-c6bcfdbda367 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:02.958258 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8308b9-4e07-4ea8-9a5b-8bf5b9697e07 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:02.993201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0af8a9-a31d-4160-90c8-43621e3d16e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:02.993875 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0af8a9-a31d-4160-90c8-43621e3d16e9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:02.994167 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0af8a9-a31d-4160-90c8-43621e3d16e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:02.994443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0af8a9-a31d-4160-90c8-43621e3d16e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:03.026997 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:03.038620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1015f-4983-493d-b714-24a2ab3d8b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:03.039763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1015f-4983-493d-b714-24a2ab3d8b00 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:03.040218 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1015f-4983-493d-b714-24a2ab3d8b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:03.040704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1015f-4983-493d-b714-24a2ab3d8b00 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:03.042032 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1015f-4983-493d-b714-24a2ab3d8b00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:03.044687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1015f-4983-493d-b714-24a2ab3d8b00 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:03.057014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 455/896] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 25 16:06:02 2022] GET /identity/v3/services => generated 1268 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:06:03.101583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0af8a9-a31d-4160-90c8-43621e3d16e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:03.103247 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0af8a9-a31d-4160-90c8-43621e3d16e9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:03.149644 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:03.203224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95273a16-ad35-4818-af3c-58ff716cb766 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:03.203824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95273a16-ad35-4818-af3c-58ff716cb766 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:03.204589 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95273a16-ad35-4818-af3c-58ff716cb766 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:03.213023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 456/897] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:03 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:06:03.216713 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dec69f-60f7-403b-80eb-36b0898b20cd None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:03.217129 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dec69f-60f7-403b-80eb-36b0898b20cd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:03.217564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dec69f-60f7-403b-80eb-36b0898b20cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:03.267071 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 442/898] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:06:02 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 16:06:03.268559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0af8a9-a31d-4160-90c8-43621e3d16e9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:03.274227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-93dec69f-60f7-403b-80eb-36b0898b20cd None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:03.275550 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-93dec69f-60f7-403b-80eb-36b0898b20cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:03.402361 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0af8a9-a31d-4160-90c8-43621e3d16e9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:03.404683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 457/899] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:06:03.428959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dec69f-60f7-403b-80eb-36b0898b20cd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:03.484067 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12863b4d-dd12-494f-9756-d04c5bb54ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:03.485324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12863b4d-dd12-494f-9756-d04c5bb54ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:03.485781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12863b4d-dd12-494f-9756-d04c5bb54ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:03.486211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12863b4d-dd12-494f-9756-d04c5bb54ad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:03.489076 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:03.499387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12863b4d-dd12-494f-9756-d04c5bb54ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:03.501895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12863b4d-dd12-494f-9756-d04c5bb54ad8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:03.523509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-12863b4d-dd12-494f-9756-d04c5bb54ad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:03.523509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:03.523509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:03.523509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:03.523509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:03.523509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:03.523509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:03.523509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:03.523509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:03.523509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:03.523509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:03.523509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:03.523509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:06:03.523509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:06:03.523509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:03.524722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:03.525822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:06:03.525822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:06:03.525822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:03.525822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:03.528079 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 443/900] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:03.538267 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12863b4d-dd12-494f-9756-d04c5bb54ad8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:03.635514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dec69f-60f7-403b-80eb-36b0898b20cd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:03.660749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12863b4d-dd12-494f-9756-d04c5bb54ad8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:03.686569 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:03.707380 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f1abd-3b75-490f-817b-88920cc7444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:03.708413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f1abd-3b75-490f-817b-88920cc7444f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:03.708852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f1abd-3b75-490f-817b-88920cc7444f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:03.709192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966575a-2116-4136-96d1-10d2e9cdaadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:03.709456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f1abd-3b75-490f-817b-88920cc7444f None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:03.710374 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f1abd-3b75-490f-817b-88920cc7444f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:03.710606 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966575a-2116-4136-96d1-10d2e9cdaadb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:03.711008 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f1abd-3b75-490f-817b-88920cc7444f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:03.711123 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966575a-2116-4136-96d1-10d2e9cdaadb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:03.711602 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966575a-2116-4136-96d1-10d2e9cdaadb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:03.712890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f1abd-3b75-490f-817b-88920cc7444f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:03.713033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966575a-2116-4136-96d1-10d2e9cdaadb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:03.715785 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966575a-2116-4136-96d1-10d2e9cdaadb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:03.727861 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 444/901] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:03.737882 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f1abd-3b75-490f-817b-88920cc7444f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:03.750937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c966575a-2116-4136-96d1-10d2e9cdaadb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 16:06:03.750937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:03.750937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:06:03.750937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:06:03.750937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:06:03.750937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:06:03.750937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:06:03.750937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:03.750937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 16:06:03.750937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:03.750937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:03.750937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:03.750937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:03.750937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:03.750937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:03.750937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:03.752164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:03.752164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:03.752164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:03.752164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:03.752164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:03.752164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:03.752164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:03.752164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:06:03.752164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:06:03.752164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:06:03.752164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:06:03.752164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:03.752164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:03.752164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:03.752164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:03.752164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:03.758236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:03.758236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:03.758236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:03.758236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:03.758236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:03.758236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:03.758236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:03.758236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:03.758236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:03.758236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:03.758236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:03.758236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:06:03.758236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:03.758236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 16:06:03.758236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:03.758236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 458/902] 10.222.0.70 () {56 vars in 1132 bytes} [Mon Jul 25 16:06:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:03.759628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966575a-2116-4136-96d1-10d2e9cdaadb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:03.803920 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:03.873103 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f1abd-3b75-490f-817b-88920cc7444f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:03.946007 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966575a-2116-4136-96d1-10d2e9cdaadb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:03.956697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70111a5d-bc95-40c4-809d-855f644a0fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:03.959188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70111a5d-bc95-40c4-809d-855f644a0fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:03.959987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70111a5d-bc95-40c4-809d-855f644a0fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:03.961235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70111a5d-bc95-40c4-809d-855f644a0fc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:03.980481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70111a5d-bc95-40c4-809d-855f644a0fc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:03.985704 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70111a5d-bc95-40c4-809d-855f644a0fc9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:03.992390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a2eaa-7990-46a0-aefc-eb8884a2fa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:03.993690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a2eaa-7990-46a0-aefc-eb8884a2fa4c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:03.994085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a2eaa-7990-46a0-aefc-eb8884a2fa4c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:03.994543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a2eaa-7990-46a0-aefc-eb8884a2fa4c None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:03.995399 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a2eaa-7990-46a0-aefc-eb8884a2fa4c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:03.995854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a2eaa-7990-46a0-aefc-eb8884a2fa4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:03.997429 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a2eaa-7990-46a0-aefc-eb8884a2fa4c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:04.008777 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 459/903] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 25 16:06:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:04.010675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a2eaa-7990-46a0-aefc-eb8884a2fa4c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:04.023072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-70111a5d-bc95-40c4-809d-855f644a0fc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:06:04.023072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:04.023072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:04.023072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:04.023072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:04.023072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:04.023072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:04.023072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:04.023072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:04.023072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:04.023072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:04.023072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:04.023072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:06:04.023072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:06:04.023072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:04.025027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:04.027192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:06:04.027192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:06:04.027192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:06:04.027192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:06:04.027192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:06:04.027192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:06:04.027192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:06:04.027192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:04.033448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 445/904] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:06:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:04.040568 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70111a5d-bc95-40c4-809d-855f644a0fc9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:04.093269 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:04.163234 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a2eaa-7990-46a0-aefc-eb8884a2fa4c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:04.219656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fff699-f95f-4e22-8ef7-f01c32d4ac56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:04.222068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fff699-f95f-4e22-8ef7-f01c32d4ac56 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:04.222778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fff699-f95f-4e22-8ef7-f01c32d4ac56 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:04.224013 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fff699-f95f-4e22-8ef7-f01c32d4ac56 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:04.225573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fff699-f95f-4e22-8ef7-f01c32d4ac56 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:04.226298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fff699-f95f-4e22-8ef7-f01c32d4ac56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:04.229011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fff699-f95f-4e22-8ef7-f01c32d4ac56 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:04.247010 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 460/905] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 25 16:06:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:04.253839 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fff699-f95f-4e22-8ef7-f01c32d4ac56 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:04.282169 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70111a5d-bc95-40c4-809d-855f644a0fc9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:04.295255 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:04.339898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8d04d-8528-4272-8428-184d349c0345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:04.340220 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8d04d-8528-4272-8428-184d349c0345 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:04.340635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8d04d-8528-4272-8428-184d349c0345 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:04.341012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8d04d-8528-4272-8428-184d349c0345 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:04.341949 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8d04d-8528-4272-8428-184d349c0345 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:04.342373 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8d04d-8528-4272-8428-184d349c0345 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:04.344241 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8d04d-8528-4272-8428-184d349c0345 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:04.373922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 446/906] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:06:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:04.375260 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8d04d-8528-4272-8428-184d349c0345 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:04.486255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fff699-f95f-4e22-8ef7-f01c32d4ac56 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:04.520802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8d04d-8528-4272-8428-184d349c0345 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:04.527608 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:04.565645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afce10b-d4cc-443d-9f69-a420d38f89b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:04.566326 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afce10b-d4cc-443d-9f69-a420d38f89b7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:04.566724 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afce10b-d4cc-443d-9f69-a420d38f89b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:04.567016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afce10b-d4cc-443d-9f69-a420d38f89b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:04.567862 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afce10b-d4cc-443d-9f69-a420d38f89b7 None admin] RBAC: Adding query filter params (interface=public, service_id=79230b05789f4489b1e4529935a5b150, region_id=RegionOne) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:04.568190 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afce10b-d4cc-443d-9f69-a420d38f89b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:04.569657 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afce10b-d4cc-443d-9f69-a420d38f89b7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:04.573960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054ce22-233e-4547-b255-2f9cd14a2666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:04.575258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054ce22-233e-4547-b255-2f9cd14a2666 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:04.577287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054ce22-233e-4547-b255-2f9cd14a2666 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:04.577287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054ce22-233e-4547-b255-2f9cd14a2666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:04.577674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054ce22-233e-4547-b255-2f9cd14a2666 None admin] RBAC: Adding query filter params (role.id=a040806445b64d57b153293502c52634, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=ea56b6a25f8e46949e6deb8443b20673) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:04.582990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054ce22-233e-4547-b255-2f9cd14a2666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:04.583158 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 461/907] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jul 25 16:06:04 2022] GET /identity/v3/endpoints?service_id=79230b05789f4489b1e4529935a5b150&interface=public®ion_id=RegionOne => generated 194 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:04.583260 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054ce22-233e-4547-b255-2f9cd14a2666 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:04.583342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63421905-9f90-47cb-89ea-68c19e0fc9e9 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:04.583342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63421905-9f90-47cb-89ea-68c19e0fc9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:04.583342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63421905-9f90-47cb-89ea-68c19e0fc9e9 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:04.587534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 462/908] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:04.589069 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63421905-9f90-47cb-89ea-68c19e0fc9e9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:04.594578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 447/909] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:06:04 2022] GET /identity/v3/role_assignments?user.id=ea56b6a25f8e46949e6deb8443b20673&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=a040806445b64d57b153293502c52634 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:04.598242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bec124-5b6b-4b1c-8730-133220e7ce64 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:04.598928 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bec124-5b6b-4b1c-8730-133220e7ce64 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:04.599386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bec124-5b6b-4b1c-8730-133220e7ce64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:04.627598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-05bec124-5b6b-4b1c-8730-133220e7ce64 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:04.629923 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-05bec124-5b6b-4b1c-8730-133220e7ce64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:04.671951 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:04.796118 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 448/910] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:04.835543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63421905-9f90-47cb-89ea-68c19e0fc9e9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:04.837730 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bec124-5b6b-4b1c-8730-133220e7ce64 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:04.883440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030745c7-797f-4212-8f1a-b64cb8e81420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:04.884706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030745c7-797f-4212-8f1a-b64cb8e81420 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:04.885232 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030745c7-797f-4212-8f1a-b64cb8e81420 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:04.885727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030745c7-797f-4212-8f1a-b64cb8e81420 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:04.886890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030745c7-797f-4212-8f1a-b64cb8e81420 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:04.889049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030745c7-797f-4212-8f1a-b64cb8e81420 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:04.897462 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 463/911] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 25 16:06:04 2022] GET /identity/v3/services => generated 1268 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:06:05.018570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bec124-5b6b-4b1c-8730-133220e7ce64 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:05.059999 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a12906-ff72-4933-9bfa-b61efabca479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:05.061116 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a12906-ff72-4933-9bfa-b61efabca479 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:05.061643 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a12906-ff72-4933-9bfa-b61efabca479 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:05.062142 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a12906-ff72-4933-9bfa-b61efabca479 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:05.063644 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a12906-ff72-4933-9bfa-b61efabca479 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:05.065393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a12906-ff72-4933-9bfa-b61efabca479 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:05.084192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 449/912] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 25 16:06:04 2022] POST /identity/v3/services => generated 241 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:06:05.318008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684a4f6-f6cd-4aca-95cc-2daa107e7a9c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:05.318214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684a4f6-f6cd-4aca-95cc-2daa107e7a9c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:05.318484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684a4f6-f6cd-4aca-95cc-2daa107e7a9c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:05.320371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 464/913] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:05.326270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ec1c1-5827-4177-8739-25383a0cb7a1 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:05.326615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ec1c1-5827-4177-8739-25383a0cb7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:05.326838 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ec1c1-5827-4177-8739-25383a0cb7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:05.346878 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c42ec1c1-5827-4177-8739-25383a0cb7a1 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:05.348108 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c42ec1c1-5827-4177-8739-25383a0cb7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:05.365164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:05.434169 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 450/914] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:05.456967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684a4f6-f6cd-4aca-95cc-2daa107e7a9c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:05.511600 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:05.619892 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684a4f6-f6cd-4aca-95cc-2daa107e7a9c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:05.694334 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d008c2c-8677-478f-95f8-0409dcb78d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:05.695833 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d008c2c-8677-478f-95f8-0409dcb78d51 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:05.696371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d008c2c-8677-478f-95f8-0409dcb78d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:05.696871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d008c2c-8677-478f-95f8-0409dcb78d51 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:05.698100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d008c2c-8677-478f-95f8-0409dcb78d51 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:05.700756 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d008c2c-8677-478f-95f8-0409dcb78d51 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6d008c2c-8677-478f-95f8-0409dcb78d51 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:05.725060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:05.727024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:05.727024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:05.727024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:05.727024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:05.727024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:05.727024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:05.727024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:06:05.727024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:06:05.727024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:06:05.727024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:06:05.727024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:05.727024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:05.727024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:05.727024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:05.727024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:05.727024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:05.729425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:05.729425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:05.729425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:05.729425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:05.729425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:05.729425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:05.729425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:05.729425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:05.729425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:05.729425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:05.729425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:06:05.729425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:05.729425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 16:06:05.729425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:05.729425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 465/915] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:06:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:05.736793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ec1c1-5827-4177-8739-25383a0cb7a1 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:05.888344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ec1c1-5827-4177-8739-25383a0cb7a1 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:05.928890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e52bf4-a084-48fe-9fa2-24b9453c3524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:05.929570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e52bf4-a084-48fe-9fa2-24b9453c3524 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:05.929850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e52bf4-a084-48fe-9fa2-24b9453c3524 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:05.930122 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e52bf4-a084-48fe-9fa2-24b9453c3524 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:05.930837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e52bf4-a084-48fe-9fa2-24b9453c3524 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:05.931189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e52bf4-a084-48fe-9fa2-24b9453c3524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:05.932612 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e52bf4-a084-48fe-9fa2-24b9453c3524 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:05.938464 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 451/916] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:06:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:05.945906 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d008c2c-8677-478f-95f8-0409dcb78d51 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:06.077699 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d008c2c-8677-478f-95f8-0409dcb78d51 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:06.089870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:06.116694 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493e0ba-63cf-4a3b-aa03-1c37158188c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:06.117369 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493e0ba-63cf-4a3b-aa03-1c37158188c0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:06.117650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493e0ba-63cf-4a3b-aa03-1c37158188c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:06.117921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493e0ba-63cf-4a3b-aa03-1c37158188c0 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:06.118626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493e0ba-63cf-4a3b-aa03-1c37158188c0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:06.118927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493e0ba-63cf-4a3b-aa03-1c37158188c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:06.120314 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493e0ba-63cf-4a3b-aa03-1c37158188c0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:06.126180 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 466/917] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Jul 25 16:06:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:06.133836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e52bf4-a084-48fe-9fa2-24b9453c3524 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:06.152328 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:06.249561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e52bf4-a084-48fe-9fa2-24b9453c3524 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:06.286927 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b73474-8262-4479-8b03-e4a6bb1351fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:06.287593 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b73474-8262-4479-8b03-e4a6bb1351fb None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:06.287871 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b73474-8262-4479-8b03-e4a6bb1351fb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:06.288226 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b73474-8262-4479-8b03-e4a6bb1351fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:06.288982 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b73474-8262-4479-8b03-e4a6bb1351fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:06.290351 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b73474-8262-4479-8b03-e4a6bb1351fb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:06.312203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 452/918] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:06:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:06:07.067089 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc724b-9cdc-4e8b-bc02-93afc546a62f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:07.068148 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc724b-9cdc-4e8b-bc02-93afc546a62f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:07.068675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc724b-9cdc-4e8b-bc02-93afc546a62f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:07.070675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 467/919] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:07.076687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b382f1a-04fe-4208-a98a-ce75bde65899 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:07.077611 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b382f1a-04fe-4208-a98a-ce75bde65899 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:07.078129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b382f1a-04fe-4208-a98a-ce75bde65899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:07.100447 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8b382f1a-04fe-4208-a98a-ce75bde65899 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:07.101658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8b382f1a-04fe-4208-a98a-ce75bde65899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:07.167773 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:07.181999 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 453/920] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:07.190858 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaeb606-b59b-4fe5-a865-176621be657f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:07.191240 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaeb606-b59b-4fe5-a865-176621be657f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:07.191520 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaeb606-b59b-4fe5-a865-176621be657f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:07.193074 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 468/921] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:07.198616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee6204-e2e6-4599-b108-d232becf5afd None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:07.199024 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee6204-e2e6-4599-b108-d232becf5afd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:07.199306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee6204-e2e6-4599-b108-d232becf5afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:07.208401 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaeb606-b59b-4fe5-a865-176621be657f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:07.220714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-bbee6204-e2e6-4599-b108-d232becf5afd None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:07.222352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bbee6204-e2e6-4599-b108-d232becf5afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:07.319387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 454/922] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:07.323568 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be7c45-1aec-45cf-a726-512b4e479050 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:07.324204 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be7c45-1aec-45cf-a726-512b4e479050 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:07.324702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be7c45-1aec-45cf-a726-512b4e479050 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:07.326699 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 455/923] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:07.331735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6a77d-50b5-49fd-8fb7-10fd8f499dc1 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:07.332028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6a77d-50b5-49fd-8fb7-10fd8f499dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:07.332340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6a77d-50b5-49fd-8fb7-10fd8f499dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:07.350920 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7ad6a77d-50b5-49fd-8fb7-10fd8f499dc1 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:07.352753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7ad6a77d-50b5-49fd-8fb7-10fd8f499dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:07.356628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaeb606-b59b-4fe5-a865-176621be657f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:07.412994 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230b096-d299-4d91-b283-36a23389d639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:07.413822 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230b096-d299-4d91-b283-36a23389d639 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:07.414100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230b096-d299-4d91-b283-36a23389d639 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:07.414371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230b096-d299-4d91-b283-36a23389d639 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:07.429246 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 456/924] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:06:07.430728 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230b096-d299-4d91-b283-36a23389d639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:06:07.433295 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6a77d-50b5-49fd-8fb7-10fd8f499dc1 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:07.442706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-3230b096-d299-4d91-b283-36a23389d639 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 16:06:07.442706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:07.442706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:07.442706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:07.442706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:07.442706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:07.442706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:07.442706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:07.442706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:07.442706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:07.442706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:07.442706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:07.442706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:06:07.442706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:06:07.442706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:06:07.442706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:06:07.443813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:06:07.443813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:06:07.443813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:06:07.443813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:06:07.443813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:07.443813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:07.443813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:07.443813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:07.443813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:07.443813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:07.443813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:07.443813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:07.443813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:07.443813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:07.443813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:07.443813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:07.444654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:07.444654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:07.444654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:07.444654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:07.444654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:06:07.444654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:06:07.444654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:06:07.444654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:06:07.444654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:06:07.444654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:06:07.444654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 16:06:07.444654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:07.451008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 469/925] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jul 25 16:06:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:07.452488 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230b096-d299-4d91-b283-36a23389d639 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:07.489716 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:07.508549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:07.561721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6a77d-50b5-49fd-8fb7-10fd8f499dc1 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:07.571489 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230b096-d299-4d91-b283-36a23389d639 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:07.602658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08af4c-5919-40c3-b147-75942d2efa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:07.603533 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08af4c-5919-40c3-b147-75942d2efa08 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:07.603822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08af4c-5919-40c3-b147-75942d2efa08 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:07.604103 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08af4c-5919-40c3-b147-75942d2efa08 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:07.604804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08af4c-5919-40c3-b147-75942d2efa08 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:07.606207 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08af4c-5919-40c3-b147-75942d2efa08 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:07.612278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b47c13-a52f-406d-8ca5-507368beaf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:07.613311 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b47c13-a52f-406d-8ca5-507368beaf59 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:07.613738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b47c13-a52f-406d-8ca5-507368beaf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:07.614172 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b47c13-a52f-406d-8ca5-507368beaf59 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:07.614963 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b47c13-a52f-406d-8ca5-507368beaf59 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:07.616515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b47c13-a52f-406d-8ca5-507368beaf59 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:07.619499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-cd08af4c-5919-40c3-b147-75942d2efa08 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 16:06:07.619499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:07.619499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:06:07.619499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:06:07.619499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:06:07.619499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:06:07.619499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:06:07.619499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:07.619499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 16:06:07.619499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:07.619499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:07.619499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:07.619499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:07.619499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:07.619499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:07.619499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:07.620619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:07.620619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:07.620619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:07.620619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:07.620619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:07.620619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:07.620619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:07.620619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:06:07.620619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:06:07.620619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:06:07.620619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:06:07.620619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:07.620619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:07.620619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:07.620619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:07.620619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:07.621749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:07.621749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:07.621749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:07.621749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:07.621749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:07.621749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:07.621749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:07.621749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:07.621749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:07.621749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:07.621749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:07.621749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:06:07.621749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:07.621749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 16:06:07.621749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:07.621749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 457/926] 10.222.0.70 () {56 vars in 1132 bytes} [Mon Jul 25 16:06:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:07.622869 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08af4c-5919-40c3-b147-75942d2efa08 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c4b47c13-a52f-406d-8ca5-507368beaf59 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:07.638138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:07.639188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:07.639188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:07.639188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:07.639188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:07.639188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:07.639188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:07.639188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:06:07.639188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:06:07.639188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:06:07.639188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:06:07.639188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:07.639188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:07.639188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:07.639188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:07.639188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:07.639188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:07.640016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:07.640016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:07.640016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:07.640016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:07.640016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:07.640016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:07.640016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:07.640016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:07.640016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:07.640016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:07.640016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:06:07.640016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:07.640016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 16:06:07.640016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:07.640016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 470/927] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 25 16:06:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:07.640862 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b47c13-a52f-406d-8ca5-507368beaf59 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:07.736086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08af4c-5919-40c3-b147-75942d2efa08 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:07.751946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:07.753405 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:07.761463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b47c13-a52f-406d-8ca5-507368beaf59 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:07.773448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a77309-71c1-415f-a954-c18c8ec25126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:07.774126 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a77309-71c1-415f-a954-c18c8ec25126 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:07.774410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a77309-71c1-415f-a954-c18c8ec25126 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:07.774684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a77309-71c1-415f-a954-c18c8ec25126 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:07.775420 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a77309-71c1-415f-a954-c18c8ec25126 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:07.775748 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a77309-71c1-415f-a954-c18c8ec25126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:07.777410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a77309-71c1-415f-a954-c18c8ec25126 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:07.786188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 458/928] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jul 25 16:06:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:07.787001 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a77309-71c1-415f-a954-c18c8ec25126 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:07.803957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ad797-e085-4d32-a203-085e6ebf06be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:07.804660 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ad797-e085-4d32-a203-085e6ebf06be None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:07.804985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ad797-e085-4d32-a203-085e6ebf06be None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:07.805225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ad797-e085-4d32-a203-085e6ebf06be None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:07.805976 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ad797-e085-4d32-a203-085e6ebf06be None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:07.806289 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ad797-e085-4d32-a203-085e6ebf06be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:07.807651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ad797-e085-4d32-a203-085e6ebf06be None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:07.813848 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 471/929] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 25 16:06:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:07.814651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ad797-e085-4d32-a203-085e6ebf06be None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:07.902610 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a77309-71c1-415f-a954-c18c8ec25126 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:07.924563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ad797-e085-4d32-a203-085e6ebf06be None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:07.944065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97cbe1-e5c1-4835-b2cb-c6216f3e8057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:07.944856 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97cbe1-e5c1-4835-b2cb-c6216f3e8057 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:07.945061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97cbe1-e5c1-4835-b2cb-c6216f3e8057 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:07.945429 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97cbe1-e5c1-4835-b2cb-c6216f3e8057 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:07.946237 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97cbe1-e5c1-4835-b2cb-c6216f3e8057 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:07.946456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97cbe1-e5c1-4835-b2cb-c6216f3e8057 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:07.947860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97cbe1-e5c1-4835-b2cb-c6216f3e8057 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:07.958324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 459/930] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 25 16:06:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:07.958324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97cbe1-e5c1-4835-b2cb-c6216f3e8057 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:07.974161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e9706-819c-488f-87fe-a7bbe13c95b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:07.974968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e9706-819c-488f-87fe-a7bbe13c95b3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:07.975259 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e9706-819c-488f-87fe-a7bbe13c95b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:07.975538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e9706-819c-488f-87fe-a7bbe13c95b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:07.986591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e9706-819c-488f-87fe-a7bbe13c95b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:07.988186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e9706-819c-488f-87fe-a7bbe13c95b3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:08.005343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:08.008649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-1b2e9706-819c-488f-87fe-a7bbe13c95b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:08.008649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:08.008649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:08.008649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:08.008649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:08.008649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:08.008649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:08.008649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:08.008649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:08.008649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:08.008649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:08.008649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:08.008649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:06:08.008649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:06:08.008649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:08.009514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:08.010412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:06:08.010412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:06:08.010412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:08.010412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:08.010412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 472/931] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:08.011088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e9706-819c-488f-87fe-a7bbe13c95b3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:08.031276 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:08.095488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97cbe1-e5c1-4835-b2cb-c6216f3e8057 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:08.154629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8ebc8-e304-48bc-a1ba-bcc835c9ca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:08.155525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8ebc8-e304-48bc-a1ba-bcc835c9ca39 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:08.156004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8ebc8-e304-48bc-a1ba-bcc835c9ca39 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:08.156540 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8ebc8-e304-48bc-a1ba-bcc835c9ca39 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:08.158385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8ebc8-e304-48bc-a1ba-bcc835c9ca39 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:08.158901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8ebc8-e304-48bc-a1ba-bcc835c9ca39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:08.161303 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8ebc8-e304-48bc-a1ba-bcc835c9ca39 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:08.168614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e9706-819c-488f-87fe-a7bbe13c95b3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:08.177826 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 460/932] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 25 16:06:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:08.177826 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8ebc8-e304-48bc-a1ba-bcc835c9ca39 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:08.223278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35279474-9a63-455e-a669-2bc632553a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:08.223970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35279474-9a63-455e-a669-2bc632553a27 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:08.224284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35279474-9a63-455e-a669-2bc632553a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:08.224560 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35279474-9a63-455e-a669-2bc632553a27 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:08.225283 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35279474-9a63-455e-a669-2bc632553a27 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:08.225589 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35279474-9a63-455e-a669-2bc632553a27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:08.227005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35279474-9a63-455e-a669-2bc632553a27 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:08.241175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 473/933] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 25 16:06:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:08.241175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35279474-9a63-455e-a669-2bc632553a27 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:08.306111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8ebc8-e304-48bc-a1ba-bcc835c9ca39 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:08.314256 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:08.343579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:08.345283 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859d51c-7b44-4aa3-bb08-d8f3c046200d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:08.346571 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859d51c-7b44-4aa3-bb08-d8f3c046200d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:08.346858 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859d51c-7b44-4aa3-bb08-d8f3c046200d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:08.347142 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859d51c-7b44-4aa3-bb08-d8f3c046200d None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:08.347884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859d51c-7b44-4aa3-bb08-d8f3c046200d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:08.348195 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859d51c-7b44-4aa3-bb08-d8f3c046200d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:08.349778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859d51c-7b44-4aa3-bb08-d8f3c046200d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:08.363980 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 461/934] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:08.369140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859d51c-7b44-4aa3-bb08-d8f3c046200d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:08.370657 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35279474-9a63-455e-a669-2bc632553a27 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:08.408755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5ec77-03b1-4b3e-8975-3f7d78aec3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:08.409341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5ec77-03b1-4b3e-8975-3f7d78aec3c8 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:08.409630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5ec77-03b1-4b3e-8975-3f7d78aec3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:08.409908 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5ec77-03b1-4b3e-8975-3f7d78aec3c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:08.410648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5ec77-03b1-4b3e-8975-3f7d78aec3c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:08.412017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5ec77-03b1-4b3e-8975-3f7d78aec3c8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:08.448285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 474/935] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:06:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:06:08.448285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5ec77-03b1-4b3e-8975-3f7d78aec3c8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:08.481328 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859d51c-7b44-4aa3-bb08-d8f3c046200d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:08.528933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4de57-1304-44d1-a1a5-923a7023b87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:08.529700 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4de57-1304-44d1-a1a5-923a7023b87c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:08.529990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4de57-1304-44d1-a1a5-923a7023b87c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:08.530272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4de57-1304-44d1-a1a5-923a7023b87c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:08.531284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4de57-1304-44d1-a1a5-923a7023b87c None admin] RBAC: Adding query filter params (interface=public, service_id=eca2838a2f684eaebbfd3bc27837cbd1, region_id=RegionOne) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:08.532883 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4de57-1304-44d1-a1a5-923a7023b87c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:08.534345 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4de57-1304-44d1-a1a5-923a7023b87c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:08.543470 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 462/936] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jul 25 16:06:08 2022] GET /identity/v3/endpoints?service_id=eca2838a2f684eaebbfd3bc27837cbd1&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:08.545067 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17544455-884c-4375-88b1-8720a01d0702 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:08.545421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17544455-884c-4375-88b1-8720a01d0702 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:08.545702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17544455-884c-4375-88b1-8720a01d0702 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:08.547819 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 463/937] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:08.550226 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17544455-884c-4375-88b1-8720a01d0702 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:08.580271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5ec77-03b1-4b3e-8975-3f7d78aec3c8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:08.590481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:08.616618 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:08.623971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32848b-656e-494b-ab43-d0653252e59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:08.625478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32848b-656e-494b-ab43-d0653252e59c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:08.625945 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32848b-656e-494b-ab43-d0653252e59c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:08.626678 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32848b-656e-494b-ab43-d0653252e59c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:08.637375 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32848b-656e-494b-ab43-d0653252e59c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:08.640087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32848b-656e-494b-ab43-d0653252e59c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:08.657543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-ff32848b-656e-494b-ab43-d0653252e59c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 16:06:08.657543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:08.657543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:08.657543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:08.657543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:08.657543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:08.657543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:08.657543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:08.657543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:08.657543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:08.657543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:08.657543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:08.657543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:06:08.657543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:06:08.657543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:06:08.657543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:08.659348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:08.661675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:08.661675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:08.661675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:06:08.661675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:06:08.661675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:06:08.661675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:06:08.661675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:06:08.661675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:06:08.661675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 16:06:08.661675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:08.661675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 475/938] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 25 16:06:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:08.661675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0220b-ce00-4efb-9dc5-4412d679a398 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:08.661675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0220b-ce00-4efb-9dc5-4412d679a398 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:08.664164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0220b-ce00-4efb-9dc5-4412d679a398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:08.680156 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7bd0220b-ce00-4efb-9dc5-4412d679a398 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:08.681365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7bd0220b-ce00-4efb-9dc5-4412d679a398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:08.697952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17544455-884c-4375-88b1-8720a01d0702 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:08.734766 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca3f46-d9c4-40fd-b931-653f9757a7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:08.736050 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca3f46-d9c4-40fd-b931-653f9757a7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:08.736355 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca3f46-d9c4-40fd-b931-653f9757a7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:08.736631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca3f46-d9c4-40fd-b931-653f9757a7c1 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:08.737305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca3f46-d9c4-40fd-b931-653f9757a7c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:08.738787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca3f46-d9c4-40fd-b931-653f9757a7c1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:08.752320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 476/939] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:08.753440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0220b-ce00-4efb-9dc5-4412d679a398 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:08.753575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 464/940] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 25 16:06:08 2022] GET /identity/v3/services => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:06:08.784212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca3f46-d9c4-40fd-b931-653f9757a7c1 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:08.909257 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:08.918365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0220b-ce00-4efb-9dc5-4412d679a398 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:08.922025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca3f46-d9c4-40fd-b931-653f9757a7c1 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:08.954372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:08.976980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994b7ef-b201-4e2f-80ad-2b8937a4ed20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:08.977902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994b7ef-b201-4e2f-80ad-2b8937a4ed20 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:08.978099 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce71191-d5a7-4ef3-8f53-4642360526f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:08.978210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994b7ef-b201-4e2f-80ad-2b8937a4ed20 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:08.978457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994b7ef-b201-4e2f-80ad-2b8937a4ed20 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:08.978758 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce71191-d5a7-4ef3-8f53-4642360526f4 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:08.979048 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce71191-d5a7-4ef3-8f53-4642360526f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:08.979331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce71191-d5a7-4ef3-8f53-4642360526f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:08.979439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994b7ef-b201-4e2f-80ad-2b8937a4ed20 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:08.979664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994b7ef-b201-4e2f-80ad-2b8937a4ed20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:08.980049 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce71191-d5a7-4ef3-8f53-4642360526f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:08.981161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994b7ef-b201-4e2f-80ad-2b8937a4ed20 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:08.981572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce71191-d5a7-4ef3-8f53-4642360526f4 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:08.984459 dv-cinder-836973-15-smb devstack@keystone.service[80366]: WARNING keystone.server.flask.common [None req-7ce71191-d5a7-4ef3-8f53-4642360526f4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 16:06:09.012851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 477/941] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jul 25 16:06:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:09.018753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.sql.core [None req-7ce71191-d5a7-4ef3-8f53-4642360526f4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 16:06:09.018753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 16:06:09.018753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [parameters: {'id': '6c52aa7f9f834cffad3ad6425892d154', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 16:06:09.018753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80366) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 16:06:09.020920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994b7ef-b201-4e2f-80ad-2b8937a4ed20 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:09.032110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-7ce71191-d5a7-4ef3-8f53-4642360526f4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6c52aa7f9f834cffad3ad6425892d154.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6c52aa7f9f834cffad3ad6425892d154. Jul 25 16:06:09.032110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:09.032110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 16:06:09.032110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 16:06:09.032110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 16:06:09.032110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 16:06:09.032110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 16:06:09.032110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 16:06:09.032110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 16:06:09.032110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application conn.query(q) Jul 25 16:06:09.032110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 16:06:09.032110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 16:06:09.032110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application result.read() Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 16:06:09.033520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application next(self.gen) Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application yield resource Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application next(self.gen) Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise self.value Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application session.commit() Jul 25 16:06:09.034673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.session.flush() Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application compat.raise_( Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 16:06:09.035556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 16:06:09.036473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 16:06:09.036473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 16:06:09.036473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 16:06:09.036473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 16:06:09.036473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 16:06:09.036473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 16:06:09.036473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 16:06:09.036473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 16:06:09.036473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 16:06:09.036473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 16:06:09.036473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 16:06:09.036473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 16:06:09.036473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 16:06:09.036473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 16:06:09.036473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application conn.query(q) Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application result.read() Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 16:06:09.037242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 16:06:09.038092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 16:06:09.038092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 16:06:09.038092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 16:06:09.038092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 16:06:09.038092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 16:06:09.038092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 16:06:09.038092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 16:06:09.038092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 16:06:09.038092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [parameters: {'id': '6c52aa7f9f834cffad3ad6425892d154', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 16:06:09.038092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 16:06:09.038092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:09.038092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:09.038092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:09.038092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:09.038092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:09.038937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:09.039792 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:09.039792 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 16:06:09.039792 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 16:06:09.039792 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:09.039792 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:09.039792 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 16:06:09.039792 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 16:06:09.039792 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6c52aa7f9f834cffad3ad6425892d154. Jul 25 16:06:09.039792 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:09.050615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 465/942] 10.222.0.70 () {60 vars in 1140 bytes} [Mon Jul 25 16:06:08 2022] POST /identity/v3/projects => generated 262 bytes in 261 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:09.052182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce71191-d5a7-4ef3-8f53-4642360526f4 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:09.195722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce71191-d5a7-4ef3-8f53-4642360526f4 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:09.207028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994b7ef-b201-4e2f-80ad-2b8937a4ed20 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:09.253461 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f285631-3bee-44d0-9440-9e9715d8ff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:09.254558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f285631-3bee-44d0-9440-9e9715d8ff67 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:09.255002 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f285631-3bee-44d0-9440-9e9715d8ff67 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:09.255686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f285631-3bee-44d0-9440-9e9715d8ff67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:09.270775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f285631-3bee-44d0-9440-9e9715d8ff67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:09.272743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f285631-3bee-44d0-9440-9e9715d8ff67 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:09.275490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c39135-0be0-449a-b3ee-5e22fc3f6394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:09.277444 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c39135-0be0-449a-b3ee-5e22fc3f6394 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:09.278007 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c39135-0be0-449a-b3ee-5e22fc3f6394 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:09.278661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c39135-0be0-449a-b3ee-5e22fc3f6394 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:09.293603 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c39135-0be0-449a-b3ee-5e22fc3f6394 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:09.296917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c39135-0be0-449a-b3ee-5e22fc3f6394 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:09.297632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6f285631-3bee-44d0-9440-9e9715d8ff67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:09.297632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:09.297632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:09.297632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:09.297632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:09.297632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:09.297632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:09.297632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:09.297632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:09.297632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:09.297632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:09.297632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:09.297632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:06:09.297632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:06:09.297632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:09.298494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:09.299378 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:06:09.299378 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:06:09.299378 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:09.299378 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:09.306088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 478/943] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:09.308641 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f285631-3bee-44d0-9440-9e9715d8ff67 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:09.325164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-a6c39135-0be0-449a-b3ee-5e22fc3f6394 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:06:09.325164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:09.325164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:09.325164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:09.325164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:09.325164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:09.325164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:09.325164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:09.325164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:09.325164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:09.325164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:09.325164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:09.325164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:06:09.325164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:06:09.325164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:09.327023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:09.328872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:06:09.328872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:06:09.328872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:06:09.328872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:06:09.328872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:06:09.328872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:06:09.328872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:06:09.328872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:09.336322 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 466/944] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:09.336322 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c39135-0be0-449a-b3ee-5e22fc3f6394 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:09.351287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:09.363237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:09.475371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f285631-3bee-44d0-9440-9e9715d8ff67 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:09.494503 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c39135-0be0-449a-b3ee-5e22fc3f6394 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:09.520261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b52aea-eacc-47a3-8ea5-ccafca48a3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:09.520998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b52aea-eacc-47a3-8ea5-ccafca48a3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:09.521281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b52aea-eacc-47a3-8ea5-ccafca48a3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:09.521564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b52aea-eacc-47a3-8ea5-ccafca48a3e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:09.522339 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b52aea-eacc-47a3-8ea5-ccafca48a3e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:09.522651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b52aea-eacc-47a3-8ea5-ccafca48a3e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:09.524019 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b52aea-eacc-47a3-8ea5-ccafca48a3e5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:09.541469 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 479/945] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:09.542772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b52aea-eacc-47a3-8ea5-ccafca48a3e5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:09.544642 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff658e66-5bc5-4602-bb6a-8c6b269bbfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:09.545752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff658e66-5bc5-4602-bb6a-8c6b269bbfe0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:09.546240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff658e66-5bc5-4602-bb6a-8c6b269bbfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:09.547658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff658e66-5bc5-4602-bb6a-8c6b269bbfe0 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:09.548706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff658e66-5bc5-4602-bb6a-8c6b269bbfe0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:09.549227 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff658e66-5bc5-4602-bb6a-8c6b269bbfe0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:09.550899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff658e66-5bc5-4602-bb6a-8c6b269bbfe0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:09.584516 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 467/946] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 25 16:06:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:09.652656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:09.664081 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b52aea-eacc-47a3-8ea5-ccafca48a3e5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:09.702916 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510139d-f58e-45a0-ab3f-762ad3aa2c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:09.704270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510139d-f58e-45a0-ab3f-762ad3aa2c73 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:09.704564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510139d-f58e-45a0-ab3f-762ad3aa2c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:09.704844 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510139d-f58e-45a0-ab3f-762ad3aa2c73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:09.712791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510139d-f58e-45a0-ab3f-762ad3aa2c73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:09.714266 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510139d-f58e-45a0-ab3f-762ad3aa2c73 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:09.730155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b510139d-f58e-45a0-ab3f-762ad3aa2c73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:06:09.730155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:09.730155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:09.730155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:09.730155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:09.730155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:09.730155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:09.730155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:09.730155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:09.730155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:09.730155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:09.730155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:09.730155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:06:09.730155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:06:09.730155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:09.731058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:09.731934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:06:09.731934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:06:09.731934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:06:09.731934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:06:09.731934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:06:09.731934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:06:09.731934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:06:09.731934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:09.731934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 480/947] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:09.739356 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff658e66-5bc5-4602-bb6a-8c6b269bbfe0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:09.826998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:09.864867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff658e66-5bc5-4602-bb6a-8c6b269bbfe0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:09.899308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8987a61-0f96-47f7-b9ed-216e2403ca3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:09.899977 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8987a61-0f96-47f7-b9ed-216e2403ca3f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:09.900273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8987a61-0f96-47f7-b9ed-216e2403ca3f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:09.900558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8987a61-0f96-47f7-b9ed-216e2403ca3f None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:09.901348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8987a61-0f96-47f7-b9ed-216e2403ca3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:09.901976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8987a61-0f96-47f7-b9ed-216e2403ca3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:09.903418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8987a61-0f96-47f7-b9ed-216e2403ca3f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:09.917900 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 468/948] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:06:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:09.923961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510139d-f58e-45a0-ab3f-762ad3aa2c73 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:10.033453 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510139d-f58e-45a0-ab3f-762ad3aa2c73 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:10.068620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db510893-20bb-45ad-8b5b-2bea423ff711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:10.069606 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db510893-20bb-45ad-8b5b-2bea423ff711 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:10.069958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db510893-20bb-45ad-8b5b-2bea423ff711 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:10.070301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db510893-20bb-45ad-8b5b-2bea423ff711 None admin] PATH_INFO: `/v3/projects/0c9d252e2e0347029d58192fab233f09/users/ea56b6a25f8e46949e6deb8443b20673/roles/a040806445b64d57b153293502c52634` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:10.072629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db510893-20bb-45ad-8b5b-2bea423ff711 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9d252e2e0347029d58192fab233f09, user_id=ea56b6a25f8e46949e6deb8443b20673, role_id=a040806445b64d57b153293502c52634)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:10.074121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db510893-20bb-45ad-8b5b-2bea423ff711 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:10.090415 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 481/949] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:06:09 2022] PUT /identity/v3/projects/0c9d252e2e0347029d58192fab233f09/users/ea56b6a25f8e46949e6deb8443b20673/roles/a040806445b64d57b153293502c52634 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:06:10.707185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f26518-ab00-43bc-8933-72cf6475236c None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:10.707707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f26518-ab00-43bc-8933-72cf6475236c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:10.707707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f26518-ab00-43bc-8933-72cf6475236c None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:10.709350 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 469/950] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:10.715020 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd25d3-0d99-47fb-a70f-667dbce50d05 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:10.715838 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd25d3-0d99-47fb-a70f-667dbce50d05 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:10.716338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd25d3-0d99-47fb-a70f-667dbce50d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:10.735714 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-fabd25d3-0d99-47fb-a70f-667dbce50d05 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:10.737264 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fabd25d3-0d99-47fb-a70f-667dbce50d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:10.745817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:10.811837 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 482/951] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:10.834203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f26518-ab00-43bc-8933-72cf6475236c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:10.924417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9499c-bb4e-4866-a037-2bdff7c2f0bb None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:10.924834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9499c-bb4e-4866-a037-2bdff7c2f0bb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:10.925173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9499c-bb4e-4866-a037-2bdff7c2f0bb None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:10.928016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 483/952] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:06:10.932569 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc87648-b86e-49b7-92b7-d4707d700515 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:10.932930 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc87648-b86e-49b7-92b7-d4707d700515 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:10.933275 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc87648-b86e-49b7-92b7-d4707d700515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:10.952187 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f26518-ab00-43bc-8933-72cf6475236c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:10.952720 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3cc87648-b86e-49b7-92b7-d4707d700515 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:10.954706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3cc87648-b86e-49b7-92b7-d4707d700515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:10.981914 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:10.991124 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773fcbc-ab02-41ca-86ca-67b99d9baca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:10.991931 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773fcbc-ab02-41ca-86ca-67b99d9baca2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:10.992216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773fcbc-ab02-41ca-86ca-67b99d9baca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:10.992524 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773fcbc-ab02-41ca-86ca-67b99d9baca2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:10.993179 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773fcbc-ab02-41ca-86ca-67b99d9baca2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:10.994681 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773fcbc-ab02-41ca-86ca-67b99d9baca2 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-c773fcbc-ab02-41ca-86ca-67b99d9baca2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:11.008415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:11.009560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:11.009560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:11.009560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:11.009560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:11.009560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:11.009560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:11.009560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:06:11.009560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:06:11.009560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:06:11.009560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:06:11.009560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:11.009560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:11.009560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:11.009560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:11.009560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:11.009560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:11.013995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:11.013995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:11.013995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:11.013995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:11.013995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:11.013995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:11.013995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:11.013995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:11.013995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:11.013995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:11.013995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:06:11.013995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:11.013995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 16:06:11.013995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:11.013995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 470/953] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:06:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:11.018694 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773fcbc-ab02-41ca-86ca-67b99d9baca2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:11.056278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 484/954] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:06:11.070860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc87648-b86e-49b7-92b7-d4707d700515 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:11.134836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773fcbc-ab02-41ca-86ca-67b99d9baca2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:11.169960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:11.172990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47aeb5-8f2c-4e2b-86b3-b4d9c411ccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:11.173908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47aeb5-8f2c-4e2b-86b3-b4d9c411ccbf None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:11.174385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47aeb5-8f2c-4e2b-86b3-b4d9c411ccbf None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:11.174875 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47aeb5-8f2c-4e2b-86b3-b4d9c411ccbf None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:11.175774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47aeb5-8f2c-4e2b-86b3-b4d9c411ccbf None admin] RBAC: Adding query filter params (name=compute) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:11.176351 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47aeb5-8f2c-4e2b-86b3-b4d9c411ccbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:11.177930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47aeb5-8f2c-4e2b-86b3-b4d9c411ccbf None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:11.183525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 471/955] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 25 16:06:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:11.190115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47aeb5-8f2c-4e2b-86b3-b4d9c411ccbf None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:11.210142 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc87648-b86e-49b7-92b7-d4707d700515 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:11.253017 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:11.263263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c406e93-9b48-4357-a201-8db14e58b70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:11.264089 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c406e93-9b48-4357-a201-8db14e58b70c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:11.264472 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c406e93-9b48-4357-a201-8db14e58b70c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:11.264927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c406e93-9b48-4357-a201-8db14e58b70c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:11.265631 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c406e93-9b48-4357-a201-8db14e58b70c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:11.268298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c406e93-9b48-4357-a201-8db14e58b70c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-4c406e93-9b48-4357-a201-8db14e58b70c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:11.280011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:11.286927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:11.286927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:11.286927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:11.286927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:11.286927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:11.286927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:11.286927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:06:11.286927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:06:11.286927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:06:11.286927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:06:11.286927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:11.286927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:11.286927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:11.286927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:11.286927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:11.286927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:11.287761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:11.287761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:11.287761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:11.287761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:11.287761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:11.287761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:11.287761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:11.287761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:11.287761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:11.287761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:11.287761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:06:11.287761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:11.287761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 16:06:11.287761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:11.287761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 485/956] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 25 16:06:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:11.290860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c406e93-9b48-4357-a201-8db14e58b70c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:11.321286 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47aeb5-8f2c-4e2b-86b3-b4d9c411ccbf None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:11.365837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501b502-cb35-4345-b688-07e59f1cc661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:11.366664 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501b502-cb35-4345-b688-07e59f1cc661 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:11.367009 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501b502-cb35-4345-b688-07e59f1cc661 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:11.367291 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501b502-cb35-4345-b688-07e59f1cc661 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:11.368412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501b502-cb35-4345-b688-07e59f1cc661 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:11.368728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501b502-cb35-4345-b688-07e59f1cc661 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:11.370456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501b502-cb35-4345-b688-07e59f1cc661 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:11.384954 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 472/957] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 25 16:06:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:11.425071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c406e93-9b48-4357-a201-8db14e58b70c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:11.462946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ae88b-2e4c-4384-9011-20a51c432c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:11.463627 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ae88b-2e4c-4384-9011-20a51c432c91 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:11.463914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ae88b-2e4c-4384-9011-20a51c432c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:11.464262 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ae88b-2e4c-4384-9011-20a51c432c91 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:11.464988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ae88b-2e4c-4384-9011-20a51c432c91 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:11.465345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ae88b-2e4c-4384-9011-20a51c432c91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:11.466755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ae88b-2e4c-4384-9011-20a51c432c91 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:11.469504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:11.474130 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 486/958] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 25 16:06:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:11.481417 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501b502-cb35-4345-b688-07e59f1cc661 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:11.594525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501b502-cb35-4345-b688-07e59f1cc661 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:11.612508 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:11.630774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fbe31-2b97-40f7-8921-7044a52dfa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:11.631803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fbe31-2b97-40f7-8921-7044a52dfa51 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:11.632306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fbe31-2b97-40f7-8921-7044a52dfa51 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:11.632799 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fbe31-2b97-40f7-8921-7044a52dfa51 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:11.633693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fbe31-2b97-40f7-8921-7044a52dfa51 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:11.634213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fbe31-2b97-40f7-8921-7044a52dfa51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:11.635780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fbe31-2b97-40f7-8921-7044a52dfa51 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:11.646367 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 473/959] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 25 16:06:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:11.648121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ae88b-2e4c-4384-9011-20a51c432c91 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:11.751915 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22cec3-a3e6-41f9-b6e0-a65f3886c492 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:11.752548 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22cec3-a3e6-41f9-b6e0-a65f3886c492 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:11.752548 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22cec3-a3e6-41f9-b6e0-a65f3886c492 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:11.754465 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 474/960] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:06:11.760911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37211074-ae42-4a31-9887-6439c575871c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:11.761525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37211074-ae42-4a31-9887-6439c575871c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:11.762008 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37211074-ae42-4a31-9887-6439c575871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:11.763698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ae88b-2e4c-4384-9011-20a51c432c91 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:11.783698 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-37211074-ae42-4a31-9887-6439c575871c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:11.785670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-37211074-ae42-4a31-9887-6439c575871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:11.834925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e2dbc-b17c-4e3d-903e-fb5454df414a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:11.835610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e2dbc-b17c-4e3d-903e-fb5454df414a None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:11.835906 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e2dbc-b17c-4e3d-903e-fb5454df414a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:11.836170 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e2dbc-b17c-4e3d-903e-fb5454df414a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:11.837345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e2dbc-b17c-4e3d-903e-fb5454df414a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:11.839185 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e2dbc-b17c-4e3d-903e-fb5454df414a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:11.870634 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 487/961] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:06:11 2022] POST /identity/v3/endpoints => generated 349 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:06:11.885694 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 475/962] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:06:11.912365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e2dbc-b17c-4e3d-903e-fb5454df414a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:11.982029 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:12.036354 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e2dbc-b17c-4e3d-903e-fb5454df414a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:12.078031 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec721f-84f8-4791-a7d5-4ca6ce482132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:12.079243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec721f-84f8-4791-a7d5-4ca6ce482132 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:12.079531 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec721f-84f8-4791-a7d5-4ca6ce482132 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:12.079809 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec721f-84f8-4791-a7d5-4ca6ce482132 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:12.080549 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec721f-84f8-4791-a7d5-4ca6ce482132 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:12.082010 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec721f-84f8-4791-a7d5-4ca6ce482132 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:12.084714 dv-cinder-836973-15-smb devstack@keystone.service[80365]: WARNING keystone.server.flask.common [None req-0bec721f-84f8-4791-a7d5-4ca6ce482132 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 16:06:12.098700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.sql.core [None req-0bec721f-84f8-4791-a7d5-4ca6ce482132 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 16:06:12.098700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 16:06:12.098700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [parameters: {'user_id': '615443f7f4a84347874f80d60bf55b01', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 16:06:12.098700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80365) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 16:06:12.116566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-0bec721f-84f8-4791-a7d5-4ca6ce482132 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 16:06:12.116566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:12.116566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 16:06:12.116566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 16:06:12.116566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 16:06:12.116566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 16:06:12.116566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 16:06:12.116566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 16:06:12.116566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 16:06:12.116566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application conn.query(q) Jul 25 16:06:12.116566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 16:06:12.116566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 16:06:12.116566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 16:06:12.116566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application result.read() Jul 25 16:06:12.116566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 16:06:12.117500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application next(self.gen) Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application yield resource Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application next(self.gen) Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise self.value Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application session.commit() Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 16:06:12.118899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self.session.flush() Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application compat.raise_( Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 16:06:12.121070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 16:06:12.126867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 16:06:12.126867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 16:06:12.126867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 16:06:12.126867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 16:06:12.126867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 16:06:12.126867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 16:06:12.126867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 16:06:12.126867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 16:06:12.126867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 16:06:12.126867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 16:06:12.126867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 16:06:12.126867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 16:06:12.126867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 16:06:12.126867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 16:06:12.126867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 16:06:12.126867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception Jul 25 16:06:12.128951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 16:06:12.128951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 16:06:12.128951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 16:06:12.128951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 16:06:12.128951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 16:06:12.128951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 16:06:12.128951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 16:06:12.128951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application conn.query(q) Jul 25 16:06:12.128951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 16:06:12.128951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 16:06:12.128951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 16:06:12.128951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application result.read() Jul 25 16:06:12.128951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 16:06:12.128951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 16:06:12.128951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 16:06:12.128951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 16:06:12.131209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 16:06:12.131209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 16:06:12.131209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 16:06:12.131209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 16:06:12.131209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 16:06:12.131209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 16:06:12.131209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [parameters: {'user_id': '615443f7f4a84347874f80d60bf55b01', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 16:06:12.131209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 16:06:12.131209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:12.131209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:12.131209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:12.131209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:12.131209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:12.131209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:12.131209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 16:06:12.133199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 16:06:12.135353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 16:06:12.135353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 16:06:12.135353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 16:06:12.135353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 16:06:12.135353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 16:06:12.135353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:12.135353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 488/963] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Jul 25 16:06:11 2022] POST /identity/v3/users => generated 160 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:12.136310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37211074-ae42-4a31-9887-6439c575871c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:12.270166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37211074-ae42-4a31-9887-6439c575871c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:12.283825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0e700-4649-41ba-855e-f816dfb32b61 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:12.284369 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0e700-4649-41ba-855e-f816dfb32b61 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:12.284866 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0e700-4649-41ba-855e-f816dfb32b61 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:12.286587 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:12.292615 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 489/964] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:12 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:12.298740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cfe4c-856e-45ee-a42d-7f9ab4056780 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:12.299054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cfe4c-856e-45ee-a42d-7f9ab4056780 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:12.299341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cfe4c-856e-45ee-a42d-7f9ab4056780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:12.321000 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-fe3cfe4c-856e-45ee-a42d-7f9ab4056780 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:12.322962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fe3cfe4c-856e-45ee-a42d-7f9ab4056780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:12.323944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726e25a-a29d-40e6-b54e-a1f65cf2180c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:12.324805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726e25a-a29d-40e6-b54e-a1f65cf2180c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:12.325088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726e25a-a29d-40e6-b54e-a1f65cf2180c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:12.325370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726e25a-a29d-40e6-b54e-a1f65cf2180c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:12.334655 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726e25a-a29d-40e6-b54e-a1f65cf2180c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:12.336204 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726e25a-a29d-40e6-b54e-a1f65cf2180c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:12.355638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-4726e25a-a29d-40e6-b54e-a1f65cf2180c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 16:06:12.355638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:12.355638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:12.355638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:12.355638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:12.355638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:12.355638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:12.355638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:12.355638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:12.355638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:12.355638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:12.355638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:12.355638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:06:12.355638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:06:12.355638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:06:12.355638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:12.356770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:12.357714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:12.357714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:12.357714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:06:12.357714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:06:12.357714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:06:12.357714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:06:12.357714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:06:12.357714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:06:12.357714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 16:06:12.357714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:12.357714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 476/965] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:06:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:12.363140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726e25a-a29d-40e6-b54e-a1f65cf2180c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:12.424344 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 490/966] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:12.446317 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cfe4c-856e-45ee-a42d-7f9ab4056780 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:12.512745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:12.518346 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726e25a-a29d-40e6-b54e-a1f65cf2180c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:12.558732 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92e786-d9cf-477c-bdf4-2a9155a4938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:12.559515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92e786-d9cf-477c-bdf4-2a9155a4938b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:12.559940 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92e786-d9cf-477c-bdf4-2a9155a4938b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:12.560276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92e786-d9cf-477c-bdf4-2a9155a4938b None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:12.561287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92e786-d9cf-477c-bdf4-2a9155a4938b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:12.561700 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92e786-d9cf-477c-bdf4-2a9155a4938b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:12.563749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92e786-d9cf-477c-bdf4-2a9155a4938b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:12.575709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cfe4c-856e-45ee-a42d-7f9ab4056780 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:12.603006 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 477/967] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Jul 25 16:06:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:12.628013 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b01a73-a14b-4c46-adcf-7a4dbec9bb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:12.628899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b01a73-a14b-4c46-adcf-7a4dbec9bb46 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:12.629179 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b01a73-a14b-4c46-adcf-7a4dbec9bb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:12.629457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b01a73-a14b-4c46-adcf-7a4dbec9bb46 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:12.642565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b01a73-a14b-4c46-adcf-7a4dbec9bb46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:06:12.651111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e4b01a73-a14b-4c46-adcf-7a4dbec9bb46 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 16:06:12.651111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:12.651111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:12.651111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:12.651111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:12.651111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:12.651111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:12.651111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:12.651111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:12.651111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:12.651111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:12.651111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:12.651111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:06:12.651111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:06:12.651111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:06:12.651111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:06:12.652604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:06:12.652604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:06:12.652604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:06:12.652604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:06:12.652604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:12.652604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:12.652604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:12.652604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:12.652604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:12.652604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:12.652604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:12.652604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:12.652604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:12.652604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:12.652604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:12.652604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:12.653624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:12.653624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:12.653624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:12.653624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:12.653624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:06:12.653624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:06:12.653624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:06:12.653624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:06:12.653624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:06:12.653624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:06:12.653624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 16:06:12.653624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:12.653624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 491/968] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jul 25 16:06:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:12.659153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92e786-d9cf-477c-bdf4-2a9155a4938b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:12.692482 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:12.775921 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92e786-d9cf-477c-bdf4-2a9155a4938b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:12.813345 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea140d-ea7b-4cf4-91b9-85ed752d0d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:12.814026 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea140d-ea7b-4cf4-91b9-85ed752d0d80 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:12.814303 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea140d-ea7b-4cf4-91b9-85ed752d0d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:12.814577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea140d-ea7b-4cf4-91b9-85ed752d0d80 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:12.815321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea140d-ea7b-4cf4-91b9-85ed752d0d80 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:12.815622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea140d-ea7b-4cf4-91b9-85ed752d0d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:12.817035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea140d-ea7b-4cf4-91b9-85ed752d0d80 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:12.826831 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 478/969] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jul 25 16:06:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:12.833176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b01a73-a14b-4c46-adcf-7a4dbec9bb46 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:12.953035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b01a73-a14b-4c46-adcf-7a4dbec9bb46 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:12.963805 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:12.993110 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624ec0c-c9c9-41a9-a672-f0a739c2c0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:12.993964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624ec0c-c9c9-41a9-a672-f0a739c2c0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:12.994310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624ec0c-c9c9-41a9-a672-f0a739c2c0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:12.994567 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624ec0c-c9c9-41a9-a672-f0a739c2c0b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:13.006092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624ec0c-c9c9-41a9-a672-f0a739c2c0b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:13.007676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624ec0c-c9c9-41a9-a672-f0a739c2c0b2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:13.026050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-8624ec0c-c9c9-41a9-a672-f0a739c2c0b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:13.026050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:13.026050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:13.026050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:13.026050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:13.026050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:13.026050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:13.026050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:13.026050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:13.026050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:13.026050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:13.026050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:13.026050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:06:13.026050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:06:13.026050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:13.027227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:13.028201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:06:13.028201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:06:13.028201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:13.028201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:13.028201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 492/970] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:13.035150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea140d-ea7b-4cf4-91b9-85ed752d0d80 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:13.145377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:13.161341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea140d-ea7b-4cf4-91b9-85ed752d0d80 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:13.198256 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb345c9-a768-4a74-aa4e-f868131331a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:13.198938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb345c9-a768-4a74-aa4e-f868131331a9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:13.199222 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb345c9-a768-4a74-aa4e-f868131331a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:13.199478 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb345c9-a768-4a74-aa4e-f868131331a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:13.200201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb345c9-a768-4a74-aa4e-f868131331a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:13.200532 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb345c9-a768-4a74-aa4e-f868131331a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:13.201969 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb345c9-a768-4a74-aa4e-f868131331a9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:13.220167 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 479/971] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:13.221643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624ec0c-c9c9-41a9-a672-f0a739c2c0b2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:13.373123 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624ec0c-c9c9-41a9-a672-f0a739c2c0b2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:13.439646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f13219-23eb-40a9-a003-81ba82b3cc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:13.442024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f13219-23eb-40a9-a003-81ba82b3cc4c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:13.442767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f13219-23eb-40a9-a003-81ba82b3cc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:13.443501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f13219-23eb-40a9-a003-81ba82b3cc4c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:13.457865 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f13219-23eb-40a9-a003-81ba82b3cc4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:13.461045 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f13219-23eb-40a9-a003-81ba82b3cc4c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:13.492054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-27f13219-23eb-40a9-a003-81ba82b3cc4c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 16:06:13.492054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:13.492054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:13.492054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:13.492054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:13.492054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:13.492054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:13.492054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:13.492054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:13.492054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:13.492054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:13.492054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:13.492054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:06:13.492054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:06:13.492054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:06:13.492054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:13.493969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:13.495871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:13.495871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:13.495871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:06:13.495871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:06:13.495871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:06:13.495871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:06:13.495871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:06:13.495871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:06:13.495871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 16:06:13.495871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:13.495871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 493/972] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 25 16:06:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:13.508557 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb345c9-a768-4a74-aa4e-f868131331a9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:13.536384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb27654-4e49-455e-b885-986a3add772b None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:13.536697 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb27654-4e49-455e-b885-986a3add772b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:13.536951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb27654-4e49-455e-b885-986a3add772b None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:13.538633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 494/973] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:06:13.545369 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065daac-3e65-4dc0-b4e8-e35655dba1ac None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:13.546053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065daac-3e65-4dc0-b4e8-e35655dba1ac None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:13.546616 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065daac-3e65-4dc0-b4e8-e35655dba1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:13.568611 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2065daac-3e65-4dc0-b4e8-e35655dba1ac None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:13.569835 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2065daac-3e65-4dc0-b4e8-e35655dba1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:13.586257 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:13.638940 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb345c9-a768-4a74-aa4e-f868131331a9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:13.645508 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 495/974] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:13.668541 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065daac-3e65-4dc0-b4e8-e35655dba1ac None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:13.677334 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996e7b0-055e-41dd-86a4-9b66cef22ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:13.678118 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e7b0-055e-41dd-86a4-9b66cef22ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:13.678430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e7b0-055e-41dd-86a4-9b66cef22ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:13.678707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996e7b0-055e-41dd-86a4-9b66cef22ca3 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:13.679580 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996e7b0-055e-41dd-86a4-9b66cef22ca3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:13.679884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996e7b0-055e-41dd-86a4-9b66cef22ca3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:13.681341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996e7b0-055e-41dd-86a4-9b66cef22ca3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:13.706447 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 480/975] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Jul 25 16:06:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:13.707221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996e7b0-055e-41dd-86a4-9b66cef22ca3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:13.715980 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:13.774819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065daac-3e65-4dc0-b4e8-e35655dba1ac None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:13.814086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472dce0-4867-47dc-87d6-8dfd8cd3385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:13.814926 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472dce0-4867-47dc-87d6-8dfd8cd3385a None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:13.815253 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472dce0-4867-47dc-87d6-8dfd8cd3385a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:13.815638 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472dce0-4867-47dc-87d6-8dfd8cd3385a None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:13.816614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472dce0-4867-47dc-87d6-8dfd8cd3385a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:13.818234 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472dce0-4867-47dc-87d6-8dfd8cd3385a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:13.818360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996e7b0-055e-41dd-86a4-9b66cef22ca3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:13.835981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 496/976] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 25 16:06:13 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:06:13.881883 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f65e4-674b-4b5e-9329-20519a6b1511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:13.882555 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f65e4-674b-4b5e-9329-20519a6b1511 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:13.882847 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f65e4-674b-4b5e-9329-20519a6b1511 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:13.883128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f65e4-674b-4b5e-9329-20519a6b1511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:13.985959 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f65e4-674b-4b5e-9329-20519a6b1511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:13.987476 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f65e4-674b-4b5e-9329-20519a6b1511 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:13.989820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:14.117531 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 481/977] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:06:13 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:06:14.123361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472dce0-4867-47dc-87d6-8dfd8cd3385a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:14.138352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:14.165030 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09074c5f-dfa9-485e-bd52-04b8e5acbd77 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:14.165452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09074c5f-dfa9-485e-bd52-04b8e5acbd77 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:14.165744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09074c5f-dfa9-485e-bd52-04b8e5acbd77 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:14.167130 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 482/978] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:14.173168 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648c672-0859-4585-9d25-c777db368ee0 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:14.173748 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648c672-0859-4585-9d25-c777db368ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:14.174095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648c672-0859-4585-9d25-c777db368ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:14.192898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a648c672-0859-4585-9d25-c777db368ee0 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:14.194210 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a648c672-0859-4585-9d25-c777db368ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:14.242623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472dce0-4867-47dc-87d6-8dfd8cd3385a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:14.280296 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 483/979] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:06:14.287703 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667adbd-0480-449c-9b2c-118fa20ac3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:14.288637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667adbd-0480-449c-9b2c-118fa20ac3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:14.288996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667adbd-0480-449c-9b2c-118fa20ac3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:14.289353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667adbd-0480-449c-9b2c-118fa20ac3c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:14.302210 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648c672-0859-4585-9d25-c777db368ee0 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:14.302558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667adbd-0480-449c-9b2c-118fa20ac3c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:14.304014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667adbd-0480-449c-9b2c-118fa20ac3c0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:14.325949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-1667adbd-0480-449c-9b2c-118fa20ac3c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:14.325949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:14.325949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:14.325949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:14.325949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:14.325949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:14.325949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:14.325949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:14.325949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:14.325949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:14.325949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:14.325949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:14.325949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:06:14.325949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:06:14.325949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:14.327973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:14.329929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:06:14.329929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:06:14.329929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:14.329929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:14.329929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 497/980] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:14.333480 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667adbd-0480-449c-9b2c-118fa20ac3c0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:14.353671 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:14.423705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:14.457893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648c672-0859-4585-9d25-c777db368ee0 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:14.468535 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667adbd-0480-449c-9b2c-118fa20ac3c0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:14.509669 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8fbe8-c578-43e2-972c-e37499423f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:14.510819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8fbe8-c578-43e2-972c-e37499423f60 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:14.511320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8fbe8-c578-43e2-972c-e37499423f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:14.511739 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e252b7c-5ba4-4004-a17c-4f259b00428a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:14.511884 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8fbe8-c578-43e2-972c-e37499423f60 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:14.512532 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e252b7c-5ba4-4004-a17c-4f259b00428a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:14.512818 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e252b7c-5ba4-4004-a17c-4f259b00428a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:14.512916 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8fbe8-c578-43e2-972c-e37499423f60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:14.513094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e252b7c-5ba4-4004-a17c-4f259b00428a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:14.513293 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8fbe8-c578-43e2-972c-e37499423f60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:14.513748 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e252b7c-5ba4-4004-a17c-4f259b00428a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:14.515129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e252b7c-5ba4-4004-a17c-4f259b00428a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:14.516500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8fbe8-c578-43e2-972c-e37499423f60 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-4e252b7c-5ba4-4004-a17c-4f259b00428a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:14.530189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:14.535657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:14.535657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:14.535657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:14.535657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:14.535657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:14.535657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:14.535657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:06:14.535657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:06:14.535657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:06:14.535657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:06:14.535657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:14.535657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:14.535657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:14.535657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:14.535657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:14.535657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:14.538111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:14.538111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:14.538111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:14.538111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:14.538111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:14.538111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:14.538111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:14.538111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:14.538111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:14.538111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:14.538111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:06:14.538111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:14.538111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 16:06:14.538111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:14.538111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 484/981] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 25 16:06:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:14.541282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e252b7c-5ba4-4004-a17c-4f259b00428a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:14.554543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 498/982] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:14.555430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8fbe8-c578-43e2-972c-e37499423f60 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:14.653436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:14.664267 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e252b7c-5ba4-4004-a17c-4f259b00428a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:14.685263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8fbe8-c578-43e2-972c-e37499423f60 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:14.706614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1cbc7-8590-4fc5-acf6-124132356a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:14.707307 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1cbc7-8590-4fc5-acf6-124132356a53 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:14.707583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1cbc7-8590-4fc5-acf6-124132356a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:14.707858 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1cbc7-8590-4fc5-acf6-124132356a53 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:14.708629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1cbc7-8590-4fc5-acf6-124132356a53 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:14.708937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1cbc7-8590-4fc5-acf6-124132356a53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:14.710338 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1cbc7-8590-4fc5-acf6-124132356a53 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:14.716297 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 485/983] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 25 16:06:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:14.720652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:14.722576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1cbc7-8590-4fc5-acf6-124132356a53 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:14.740449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbe636-27ef-4c3e-a4fa-d17ebb9df9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:14.741265 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbe636-27ef-4c3e-a4fa-d17ebb9df9bf None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:14.741556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbe636-27ef-4c3e-a4fa-d17ebb9df9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:14.741832 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbe636-27ef-4c3e-a4fa-d17ebb9df9bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:14.749242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbe636-27ef-4c3e-a4fa-d17ebb9df9bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:14.750798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbe636-27ef-4c3e-a4fa-d17ebb9df9bf None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:14.765261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-53cbe636-27ef-4c3e-a4fa-d17ebb9df9bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:06:14.765261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:14.765261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:14.765261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:14.765261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:14.765261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:14.765261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:14.765261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:14.765261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:14.765261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:14.765261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:14.765261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:14.765261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:06:14.765261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:06:14.765261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:14.766237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:14.767091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:06:14.767091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:06:14.767091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:06:14.767091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:06:14.767091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:06:14.767091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:06:14.767091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:06:14.767091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:14.767091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 499/984] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:06:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:14.772172 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbe636-27ef-4c3e-a4fa-d17ebb9df9bf None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:14.835790 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1cbc7-8590-4fc5-acf6-124132356a53 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:14.872573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be054625-2a1c-4ae7-a151-a3e5068f05c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:14.873243 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be054625-2a1c-4ae7-a151-a3e5068f05c8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:14.873558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be054625-2a1c-4ae7-a151-a3e5068f05c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:14.873805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be054625-2a1c-4ae7-a151-a3e5068f05c8 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:14.874747 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be054625-2a1c-4ae7-a151-a3e5068f05c8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:14.874862 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be054625-2a1c-4ae7-a151-a3e5068f05c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:14.876209 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be054625-2a1c-4ae7-a151-a3e5068f05c8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:14.885982 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 486/985] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 25 16:06:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:14.886182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbe636-27ef-4c3e-a4fa-d17ebb9df9bf None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:14.887451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be054625-2a1c-4ae7-a151-a3e5068f05c8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:14.915802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:14.923131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fd76a-107a-447f-adb1-ddb3bb6e4f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:14.923969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fd76a-107a-447f-adb1-ddb3bb6e4f3f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:14.924379 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fd76a-107a-447f-adb1-ddb3bb6e4f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:14.924754 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fd76a-107a-447f-adb1-ddb3bb6e4f3f None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:14.925696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fd76a-107a-447f-adb1-ddb3bb6e4f3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:14.925883 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fd76a-107a-447f-adb1-ddb3bb6e4f3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:14.927618 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fd76a-107a-447f-adb1-ddb3bb6e4f3f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:14.940481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 500/986] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:06:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:14.946284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fd76a-107a-447f-adb1-ddb3bb6e4f3f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:14.992325 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:15.000156 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be054625-2a1c-4ae7-a151-a3e5068f05c8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:15.038307 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceac93a-1fd6-4754-8a2a-5c4ca80dffa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:15.038982 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceac93a-1fd6-4754-8a2a-5c4ca80dffa9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:15.039270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceac93a-1fd6-4754-8a2a-5c4ca80dffa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:15.039548 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceac93a-1fd6-4754-8a2a-5c4ca80dffa9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:15.040372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceac93a-1fd6-4754-8a2a-5c4ca80dffa9 None admin] RBAC: Adding query filter params (interface=admin, service_id=eca2838a2f684eaebbfd3bc27837cbd1, region_id=RegionOne) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:15.040689 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceac93a-1fd6-4754-8a2a-5c4ca80dffa9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:15.042077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceac93a-1fd6-4754-8a2a-5c4ca80dffa9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:15.047781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 487/987] 10.222.0.70 () {56 vars in 1249 bytes} [Mon Jul 25 16:06:14 2022] GET /identity/v3/endpoints?service_id=eca2838a2f684eaebbfd3bc27837cbd1&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:15.053252 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceac93a-1fd6-4754-8a2a-5c4ca80dffa9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:15.062109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fd76a-107a-447f-adb1-ddb3bb6e4f3f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:15.102187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6f37e-fc45-4069-9167-79e6dcdbe52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:15.103009 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6f37e-fc45-4069-9167-79e6dcdbe52b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:15.103389 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6f37e-fc45-4069-9167-79e6dcdbe52b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:15.103768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6f37e-fc45-4069-9167-79e6dcdbe52b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:15.104762 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6f37e-fc45-4069-9167-79e6dcdbe52b None admin] RBAC: Adding query filter params (role.id=a040806445b64d57b153293502c52634, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=ea56b6a25f8e46949e6deb8443b20673) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:15.105167 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6f37e-fc45-4069-9167-79e6dcdbe52b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:15.106596 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6f37e-fc45-4069-9167-79e6dcdbe52b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:15.124297 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 501/988] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:06:14 2022] GET /identity/v3/role_assignments?user.id=ea56b6a25f8e46949e6deb8443b20673&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=a040806445b64d57b153293502c52634 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:15.163924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:15.182071 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceac93a-1fd6-4754-8a2a-5c4ca80dffa9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:15.220155 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968868d-f9b9-4de7-a9fd-d5e3a01024ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:15.220789 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968868d-f9b9-4de7-a9fd-d5e3a01024ce None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:15.221075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968868d-f9b9-4de7-a9fd-d5e3a01024ce None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:15.221353 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968868d-f9b9-4de7-a9fd-d5e3a01024ce None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:15.222044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968868d-f9b9-4de7-a9fd-d5e3a01024ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:15.223432 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968868d-f9b9-4de7-a9fd-d5e3a01024ce None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:15.239492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 488/989] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 25 16:06:15 2022] GET /identity/v3/services => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:06:15.965632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df3ce7-dc6b-42b6-ab52-20b10881b225 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:15.966178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df3ce7-dc6b-42b6-ab52-20b10881b225 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:15.966178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df3ce7-dc6b-42b6-ab52-20b10881b225 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:15.967633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 502/990] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:15.972998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3ca9d-4111-4c37-8739-1f69d9beb06c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:15.973404 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3ca9d-4111-4c37-8739-1f69d9beb06c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:15.973619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3ca9d-4111-4c37-8739-1f69d9beb06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:15.991925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-cae3ca9d-4111-4c37-8739-1f69d9beb06c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:15.993145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-cae3ca9d-4111-4c37-8739-1f69d9beb06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:16.062172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 489/991] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:16.084178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df3ce7-dc6b-42b6-ab52-20b10881b225 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:16.189761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df3ce7-dc6b-42b6-ab52-20b10881b225 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:16.197416 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:16.228649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010ce69-c9f2-4bf8-ab82-e9148f91ba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:16.229365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010ce69-c9f2-4bf8-ab82-e9148f91ba83 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:16.229644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010ce69-c9f2-4bf8-ab82-e9148f91ba83 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:16.229972 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010ce69-c9f2-4bf8-ab82-e9148f91ba83 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:16.230624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010ce69-c9f2-4bf8-ab82-e9148f91ba83 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:16.231978 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010ce69-c9f2-4bf8-ab82-e9148f91ba83 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-3010ce69-c9f2-4bf8-ab82-e9148f91ba83 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:16.246654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:16.247755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:16.247755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:16.247755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:16.247755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:16.247755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:16.247755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:16.247755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:06:16.247755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:06:16.247755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:06:16.247755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:06:16.247755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:16.247755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:16.247755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:16.247755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:16.247755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:16.247755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:16.249343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:16.249343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:16.249343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:16.249343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:16.249343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:16.249343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:16.249343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:16.249343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:16.249343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:16.249343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:16.249343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:06:16.249343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:16.249343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 16:06:16.249343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:16.250839 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 503/992] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:06:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:16.254701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3ca9d-4111-4c37-8739-1f69d9beb06c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:16.345152 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:16.367919 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3ca9d-4111-4c37-8739-1f69d9beb06c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:16.406262 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c3a29-324f-4529-bd2f-ea675d4c77ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:16.407467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c3a29-324f-4529-bd2f-ea675d4c77ea None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:16.407772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c3a29-324f-4529-bd2f-ea675d4c77ea None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:16.408073 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c3a29-324f-4529-bd2f-ea675d4c77ea None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:16.408938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c3a29-324f-4529-bd2f-ea675d4c77ea None admin] RBAC: Adding query filter params (name=compute) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:16.409279 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c3a29-324f-4529-bd2f-ea675d4c77ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:16.410685 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c3a29-324f-4529-bd2f-ea675d4c77ea None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:16.420312 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 490/993] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 25 16:06:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:16.421775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010ce69-c9f2-4bf8-ab82-e9148f91ba83 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:16.520747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010ce69-c9f2-4bf8-ab82-e9148f91ba83 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:16.554117 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f16d35-e948-4b92-bd8f-c1a0d5449575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:16.554957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f16d35-e948-4b92-bd8f-c1a0d5449575 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:16.555338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f16d35-e948-4b92-bd8f-c1a0d5449575 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:16.555710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f16d35-e948-4b92-bd8f-c1a0d5449575 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:16.556546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f16d35-e948-4b92-bd8f-c1a0d5449575 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:16.556951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f16d35-e948-4b92-bd8f-c1a0d5449575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:16.558412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f16d35-e948-4b92-bd8f-c1a0d5449575 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:16.563886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 504/994] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 25 16:06:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:16.569497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c3a29-324f-4529-bd2f-ea675d4c77ea None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:16.673558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c3a29-324f-4529-bd2f-ea675d4c77ea None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:16.708197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af84290-2699-4cc9-aa5a-14294a48a893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:16.708876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af84290-2699-4cc9-aa5a-14294a48a893 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:16.709159 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af84290-2699-4cc9-aa5a-14294a48a893 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:16.709434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af84290-2699-4cc9-aa5a-14294a48a893 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:16.710208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af84290-2699-4cc9-aa5a-14294a48a893 None admin] RBAC: Adding query filter params (interface=public, service_id=e6026f68320f45fba167e280e830a0ed, region_id=RegionOne) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:16.710517 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af84290-2699-4cc9-aa5a-14294a48a893 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:16.711871 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af84290-2699-4cc9-aa5a-14294a48a893 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:16.722060 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 491/995] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jul 25 16:06:16 2022] GET /identity/v3/endpoints?service_id=e6026f68320f45fba167e280e830a0ed&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:16.723724 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f16d35-e948-4b92-bd8f-c1a0d5449575 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:16.759310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:16.828243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f16d35-e948-4b92-bd8f-c1a0d5449575 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:16.862387 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210c2e5-5664-49c8-836d-447a386d74bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:16.863057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210c2e5-5664-49c8-836d-447a386d74bc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:16.863338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210c2e5-5664-49c8-836d-447a386d74bc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:16.863610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210c2e5-5664-49c8-836d-447a386d74bc None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:16.864308 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210c2e5-5664-49c8-836d-447a386d74bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:16.865664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210c2e5-5664-49c8-836d-447a386d74bc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:16.872201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 505/996] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 25 16:06:16 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:06:17.229615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617da02-cd23-4356-9bed-b21cf2a52058 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:17.230210 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617da02-cd23-4356-9bed-b21cf2a52058 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:17.230210 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617da02-cd23-4356-9bed-b21cf2a52058 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:17.231740 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 492/997] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:17.239660 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8d5bb-df0b-4614-9c4d-fc09cd243324 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:17.240548 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8d5bb-df0b-4614-9c4d-fc09cd243324 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:17.240830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8d5bb-df0b-4614-9c4d-fc09cd243324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:17.259107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-96a8d5bb-df0b-4614-9c4d-fc09cd243324 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:17.260340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-96a8d5bb-df0b-4614-9c4d-fc09cd243324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:17.267187 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ae831-3dba-42a8-bfba-3bf21b976327 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:17.267478 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ae831-3dba-42a8-bfba-3bf21b976327 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:17.267758 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ae831-3dba-42a8-bfba-3bf21b976327 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:17.269307 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 493/998] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:06:17.274045 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca04353-ace7-4506-927a-5f2e650fc8e2 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:17.274339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca04353-ace7-4506-927a-5f2e650fc8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:17.274622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca04353-ace7-4506-927a-5f2e650fc8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:17.294128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-cca04353-ace7-4506-927a-5f2e650fc8e2 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:17.295326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-cca04353-ace7-4506-927a-5f2e650fc8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:17.298261 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:17.338294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 506/999] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:17.360835 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8d5bb-df0b-4614-9c4d-fc09cd243324 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:17.365190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 494/1000] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:06:17.387619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca04353-ace7-4506-927a-5f2e650fc8e2 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:17.389553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:17.468584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8d5bb-df0b-4614-9c4d-fc09cd243324 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:17.496822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca04353-ace7-4506-927a-5f2e650fc8e2 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:17.506042 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43908b28-dd9b-49c3-a80a-346f15133af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:17.506843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43908b28-dd9b-49c3-a80a-346f15133af2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:17.507133 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43908b28-dd9b-49c3-a80a-346f15133af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:17.507414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43908b28-dd9b-49c3-a80a-346f15133af2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:17.508057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43908b28-dd9b-49c3-a80a-346f15133af2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:17.509474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43908b28-dd9b-49c3-a80a-346f15133af2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-43908b28-dd9b-49c3-a80a-346f15133af2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:17.522274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:17.523515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:17.523515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:17.523515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:17.523515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:17.523515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:17.523515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:17.523515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:06:17.523515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:06:17.523515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:06:17.523515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:06:17.523515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:17.523515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:17.523515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:17.523515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:17.523515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:17.523515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:17.524620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:17.524620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:17.524620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:17.524620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:17.524620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:17.524620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:17.524620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:17.524620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:17.524620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:17.524620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:17.524620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:06:17.524620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:17.524620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 16:06:17.524620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:17.524620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 507/1001] 10.222.0.70 () {56 vars in 1105 bytes} [Mon Jul 25 16:06:17 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:17.530206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43908b28-dd9b-49c3-a80a-346f15133af2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:17.537858 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640d5fb-f475-47cc-a0f4-b088a92b2a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:17.538738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640d5fb-f475-47cc-a0f4-b088a92b2a8b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:17.539025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640d5fb-f475-47cc-a0f4-b088a92b2a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:17.539295 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640d5fb-f475-47cc-a0f4-b088a92b2a8b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:17.539986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640d5fb-f475-47cc-a0f4-b088a92b2a8b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:17.541600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640d5fb-f475-47cc-a0f4-b088a92b2a8b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-9640d5fb-f475-47cc-a0f4-b088a92b2a8b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:17.555670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:17.556759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:17.556759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:17.556759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:17.556759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:17.556759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:17.556759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:17.556759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:06:17.556759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:06:17.556759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:06:17.556759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:06:17.556759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:17.556759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:17.556759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:17.556759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:17.556759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:17.556759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:17.557608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:17.557608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:17.557608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:17.557608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:17.557608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:17.557608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:17.557608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:17.557608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:17.557608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:17.557608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:17.557608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:06:17.557608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:17.557608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 16:06:17.557608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:17.557608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 495/1002] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Jul 25 16:06:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:17.563398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640d5fb-f475-47cc-a0f4-b088a92b2a8b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:17.567117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:17.631941 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:17.642874 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43908b28-dd9b-49c3-a80a-346f15133af2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:17.669802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640d5fb-f475-47cc-a0f4-b088a92b2a8b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:17.682478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bece1-c489-4ba8-bce3-7333f08cc49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:17.683160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bece1-c489-4ba8-bce3-7333f08cc49b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:17.683565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bece1-c489-4ba8-bce3-7333f08cc49b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:17.683843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bece1-c489-4ba8-bce3-7333f08cc49b None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:17.684726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bece1-c489-4ba8-bce3-7333f08cc49b None admin] RBAC: Adding query filter params (name=image) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:17.685206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bece1-c489-4ba8-bce3-7333f08cc49b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:17.686798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bece1-c489-4ba8-bce3-7333f08cc49b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:17.697523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 508/1003] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:17.698683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bece1-c489-4ba8-bce3-7333f08cc49b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:17.712605 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493f219-f2a9-4b64-8f2e-a8805e651d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:17.713278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493f219-f2a9-4b64-8f2e-a8805e651d37 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:17.713563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493f219-f2a9-4b64-8f2e-a8805e651d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:17.713839 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493f219-f2a9-4b64-8f2e-a8805e651d37 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:17.714541 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493f219-f2a9-4b64-8f2e-a8805e651d37 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:17.714868 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493f219-f2a9-4b64-8f2e-a8805e651d37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:17.716211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493f219-f2a9-4b64-8f2e-a8805e651d37 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:17.726216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 496/1004] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 25 16:06:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:17.727067 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493f219-f2a9-4b64-8f2e-a8805e651d37 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:17.795555 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:17.800727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bece1-c489-4ba8-bce3-7333f08cc49b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:17.831392 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493f219-f2a9-4b64-8f2e-a8805e651d37 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:17.835226 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a7629-7eb9-4ccc-a998-c28c54b120f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:17.835894 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a7629-7eb9-4ccc-a998-c28c54b120f6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:17.836175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a7629-7eb9-4ccc-a998-c28c54b120f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:17.836475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a7629-7eb9-4ccc-a998-c28c54b120f6 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:17.837174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a7629-7eb9-4ccc-a998-c28c54b120f6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:17.837481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a7629-7eb9-4ccc-a998-c28c54b120f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:17.838843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a7629-7eb9-4ccc-a998-c28c54b120f6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:17.852423 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 509/1005] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:17.878690 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71895d7e-a192-4ddc-8c3c-1c199b963e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:17.879496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71895d7e-a192-4ddc-8c3c-1c199b963e49 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:17.879847 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71895d7e-a192-4ddc-8c3c-1c199b963e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:17.880198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71895d7e-a192-4ddc-8c3c-1c199b963e49 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:17.881026 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71895d7e-a192-4ddc-8c3c-1c199b963e49 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:17.881425 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71895d7e-a192-4ddc-8c3c-1c199b963e49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:17.882942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71895d7e-a192-4ddc-8c3c-1c199b963e49 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:17.894154 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 497/1006] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Jul 25 16:06:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:17.895258 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a7629-7eb9-4ccc-a998-c28c54b120f6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:17.920892 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:18.015952 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a7629-7eb9-4ccc-a998-c28c54b120f6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:18.053522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b928c3c-5229-4fb3-9cc2-3245b3b94c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:18.054102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b928c3c-5229-4fb3-9cc2-3245b3b94c0b None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:18.054384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b928c3c-5229-4fb3-9cc2-3245b3b94c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:18.054686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b928c3c-5229-4fb3-9cc2-3245b3b94c0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:18.055419 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b928c3c-5229-4fb3-9cc2-3245b3b94c0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:18.056817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b928c3c-5229-4fb3-9cc2-3245b3b94c0b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:18.080291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 510/1007] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:06:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:06:18.946434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f8785-276e-47d5-b494-d8b7266d700c None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:18.947010 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f8785-276e-47d5-b494-d8b7266d700c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:18.947010 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f8785-276e-47d5-b494-d8b7266d700c None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:18.948534 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 498/1008] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:18.954382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b53f76-6d81-48d4-b938-be64e7dcb1f3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:18.955055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b53f76-6d81-48d4-b938-be64e7dcb1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:18.955055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b53f76-6d81-48d4-b938-be64e7dcb1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:18.974630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-22b53f76-6d81-48d4-b938-be64e7dcb1f3 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:18.975819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-22b53f76-6d81-48d4-b938-be64e7dcb1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:19.050942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 511/1009] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:18 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:19.073597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f8785-276e-47d5-b494-d8b7266d700c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:19.184381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f8785-276e-47d5-b494-d8b7266d700c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:19.217515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:19.231965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076d773-47b9-45e9-9eeb-3801c48426a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:19.232890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076d773-47b9-45e9-9eeb-3801c48426a7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:19.233197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076d773-47b9-45e9-9eeb-3801c48426a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:19.233481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076d773-47b9-45e9-9eeb-3801c48426a7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:19.234126 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076d773-47b9-45e9-9eeb-3801c48426a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:19.236694 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076d773-47b9-45e9-9eeb-3801c48426a7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-e076d773-47b9-45e9-9eeb-3801c48426a7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:19.255705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:19.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:19.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:19.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:19.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:19.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:19.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:19.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:06:19.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:06:19.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:06:19.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:06:19.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:19.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:19.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:19.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:19.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:19.256832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:19.257657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:19.257657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:19.257657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:19.257657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:19.257657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:19.257657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:19.257657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:19.257657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:19.257657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:19.257657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:19.257657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:06:19.257657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:19.257657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 16:06:19.257657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:19.257657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 499/1010] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:06:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:19.264327 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b53f76-6d81-48d4-b938-be64e7dcb1f3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:19.274036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:19.383216 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b53f76-6d81-48d4-b938-be64e7dcb1f3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:19.419264 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329343b1-3e24-4320-9f28-bdba50131417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:19.419908 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329343b1-3e24-4320-9f28-bdba50131417 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:19.420192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329343b1-3e24-4320-9f28-bdba50131417 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:19.420505 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329343b1-3e24-4320-9f28-bdba50131417 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:19.421216 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329343b1-3e24-4320-9f28-bdba50131417 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:19.421526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329343b1-3e24-4320-9f28-bdba50131417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:19.423444 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329343b1-3e24-4320-9f28-bdba50131417 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:19.433730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 512/1011] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 25 16:06:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:19.435008 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076d773-47b9-45e9-9eeb-3801c48426a7 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:19.540420 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076d773-47b9-45e9-9eeb-3801c48426a7 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:19.575810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43699e41-56d5-4cbd-b3c9-f145617e5a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:19.576555 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43699e41-56d5-4cbd-b3c9-f145617e5a71 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:19.576857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43699e41-56d5-4cbd-b3c9-f145617e5a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:19.577142 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43699e41-56d5-4cbd-b3c9-f145617e5a71 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:19.577943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43699e41-56d5-4cbd-b3c9-f145617e5a71 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:19.578367 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43699e41-56d5-4cbd-b3c9-f145617e5a71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:19.579845 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43699e41-56d5-4cbd-b3c9-f145617e5a71 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:19.585044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 500/1012] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Jul 25 16:06:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:19.590959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329343b1-3e24-4320-9f28-bdba50131417 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:19.666434 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:19.700041 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329343b1-3e24-4320-9f28-bdba50131417 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:19.735256 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae7dc0-80d4-4c4e-95cf-e507e61bf515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:19.735960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae7dc0-80d4-4c4e-95cf-e507e61bf515 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:19.736212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae7dc0-80d4-4c4e-95cf-e507e61bf515 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:19.736518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae7dc0-80d4-4c4e-95cf-e507e61bf515 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:19.737263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae7dc0-80d4-4c4e-95cf-e507e61bf515 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:19.738627 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae7dc0-80d4-4c4e-95cf-e507e61bf515 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:19.760802 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 513/1013] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:06:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:06:19.873485 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b41d1-3ebc-40f1-8fa6-8b19c9932e7a None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:19.873786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b41d1-3ebc-40f1-8fa6-8b19c9932e7a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:19.873975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b41d1-3ebc-40f1-8fa6-8b19c9932e7a None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:19.875910 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 501/1014] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:19.881665 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07bb10-0249-4e0b-9d39-5800e774dc8e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:19.881947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07bb10-0249-4e0b-9d39-5800e774dc8e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:19.882225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07bb10-0249-4e0b-9d39-5800e774dc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:19.902068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-da07bb10-0249-4e0b-9d39-5800e774dc8e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:19.903268 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-da07bb10-0249-4e0b-9d39-5800e774dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:19.985739 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 514/1015] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:19 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:20.008881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b41d1-3ebc-40f1-8fa6-8b19c9932e7a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:20.075167 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:20.128957 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b41d1-3ebc-40f1-8fa6-8b19c9932e7a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:20.160133 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ae5be-8863-434f-b51e-b4c06a660c74 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:20.160485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ae5be-8863-434f-b51e-b4c06a660c74 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:20.160738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ae5be-8863-434f-b51e-b4c06a660c74 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:20.162965 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 515/1016] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:06:20.166138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24164ca7-e28d-43be-a7d0-12adaff191cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:20.166898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164ca7-e28d-43be-a7d0-12adaff191cb None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:20.167184 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164ca7-e28d-43be-a7d0-12adaff191cb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:20.167455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24164ca7-e28d-43be-a7d0-12adaff191cb None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:20.167911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2b21-5c1b-445f-90ac-58a5d11f651e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:20.168172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24164ca7-e28d-43be-a7d0-12adaff191cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:20.168299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2b21-5c1b-445f-90ac-58a5d11f651e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:20.168500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2b21-5c1b-445f-90ac-58a5d11f651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:20.169553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24164ca7-e28d-43be-a7d0-12adaff191cb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:20.189375 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-33ff2b21-5c1b-445f-90ac-58a5d11f651e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:20.191130 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-33ff2b21-5c1b-445f-90ac-58a5d11f651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:20.191457 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 502/1017] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 25 16:06:20 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:06:20.254975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:20.286746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 516/1018] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:06:20.310220 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24164ca7-e28d-43be-a7d0-12adaff191cb None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:20.421555 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24164ca7-e28d-43be-a7d0-12adaff191cb None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:20.442765 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:20.458897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6abbe1-520a-4bf8-abb7-2b37b240c301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:20.459694 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6abbe1-520a-4bf8-abb7-2b37b240c301 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:20.459970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6abbe1-520a-4bf8-abb7-2b37b240c301 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:20.460240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6abbe1-520a-4bf8-abb7-2b37b240c301 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:20.461420 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6abbe1-520a-4bf8-abb7-2b37b240c301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:20.462848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6abbe1-520a-4bf8-abb7-2b37b240c301 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:20.464646 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 503/1019] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:20.470850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2b21-5c1b-445f-90ac-58a5d11f651e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:20.582119 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2b21-5c1b-445f-90ac-58a5d11f651e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:20.621452 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbe924-02d9-49b5-b7e6-0934c19b4e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:20.622135 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbe924-02d9-49b5-b7e6-0934c19b4e3f None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:20.622424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbe924-02d9-49b5-b7e6-0934c19b4e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:20.622703 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbe924-02d9-49b5-b7e6-0934c19b4e3f None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:20.623435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbe924-02d9-49b5-b7e6-0934c19b4e3f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:20.624944 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbe924-02d9-49b5-b7e6-0934c19b4e3f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:20.662883 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 517/1020] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 25 16:06:20 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:06:21.906343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b06cc-5100-4321-8075-fe8172d0e931 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:21.907442 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b06cc-5100-4321-8075-fe8172d0e931 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:21.907742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b06cc-5100-4321-8075-fe8172d0e931 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:21.909544 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 504/1021] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:21.915166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736415e5-acd0-4a6f-969b-e002ebf5970b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:21.915616 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736415e5-acd0-4a6f-969b-e002ebf5970b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:21.915795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736415e5-acd0-4a6f-969b-e002ebf5970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:21.933923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-736415e5-acd0-4a6f-969b-e002ebf5970b None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:21.935097 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-736415e5-acd0-4a6f-969b-e002ebf5970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:21.960720 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:22.006917 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 518/1022] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:22.030180 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b06cc-5100-4321-8075-fe8172d0e931 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:22.137871 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b06cc-5100-4321-8075-fe8172d0e931 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:22.172587 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77792c-94ad-4680-acc6-5cf6361010eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:22.173314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77792c-94ad-4680-acc6-5cf6361010eb None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:22.173589 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77792c-94ad-4680-acc6-5cf6361010eb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:22.173856 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77792c-94ad-4680-acc6-5cf6361010eb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:22.183958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77792c-94ad-4680-acc6-5cf6361010eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:06:22.192733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-dd77792c-94ad-4680-acc6-5cf6361010eb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 16:06:22.192733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:22.192733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:22.192733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:22.192733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:22.192733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:22.192733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:22.192733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:22.192733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:22.192733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:22.192733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:22.192733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:22.192733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:06:22.192733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:06:22.192733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:06:22.192733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:06:22.193637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:06:22.193637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:06:22.193637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:06:22.193637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:06:22.193637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:22.193637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:22.193637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:22.193637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:22.193637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:22.193637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:22.193637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:22.193637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:22.193637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:22.193637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:22.193637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:22.193637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:22.194496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:22.194496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:22.194496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:22.194496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:22.194496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:06:22.194496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:06:22.194496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:06:22.194496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:06:22.194496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:06:22.194496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:06:22.194496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 16:06:22.194496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:22.196609 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 505/1023] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jul 25 16:06:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:22.199888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736415e5-acd0-4a6f-969b-e002ebf5970b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:22.253820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd4a49-8eb6-44a8-bbb7-6deefc4cde66 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:22.254156 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd4a49-8eb6-44a8-bbb7-6deefc4cde66 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:22.254387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd4a49-8eb6-44a8-bbb7-6deefc4cde66 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:22.255896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 506/1024] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:06:22.261064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06481e7c-48d3-46e0-947b-01b00d4aa73d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:22.261519 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06481e7c-48d3-46e0-947b-01b00d4aa73d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:22.261878 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06481e7c-48d3-46e0-947b-01b00d4aa73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:22.282530 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-06481e7c-48d3-46e0-947b-01b00d4aa73d None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:22.284905 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-06481e7c-48d3-46e0-947b-01b00d4aa73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:22.316902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736415e5-acd0-4a6f-969b-e002ebf5970b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:22.333674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:22.354170 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00820cfe-862c-474a-8529-1e0d3f77db8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:22.354845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00820cfe-862c-474a-8529-1e0d3f77db8b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:22.355116 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00820cfe-862c-474a-8529-1e0d3f77db8b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:22.355393 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00820cfe-862c-474a-8529-1e0d3f77db8b None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:22.356131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00820cfe-862c-474a-8529-1e0d3f77db8b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:22.356475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00820cfe-862c-474a-8529-1e0d3f77db8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:22.357836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00820cfe-862c-474a-8529-1e0d3f77db8b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:22.368295 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 507/1025] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:22.368507 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 519/1026] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jul 25 16:06:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:22.372518 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06481e7c-48d3-46e0-947b-01b00d4aa73d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:22.383371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00820cfe-862c-474a-8529-1e0d3f77db8b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:22.413118 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:22.480796 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06481e7c-48d3-46e0-947b-01b00d4aa73d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:22.496473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00820cfe-862c-474a-8529-1e0d3f77db8b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:22.518516 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a2726-d70a-4e47-a435-19ac0f8e1013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:22.519433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a2726-d70a-4e47-a435-19ac0f8e1013 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:22.519716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a2726-d70a-4e47-a435-19ac0f8e1013 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:22.520104 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a2726-d70a-4e47-a435-19ac0f8e1013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:22.531182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a2726-d70a-4e47-a435-19ac0f8e1013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:22.531484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e304004-9fd9-4a73-a68c-66b6aade77c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:22.532302 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e304004-9fd9-4a73-a68c-66b6aade77c4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:22.532584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e304004-9fd9-4a73-a68c-66b6aade77c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:22.532683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a2726-d70a-4e47-a435-19ac0f8e1013 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:22.536744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e304004-9fd9-4a73-a68c-66b6aade77c4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:22.536744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e304004-9fd9-4a73-a68c-66b6aade77c4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:22.536744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e304004-9fd9-4a73-a68c-66b6aade77c4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-7e304004-9fd9-4a73-a68c-66b6aade77c4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:22.549027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:22.550023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:22.550023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:22.550023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:22.550023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:22.550023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:22.550023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:22.550023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:06:22.550023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:06:22.550023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:06:22.550023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:06:22.550023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:22.550023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:22.550023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:22.550023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:22.550023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:22.550023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:22.551492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:22.551492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:22.551492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:22.551492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:22.551492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:22.551492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:22.551492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:22.551492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:22.551492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:22.551492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:22.551492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:06:22.551492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:22.551492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 16:06:22.551492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:22.551492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 520/1027] 10.222.0.70 () {56 vars in 1105 bytes} [Mon Jul 25 16:06:22 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:22.556211 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e304004-9fd9-4a73-a68c-66b6aade77c4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:22.557046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-de0a2726-d70a-4e47-a435-19ac0f8e1013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:22.557046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:22.557046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:22.557046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:22.557046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:22.557046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:22.557046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:22.557046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:22.557046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:22.557046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:22.557046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:22.557046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:22.557046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:06:22.557046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:06:22.557046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:22.557866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:22.563626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:06:22.563626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:06:22.563626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:22.563626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:22.563626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 508/1028] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:22.563905 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a2726-d70a-4e47-a435-19ac0f8e1013 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:22.596131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:22.654136 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:22.673595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a2726-d70a-4e47-a435-19ac0f8e1013 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:22.673789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e304004-9fd9-4a73-a68c-66b6aade77c4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:22.708288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6390b0d-2819-4237-92e0-0707a974d57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:22.709364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6390b0d-2819-4237-92e0-0707a974d57f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:22.709645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6390b0d-2819-4237-92e0-0707a974d57f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:22.709915 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6390b0d-2819-4237-92e0-0707a974d57f None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:22.710612 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6390b0d-2819-4237-92e0-0707a974d57f None admin] RBAC: Adding query filter params (name=image) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:22.710914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6390b0d-2819-4237-92e0-0707a974d57f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:22.711455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99f4a8-4c8c-49ab-b5d1-b69d0e3b2ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:22.712121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99f4a8-4c8c-49ab-b5d1-b69d0e3b2ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:22.712331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6390b0d-2819-4237-92e0-0707a974d57f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:22.712428 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99f4a8-4c8c-49ab-b5d1-b69d0e3b2ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:22.712698 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99f4a8-4c8c-49ab-b5d1-b69d0e3b2ee0 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:22.713473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99f4a8-4c8c-49ab-b5d1-b69d0e3b2ee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:22.713779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99f4a8-4c8c-49ab-b5d1-b69d0e3b2ee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:22.715134 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99f4a8-4c8c-49ab-b5d1-b69d0e3b2ee0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:22.717477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 521/1029] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:22.723421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6390b0d-2819-4237-92e0-0707a974d57f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:22.733349 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 509/1030] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:22.739127 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99f4a8-4c8c-49ab-b5d1-b69d0e3b2ee0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:22.827979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6390b0d-2819-4237-92e0-0707a974d57f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:22.831178 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:22.841328 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99f4a8-4c8c-49ab-b5d1-b69d0e3b2ee0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:22.862435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4d9c5-6fc6-4eec-ae5b-066468996349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:22.863171 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4d9c5-6fc6-4eec-ae5b-066468996349 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:22.863463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4d9c5-6fc6-4eec-ae5b-066468996349 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:22.863740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4d9c5-6fc6-4eec-ae5b-066468996349 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:22.864491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4d9c5-6fc6-4eec-ae5b-066468996349 None admin] RBAC: Adding query filter params (type=image) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:22.864804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4d9c5-6fc6-4eec-ae5b-066468996349 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:22.866175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4d9c5-6fc6-4eec-ae5b-066468996349 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:22.872418 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 522/1031] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:22.873718 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14b8df-0b14-4852-ad6a-6bc636d28278 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:22.874009 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14b8df-0b14-4852-ad6a-6bc636d28278 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:22.874288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14b8df-0b14-4852-ad6a-6bc636d28278 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:22.876067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 523/1032] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:22.878918 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14b8df-0b14-4852-ad6a-6bc636d28278 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:22.882607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136c3a1-b67d-4d20-83d2-99255c06505f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:22.883421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136c3a1-b67d-4d20-83d2-99255c06505f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:22.883696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136c3a1-b67d-4d20-83d2-99255c06505f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:22.883968 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136c3a1-b67d-4d20-83d2-99255c06505f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:22.892768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136c3a1-b67d-4d20-83d2-99255c06505f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:22.894227 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136c3a1-b67d-4d20-83d2-99255c06505f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:22.895687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:22.910109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-9136c3a1-b67d-4d20-83d2-99255c06505f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:06:22.910109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:22.910109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:22.910109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:22.910109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:22.910109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:22.910109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:22.910109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:22.910109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:22.910109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:22.910109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:22.910109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:22.910109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:06:22.910109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:06:22.910109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:06:22.910109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:22.911620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:22.913331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:22.913331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:22.913331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:06:22.913331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:06:22.913331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:06:22.913331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:06:22.913331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:06:22.913331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:06:22.913331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:06:22.913331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:22.913331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 510/1033] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 25 16:06:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:22.913331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780ad9d-d107-4bff-b021-46f6f372817b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:22.913331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780ad9d-d107-4bff-b021-46f6f372817b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:22.914053 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780ad9d-d107-4bff-b021-46f6f372817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:22.934218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-9780ad9d-d107-4bff-b021-46f6f372817b None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:22.935448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9780ad9d-d107-4bff-b021-46f6f372817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:23.000044 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14b8df-0b14-4852-ad6a-6bc636d28278 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:23.005231 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 511/1034] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:23.006077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780ad9d-d107-4bff-b021-46f6f372817b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:23.047779 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce880e08-b2c7-4564-9b8a-e9a0805edf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:23.048493 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce880e08-b2c7-4564-9b8a-e9a0805edf4b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:23.048773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce880e08-b2c7-4564-9b8a-e9a0805edf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:23.049044 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce880e08-b2c7-4564-9b8a-e9a0805edf4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:23.049827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce880e08-b2c7-4564-9b8a-e9a0805edf4b None admin] RBAC: Adding query filter params (interface=public, service_id=144a14d1083a4524ac74c6debe5eee46, region_id=RegionOne) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:23.050133 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce880e08-b2c7-4564-9b8a-e9a0805edf4b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:23.051482 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce880e08-b2c7-4564-9b8a-e9a0805edf4b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:23.056552 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 524/1035] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jul 25 16:06:22 2022] GET /identity/v3/endpoints?service_id=144a14d1083a4524ac74c6debe5eee46&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:23.057351 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce880e08-b2c7-4564-9b8a-e9a0805edf4b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:23.093601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:23.114666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780ad9d-d107-4bff-b021-46f6f372817b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:23.138554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:23.150255 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e79bc-15b1-4286-8335-94a155efae5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:23.150952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e79bc-15b1-4286-8335-94a155efae5f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:23.151231 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e79bc-15b1-4286-8335-94a155efae5f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:23.151504 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e79bc-15b1-4286-8335-94a155efae5f None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:23.152629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e79bc-15b1-4286-8335-94a155efae5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:23.152939 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e79bc-15b1-4286-8335-94a155efae5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:23.154368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e79bc-15b1-4286-8335-94a155efae5f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:23.161925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce880e08-b2c7-4564-9b8a-e9a0805edf4b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:23.173561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 512/1036] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 25 16:06:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:23.174465 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e79bc-15b1-4286-8335-94a155efae5f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:23.196415 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306589ef-5014-4f35-9841-6a17acfc2a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:23.197243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306589ef-5014-4f35-9841-6a17acfc2a52 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:23.197524 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306589ef-5014-4f35-9841-6a17acfc2a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:23.197799 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306589ef-5014-4f35-9841-6a17acfc2a52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:23.199359 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306589ef-5014-4f35-9841-6a17acfc2a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:23.200817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306589ef-5014-4f35-9841-6a17acfc2a52 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:23.202425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 525/1037] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:23.203717 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306589ef-5014-4f35-9841-6a17acfc2a52 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:23.294025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e79bc-15b1-4286-8335-94a155efae5f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:23.306067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306589ef-5014-4f35-9841-6a17acfc2a52 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:23.329099 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c525ee-7911-4512-8b91-975bafd41c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:23.329788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c525ee-7911-4512-8b91-975bafd41c7c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:23.330066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c525ee-7911-4512-8b91-975bafd41c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:23.330393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c525ee-7911-4512-8b91-975bafd41c7c None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:23.331078 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c525ee-7911-4512-8b91-975bafd41c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:23.332523 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c525ee-7911-4512-8b91-975bafd41c7c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:23.338925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 513/1038] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 25 16:06:23 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:06:23.339762 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c525ee-7911-4512-8b91-975bafd41c7c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:23.340314 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086db18-3050-46da-af70-52efb672d1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:23.340970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086db18-3050-46da-af70-52efb672d1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:23.341260 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086db18-3050-46da-af70-52efb672d1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:23.341586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086db18-3050-46da-af70-52efb672d1c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:23.354836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:23.360798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:23.429246 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086db18-3050-46da-af70-52efb672d1c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:23.431231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086db18-3050-46da-af70-52efb672d1c9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:23.472584 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c525ee-7911-4512-8b91-975bafd41c7c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:23.520894 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766213a-4471-48ba-83dc-09e8e53484ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:23.521578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766213a-4471-48ba-83dc-09e8e53484ef None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:23.521863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766213a-4471-48ba-83dc-09e8e53484ef None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:23.522137 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766213a-4471-48ba-83dc-09e8e53484ef None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:23.522852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766213a-4471-48ba-83dc-09e8e53484ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:23.524368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766213a-4471-48ba-83dc-09e8e53484ef None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:23.550306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 514/1039] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:06:23 2022] POST /identity/v3/users => generated 285 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:06:23.569737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 526/1040] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:06:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:06:23.575686 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766213a-4471-48ba-83dc-09e8e53484ef None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:23.646970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:23.699470 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766213a-4471-48ba-83dc-09e8e53484ef None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:23.737161 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c835b-6354-4e80-9f64-eddc0c096c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:23.737971 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c835b-6354-4e80-9f64-eddc0c096c4e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:23.738253 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c835b-6354-4e80-9f64-eddc0c096c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:23.738535 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c835b-6354-4e80-9f64-eddc0c096c4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:23.751004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c835b-6354-4e80-9f64-eddc0c096c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:23.752550 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c835b-6354-4e80-9f64-eddc0c096c4e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:23.771133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-6b6c835b-6354-4e80-9f64-eddc0c096c4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:23.771133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:23.771133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:23.771133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:23.771133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:23.771133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:23.771133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:23.771133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:23.771133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:23.771133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:23.771133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:23.771133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:23.771133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:06:23.771133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:06:23.771133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:23.772065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:23.772981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:06:23.772981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:06:23.772981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:23.772981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:23.772981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 515/1041] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:23.779324 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086db18-3050-46da-af70-52efb672d1c9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:23.833381 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:23.890036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086db18-3050-46da-af70-52efb672d1c9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:23.928118 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62b1fc-a85b-4b45-bfb0-7e80f126d958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:23.928822 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62b1fc-a85b-4b45-bfb0-7e80f126d958 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:23.929109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62b1fc-a85b-4b45-bfb0-7e80f126d958 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:23.929382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62b1fc-a85b-4b45-bfb0-7e80f126d958 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:23.930109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62b1fc-a85b-4b45-bfb0-7e80f126d958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:23.930423 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62b1fc-a85b-4b45-bfb0-7e80f126d958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:23.931788 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62b1fc-a85b-4b45-bfb0-7e80f126d958 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:23.948923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 527/1042] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:23.955336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c835b-6354-4e80-9f64-eddc0c096c4e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:24.067363 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c835b-6354-4e80-9f64-eddc0c096c4e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:24.078930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:24.108789 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41a3b6-9573-43d4-acb4-4ecc38d6b530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:24.110065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41a3b6-9573-43d4-acb4-4ecc38d6b530 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:24.110350 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41a3b6-9573-43d4-acb4-4ecc38d6b530 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:24.110627 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41a3b6-9573-43d4-acb4-4ecc38d6b530 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:24.118804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41a3b6-9573-43d4-acb4-4ecc38d6b530 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:24.120316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41a3b6-9573-43d4-acb4-4ecc38d6b530 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:24.136632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-6c41a3b6-9573-43d4-acb4-4ecc38d6b530 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:06:24.136632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:24.136632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:24.136632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:24.136632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:24.136632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:24.136632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:24.136632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:24.136632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:24.136632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:24.136632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:24.136632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:24.136632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:06:24.136632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:06:24.136632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:24.137615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:24.138474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:06:24.138474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:06:24.138474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:06:24.138474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:06:24.138474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:06:24.138474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:06:24.138474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:06:24.138474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:24.141082 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 516/1043] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:06:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:24.144606 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62b1fc-a85b-4b45-bfb0-7e80f126d958 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:24.265139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62b1fc-a85b-4b45-bfb0-7e80f126d958 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:24.274600 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:24.305196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840cc09-2137-42f2-b34b-5abe7b384b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:24.305871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840cc09-2137-42f2-b34b-5abe7b384b3b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:24.306150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840cc09-2137-42f2-b34b-5abe7b384b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:24.306475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840cc09-2137-42f2-b34b-5abe7b384b3b None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:24.307199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840cc09-2137-42f2-b34b-5abe7b384b3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:24.307509 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840cc09-2137-42f2-b34b-5abe7b384b3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:24.308954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840cc09-2137-42f2-b34b-5abe7b384b3b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:24.321454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 528/1044] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:06:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:24.327412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41a3b6-9573-43d4-acb4-4ecc38d6b530 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:24.436943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41a3b6-9573-43d4-acb4-4ecc38d6b530 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:24.471359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7b0c1-3163-4d10-8f59-1e336e0eb61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:24.472028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7b0c1-3163-4d10-8f59-1e336e0eb61f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:24.472339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7b0c1-3163-4d10-8f59-1e336e0eb61f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:24.472618 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7b0c1-3163-4d10-8f59-1e336e0eb61f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:24.473438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7b0c1-3163-4d10-8f59-1e336e0eb61f None admin] RBAC: Adding query filter params (role.id=a040806445b64d57b153293502c52634, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=c455f8d340444b068249213ff504895e) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:24.473752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7b0c1-3163-4d10-8f59-1e336e0eb61f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:24.475189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7b0c1-3163-4d10-8f59-1e336e0eb61f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:24.480747 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 517/1045] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:06:24 2022] GET /identity/v3/role_assignments?user.id=c455f8d340444b068249213ff504895e&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=a040806445b64d57b153293502c52634 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:25.542346 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb37a90-2ca7-487d-8e82-777d0567ea1e None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:25.542839 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb37a90-2ca7-487d-8e82-777d0567ea1e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:25.542839 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb37a90-2ca7-487d-8e82-777d0567ea1e None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:25.544241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 529/1046] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:25.550086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c5b53-8a83-49a3-bd1c-1e5c6b490357 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:25.550700 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c5b53-8a83-49a3-bd1c-1e5c6b490357 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:25.550777 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c5b53-8a83-49a3-bd1c-1e5c6b490357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:25.569895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-018c5b53-8a83-49a3-bd1c-1e5c6b490357 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:25.571085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-018c5b53-8a83-49a3-bd1c-1e5c6b490357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:25.598395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:25.643306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 518/1047] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:25.652338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04681311-80bb-40e0-b21a-ce1a0da06f0f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:25.652635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04681311-80bb-40e0-b21a-ce1a0da06f0f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:25.652912 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04681311-80bb-40e0-b21a-ce1a0da06f0f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:25.654429 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 530/1048] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:25.659455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9293da-6e36-425d-9b6b-2b593605d039 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:25.659743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9293da-6e36-425d-9b6b-2b593605d039 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:25.660020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9293da-6e36-425d-9b6b-2b593605d039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:25.665661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04681311-80bb-40e0-b21a-ce1a0da06f0f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:25.678785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8c9293da-6e36-425d-9b6b-2b593605d039 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:25.679970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8c9293da-6e36-425d-9b6b-2b593605d039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:25.751587 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 519/1049] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:25.774304 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9293da-6e36-425d-9b6b-2b593605d039 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:25.779717 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04681311-80bb-40e0-b21a-ce1a0da06f0f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:25.821476 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b62aaf-27b0-495f-b242-b560120798ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:25.822237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b62aaf-27b0-495f-b242-b560120798ca None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:25.822531 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b62aaf-27b0-495f-b242-b560120798ca None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:25.822823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b62aaf-27b0-495f-b242-b560120798ca None admin] PATH_INFO: `/v3/services/image` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:25.823532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b62aaf-27b0-495f-b242-b560120798ca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:25.825019 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b62aaf-27b0-495f-b242-b560120798ca None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d7b62aaf-27b0-495f-b242-b560120798ca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:25.838341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:25.839301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:25.839301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:25.839301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:25.839301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:25.839301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:25.839301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:25.839301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:06:25.839301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:06:25.839301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:06:25.839301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:06:25.839301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:25.839301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:25.839301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:25.839301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:25.839301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:25.839301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:25.840115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:25.840115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:25.840115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:25.840115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:25.840115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:25.840115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:25.840115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:25.840115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:25.840115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:25.840115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:25.840115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:06:25.840115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:06:25.840115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 16:06:25.840115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:25.840881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 531/1050] 10.222.0.70 () {56 vars in 1105 bytes} [Mon Jul 25 16:06:25 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:25.846323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b62aaf-27b0-495f-b242-b560120798ca None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:25.876722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:25.879936 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:25.884629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9293da-6e36-425d-9b6b-2b593605d039 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:25.922960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852038a-006b-4109-b743-966dafe2fb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:25.923766 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852038a-006b-4109-b743-966dafe2fb48 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:25.924049 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852038a-006b-4109-b743-966dafe2fb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:25.924348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852038a-006b-4109-b743-966dafe2fb48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:25.936617 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852038a-006b-4109-b743-966dafe2fb48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:06:25.947306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-8852038a-006b-4109-b743-966dafe2fb48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:06:25.947306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:25.947306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:25.947306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:25.947306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:25.947306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:25.947306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:25.947306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:25.947306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:25.947306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:25.947306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:25.947306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:25.947306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:06:25.947306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:06:25.947306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:06:25.947306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:06:25.948410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:06:25.948410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:06:25.948410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:06:25.948410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:06:25.948410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:25.948410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:25.948410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:25.948410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:25.948410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:25.948410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:25.948410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:25.948410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:25.948410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:25.948410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:25.948410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:25.948410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:25.949371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:25.949371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:25.949371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:25.949371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:25.949371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:06:25.949371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:06:25.949371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:06:25.949371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:06:25.949371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:06:25.949371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:06:25.949371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:06:25.949371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:25.950899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 520/1051] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:06:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:25.955395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852038a-006b-4109-b743-966dafe2fb48 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:25.960579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b62aaf-27b0-495f-b242-b560120798ca None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:25.997595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021499c-910c-4802-9e49-fd01a885adab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:25.998269 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021499c-910c-4802-9e49-fd01a885adab None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:25.998554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021499c-910c-4802-9e49-fd01a885adab None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:25.998830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021499c-910c-4802-9e49-fd01a885adab None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:25.999536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021499c-910c-4802-9e49-fd01a885adab None admin] RBAC: Adding query filter params (name=image) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:25.999536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021499c-910c-4802-9e49-fd01a885adab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:26.001726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021499c-910c-4802-9e49-fd01a885adab None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:26.011783 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 532/1052] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:26.012681 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021499c-910c-4802-9e49-fd01a885adab None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:26.068812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852038a-006b-4109-b743-966dafe2fb48 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:26.104863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731f61c-ed6f-4621-bc14-73990648c38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:26.105490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f61c-ed6f-4621-bc14-73990648c38b None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:26.105778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f61c-ed6f-4621-bc14-73990648c38b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:26.106045 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f61c-ed6f-4621-bc14-73990648c38b None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:26.106792 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731f61c-ed6f-4621-bc14-73990648c38b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:26.107272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731f61c-ed6f-4621-bc14-73990648c38b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:26.108514 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731f61c-ed6f-4621-bc14-73990648c38b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:26.118656 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 521/1053] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:06:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:26.124095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731f61c-ed6f-4621-bc14-73990648c38b None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:26.128760 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:26.137689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021499c-910c-4802-9e49-fd01a885adab None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:26.145525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:26.178374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aea98-916d-4f96-aece-562b6f0e237a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:26.179075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aea98-916d-4f96-aece-562b6f0e237a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:26.179357 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aea98-916d-4f96-aece-562b6f0e237a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:26.179631 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3aea98-916d-4f96-aece-562b6f0e237a None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:26.180362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3aea98-916d-4f96-aece-562b6f0e237a None admin] RBAC: Adding query filter params (type=image) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:26.180671 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3aea98-916d-4f96-aece-562b6f0e237a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:26.182030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3aea98-916d-4f96-aece-562b6f0e237a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:26.187187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 533/1054] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:26.193053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aea98-916d-4f96-aece-562b6f0e237a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:26.240363 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731f61c-ed6f-4621-bc14-73990648c38b None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:26.275841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed51dc-05dc-47d7-9204-2c57e2ce7488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:26.277015 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed51dc-05dc-47d7-9204-2c57e2ce7488 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:26.277423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed51dc-05dc-47d7-9204-2c57e2ce7488 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:26.277700 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed51dc-05dc-47d7-9204-2c57e2ce7488 None admin] PATH_INFO: `/v3/users/28ece41c0c824be9930dbb9cdf2f52c3` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:26.292695 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed51dc-05dc-47d7-9204-2c57e2ce7488 None admin] RBAC: Authorizing `identity:get_user(user_id=28ece41c0c824be9930dbb9cdf2f52c3)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:26.294387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed51dc-05dc-47d7-9204-2c57e2ce7488 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:26.296980 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 522/1055] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:06:26 2022] GET /identity/v3/users/28ece41c0c824be9930dbb9cdf2f52c3 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:26.302304 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed51dc-05dc-47d7-9204-2c57e2ce7488 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:26.308413 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3aea98-916d-4f96-aece-562b6f0e237a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:26.343954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35e285-f756-4a3d-878b-6afb6d79a5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:26.344650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35e285-f756-4a3d-878b-6afb6d79a5c4 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:26.344940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35e285-f756-4a3d-878b-6afb6d79a5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:26.345219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35e285-f756-4a3d-878b-6afb6d79a5c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:26.345959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35e285-f756-4a3d-878b-6afb6d79a5c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:26.347322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35e285-f756-4a3d-878b-6afb6d79a5c4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:26.369753 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 534/1056] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:06:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:06:26.396878 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:26.431573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed51dc-05dc-47d7-9204-2c57e2ce7488 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:26.482995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f1e2e-c32d-4b31-9901-e78de2499832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:26.483674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1e2e-c32d-4b31-9901-e78de2499832 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:26.483987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1e2e-c32d-4b31-9901-e78de2499832 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:26.484840 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1e2e-c32d-4b31-9901-e78de2499832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:26.528833 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cacffc-f564-461c-96be-21e41c8b6dc1 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:26.529187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cacffc-f564-461c-96be-21e41c8b6dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:26.529406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cacffc-f564-461c-96be-21e41c8b6dc1 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:26.531567 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 535/1057] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:06:26.537014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ea44c-37e5-4aea-a4dd-eaae1907c8ee None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:26.537306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ea44c-37e5-4aea-a4dd-eaae1907c8ee None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:26.537736 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ea44c-37e5-4aea-a4dd-eaae1907c8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:26.558589 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-400ea44c-37e5-4aea-a4dd-eaae1907c8ee None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:26.559875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-400ea44c-37e5-4aea-a4dd-eaae1907c8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:26.571130 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:26.581551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f1e2e-c32d-4b31-9901-e78de2499832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:26.583110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f1e2e-c32d-4b31-9901-e78de2499832 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:26.641332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 536/1058] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:06:26.662191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:26.664854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ea44c-37e5-4aea-a4dd-eaae1907c8ee None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:26.697154 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 523/1059] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:06:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 16:06:26.702937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f1e2e-c32d-4b31-9901-e78de2499832 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:26.775848 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ea44c-37e5-4aea-a4dd-eaae1907c8ee None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:26.814483 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f1e2e-c32d-4b31-9901-e78de2499832 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:26.816265 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e39ccd-f338-44a6-8613-16103ab258f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:26.817125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e39ccd-f338-44a6-8613-16103ab258f6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:26.817413 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e39ccd-f338-44a6-8613-16103ab258f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:26.817695 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e39ccd-f338-44a6-8613-16103ab258f6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:26.829007 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e39ccd-f338-44a6-8613-16103ab258f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:06:26.837466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c2e39ccd-f338-44a6-8613-16103ab258f6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 16:06:26.837466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:26.837466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:26.837466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:26.837466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:26.837466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:26.837466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:26.837466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:26.837466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:26.837466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:26.837466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:26.837466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:26.837466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:06:26.837466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:06:26.837466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:06:26.837466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:06:26.838361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:06:26.838361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:06:26.838361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:06:26.838361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:06:26.838361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:26.838361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:26.838361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:26.838361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:26.838361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:26.838361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:26.838361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:26.838361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:26.838361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:26.838361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:26.838361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:26.838361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:26.839174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:26.839174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:26.839174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:26.839174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:26.839174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:06:26.839174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:06:26.839174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:06:26.839174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:06:26.839174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:06:26.839174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:06:26.839174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 16:06:26.839174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:26.839174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 537/1060] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jul 25 16:06:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:26.844624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e39ccd-f338-44a6-8613-16103ab258f6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:26.849122 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:26.853244 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878955e1-a8cb-4b7d-bc39-f62722c77852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:26.854118 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878955e1-a8cb-4b7d-bc39-f62722c77852 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:26.854395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878955e1-a8cb-4b7d-bc39-f62722c77852 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:26.855059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878955e1-a8cb-4b7d-bc39-f62722c77852 None admin] PATH_INFO: `/v3/projects/8db5ce99daab4453826ba40d5a7f8d61` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:26.855914 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878955e1-a8cb-4b7d-bc39-f62722c77852 None admin] RBAC: Authorizing `identity:get_project(project_id=8db5ce99daab4453826ba40d5a7f8d61)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:26.857406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878955e1-a8cb-4b7d-bc39-f62722c77852 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:26.860054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 524/1061] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:06:26 2022] GET /identity/v3/projects/8db5ce99daab4453826ba40d5a7f8d61 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:26.865600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878955e1-a8cb-4b7d-bc39-f62722c77852 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:26.907723 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:26.959226 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e39ccd-f338-44a6-8613-16103ab258f6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:26.974790 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878955e1-a8cb-4b7d-bc39-f62722c77852 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:26.996933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c19b8-4397-42f8-b62b-a2aa29a513bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:26.997693 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c19b8-4397-42f8-b62b-a2aa29a513bd None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:26.997983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c19b8-4397-42f8-b62b-a2aa29a513bd None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:26.998257 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c19b8-4397-42f8-b62b-a2aa29a513bd None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:26.998990 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c19b8-4397-42f8-b62b-a2aa29a513bd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:26.999294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c19b8-4397-42f8-b62b-a2aa29a513bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:27.001247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c19b8-4397-42f8-b62b-a2aa29a513bd None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:27.009335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 538/1062] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jul 25 16:06:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:27.015081 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c19b8-4397-42f8-b62b-a2aa29a513bd None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:27.015658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bacfcd-3a8d-45da-940d-d9c21036326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:27.016348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bacfcd-3a8d-45da-940d-d9c21036326c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:27.016630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bacfcd-3a8d-45da-940d-d9c21036326c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:27.016901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bacfcd-3a8d-45da-940d-d9c21036326c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:27.017749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bacfcd-3a8d-45da-940d-d9c21036326c None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=8db5ce99daab4453826ba40d5a7f8d61, user.id=28ece41c0c824be9930dbb9cdf2f52c3) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:27.018056 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bacfcd-3a8d-45da-940d-d9c21036326c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:27.019477 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bacfcd-3a8d-45da-940d-d9c21036326c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:27.025937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 525/1063] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:06:26 2022] GET /identity/v3/role_assignments?user.id=28ece41c0c824be9930dbb9cdf2f52c3&scope.project.id=8db5ce99daab4453826ba40d5a7f8d61&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:27.089135 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:27.132220 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c19b8-4397-42f8-b62b-a2aa29a513bd None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:27.169888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b71e7-6c51-4e69-bfa8-3ffdb46eea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:27.171028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b71e7-6c51-4e69-bfa8-3ffdb46eea39 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:27.172099 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b71e7-6c51-4e69-bfa8-3ffdb46eea39 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:27.172594 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b71e7-6c51-4e69-bfa8-3ffdb46eea39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:27.186005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b71e7-6c51-4e69-bfa8-3ffdb46eea39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:27.187767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b71e7-6c51-4e69-bfa8-3ffdb46eea39 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:27.206343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-5a6b71e7-6c51-4e69-bfa8-3ffdb46eea39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:27.206343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:27.206343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:27.206343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:27.206343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:27.206343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:27.206343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:27.206343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:27.206343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:27.206343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:27.206343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:27.206343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:27.206343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:06:27.206343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:06:27.206343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:27.207363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:27.208247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:06:27.208247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:06:27.208247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:27.208247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:27.212510 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 539/1064] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:27.213706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bacfcd-3a8d-45da-940d-d9c21036326c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:27.324673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bacfcd-3a8d-45da-940d-d9c21036326c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:27.326237 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:27.361037 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d3905-5fce-4c63-8575-30410eff6bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:27.361712 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d3905-5fce-4c63-8575-30410eff6bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:27.361996 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d3905-5fce-4c63-8575-30410eff6bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:27.362271 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d3905-5fce-4c63-8575-30410eff6bf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:27.362987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d3905-5fce-4c63-8575-30410eff6bf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:27.363292 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d3905-5fce-4c63-8575-30410eff6bf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:27.364704 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d3905-5fce-4c63-8575-30410eff6bf9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:27.377492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 526/1065] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:27.382902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b71e7-6c51-4e69-bfa8-3ffdb46eea39 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:27.489372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b71e7-6c51-4e69-bfa8-3ffdb46eea39 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:27.506253 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:27.524683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0064e7-91b8-4bcf-894d-e47312368b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:27.525482 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0064e7-91b8-4bcf-894d-e47312368b44 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:27.525765 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0064e7-91b8-4bcf-894d-e47312368b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:27.526039 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0064e7-91b8-4bcf-894d-e47312368b44 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:27.534453 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0064e7-91b8-4bcf-894d-e47312368b44 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:27.535883 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0064e7-91b8-4bcf-894d-e47312368b44 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:27.550004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-5e0064e7-91b8-4bcf-894d-e47312368b44 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:06:27.550004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:27.550004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:27.550004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:27.550004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:27.550004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:27.550004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:27.550004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:27.550004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:27.550004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:27.550004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:27.550004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:27.550004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:06:27.550004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:06:27.550004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:06:27.550004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:27.551108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:27.557176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:27.557176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:27.557176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:06:27.557176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:06:27.557176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:06:27.557176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:06:27.557176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:06:27.557176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:06:27.557176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:06:27.557176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:27.557176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 540/1066] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 25 16:06:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:27.559489 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d3905-5fce-4c63-8575-30410eff6bf9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:27.667312 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d3905-5fce-4c63-8575-30410eff6bf9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:27.705599 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782c156-b352-49d8-bba3-f8531e928360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:27.706285 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782c156-b352-49d8-bba3-f8531e928360 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:27.706571 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782c156-b352-49d8-bba3-f8531e928360 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:27.706839 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782c156-b352-49d8-bba3-f8531e928360 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:27.707677 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782c156-b352-49d8-bba3-f8531e928360 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:27.707987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782c156-b352-49d8-bba3-f8531e928360 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:27.709472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782c156-b352-49d8-bba3-f8531e928360 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:27.733269 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 527/1067] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 25 16:06:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:27.735141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0064e7-91b8-4bcf-894d-e47312368b44 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:27.836780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0064e7-91b8-4bcf-894d-e47312368b44 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:27.869589 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca5240-8775-4fc3-a359-51658c6c7d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:27.870382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5240-8775-4fc3-a359-51658c6c7d9b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:27.870661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5240-8775-4fc3-a359-51658c6c7d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:27.870937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5240-8775-4fc3-a359-51658c6c7d9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:27.881651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca5240-8775-4fc3-a359-51658c6c7d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:27.883091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca5240-8775-4fc3-a359-51658c6c7d9b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:27.900726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6fca5240-8775-4fc3-a359-51658c6c7d9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:27.900726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:27.900726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:27.900726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:27.900726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:27.900726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:27.900726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:27.900726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:27.900726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:27.900726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:27.900726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:27.900726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:27.900726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:06:27.900726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:06:27.900726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:27.902033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:27.909561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:06:27.909561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:06:27.909561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:27.909561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:27.909561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 541/1068] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:27.910123 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782c156-b352-49d8-bba3-f8531e928360 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:27.930880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:28.012397 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782c156-b352-49d8-bba3-f8531e928360 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:28.048569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878dcd3-df3b-469d-a91f-cddfa6b54cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:28.049237 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878dcd3-df3b-469d-a91f-cddfa6b54cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:28.049517 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878dcd3-df3b-469d-a91f-cddfa6b54cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:28.049793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878dcd3-df3b-469d-a91f-cddfa6b54cc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:28.050505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878dcd3-df3b-469d-a91f-cddfa6b54cc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:28.050809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878dcd3-df3b-469d-a91f-cddfa6b54cc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:28.052173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878dcd3-df3b-469d-a91f-cddfa6b54cc5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:28.068649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 528/1069] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:28.070105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca5240-8775-4fc3-a359-51658c6c7d9b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:28.102003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:28.176578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca5240-8775-4fc3-a359-51658c6c7d9b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:28.210415 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b617d-112c-4bbb-a0a3-f31aa01aa64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:28.211234 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b617d-112c-4bbb-a0a3-f31aa01aa64d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:28.211516 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b617d-112c-4bbb-a0a3-f31aa01aa64d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:28.211923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b617d-112c-4bbb-a0a3-f31aa01aa64d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:28.219474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b617d-112c-4bbb-a0a3-f31aa01aa64d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:28.220961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b617d-112c-4bbb-a0a3-f31aa01aa64d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:28.239454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-2f4b617d-112c-4bbb-a0a3-f31aa01aa64d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:06:28.239454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:28.239454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:28.239454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:28.239454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:28.239454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:28.239454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:28.239454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:28.239454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:28.239454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:28.239454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:28.239454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:28.239454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:06:28.239454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:06:28.239454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:28.240386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:28.245967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:06:28.245967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:06:28.245967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:06:28.245967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:06:28.245967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:06:28.245967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:06:28.245967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:06:28.245967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:28.245967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 542/1070] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:06:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:28.246440 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878dcd3-df3b-469d-a91f-cddfa6b54cc5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:28.329377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:28.349283 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878dcd3-df3b-469d-a91f-cddfa6b54cc5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:28.384206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604768ce-d7a8-42b3-8b8e-1ec38bc383db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:28.384822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604768ce-d7a8-42b3-8b8e-1ec38bc383db None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:28.385105 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604768ce-d7a8-42b3-8b8e-1ec38bc383db None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:28.385382 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604768ce-d7a8-42b3-8b8e-1ec38bc383db None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:28.386162 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604768ce-d7a8-42b3-8b8e-1ec38bc383db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:28.386472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604768ce-d7a8-42b3-8b8e-1ec38bc383db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:28.387905 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604768ce-d7a8-42b3-8b8e-1ec38bc383db None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:28.405162 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 529/1071] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:06:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:28.406475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b617d-112c-4bbb-a0a3-f31aa01aa64d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:28.499243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:28.508395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b51e00-b7ae-4d13-9c6d-20b5d899b6e1 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:28.508688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b51e00-b7ae-4d13-9c6d-20b5d899b6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:28.508970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b51e00-b7ae-4d13-9c6d-20b5d899b6e1 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:28.510342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 530/1072] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:28.511199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b617d-112c-4bbb-a0a3-f31aa01aa64d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:28.515233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90b3c6-e92e-41b1-8350-dfc0d4fbcd69 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:28.515520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90b3c6-e92e-41b1-8350-dfc0d4fbcd69 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:28.515795 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90b3c6-e92e-41b1-8350-dfc0d4fbcd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:28.534496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-0d90b3c6-e92e-41b1-8350-dfc0d4fbcd69 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:28.535687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0d90b3c6-e92e-41b1-8350-dfc0d4fbcd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:28.551873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65829c13-503f-4fd3-8fe0-78525cccca58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:28.552795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65829c13-503f-4fd3-8fe0-78525cccca58 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:28.553080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65829c13-503f-4fd3-8fe0-78525cccca58 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:28.553364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65829c13-503f-4fd3-8fe0-78525cccca58 None admin] PATH_INFO: `/v3/projects/0c9d252e2e0347029d58192fab233f09/users/c455f8d340444b068249213ff504895e/roles/a040806445b64d57b153293502c52634` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:28.555563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65829c13-503f-4fd3-8fe0-78525cccca58 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9d252e2e0347029d58192fab233f09, user_id=c455f8d340444b068249213ff504895e, role_id=a040806445b64d57b153293502c52634)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:28.557030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65829c13-503f-4fd3-8fe0-78525cccca58 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:28.570913 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 543/1073] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:06:28 2022] PUT /identity/v3/projects/0c9d252e2e0347029d58192fab233f09/users/c455f8d340444b068249213ff504895e/roles/a040806445b64d57b153293502c52634 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:06:28.616913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 531/1074] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:06:28.640984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65829c13-503f-4fd3-8fe0-78525cccca58 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:28.759279 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65829c13-503f-4fd3-8fe0-78525cccca58 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:28.798116 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8d084-3175-4bf2-8c10-214cc7b0dc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:28.798778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8d084-3175-4bf2-8c10-214cc7b0dc09 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:28.799062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8d084-3175-4bf2-8c10-214cc7b0dc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:28.799338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8d084-3175-4bf2-8c10-214cc7b0dc09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:28.827881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:28.907580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8d084-3175-4bf2-8c10-214cc7b0dc09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:28.910997 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8d084-3175-4bf2-8c10-214cc7b0dc09 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:29.028744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 544/1075] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:06:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 16:06:29.035134 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90b3c6-e92e-41b1-8350-dfc0d4fbcd69 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:29.057495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ecec4-be2d-44f1-9033-05c7b6bf813a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:29.057825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ecec4-be2d-44f1-9033-05c7b6bf813a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:29.058075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ecec4-be2d-44f1-9033-05c7b6bf813a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:29.059459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 545/1076] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:06:29.064744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905d238-428b-4268-858b-d62113039520 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:29.065016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905d238-428b-4268-858b-d62113039520 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:29.065304 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905d238-428b-4268-858b-d62113039520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:29.084018 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4905d238-428b-4268-858b-d62113039520 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:29.085257 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4905d238-428b-4268-858b-d62113039520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:29.113279 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:29.137528 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:29.150051 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90b3c6-e92e-41b1-8350-dfc0d4fbcd69 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:29.162104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 546/1077] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:06:29.183793 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905d238-428b-4268-858b-d62113039520 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:29.186218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d5e72-315d-4b1a-8daf-ff523053f999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:29.187089 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d5e72-315d-4b1a-8daf-ff523053f999 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:29.188229 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d5e72-315d-4b1a-8daf-ff523053f999 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:29.188229 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d5e72-315d-4b1a-8daf-ff523053f999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:29.199012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d5e72-315d-4b1a-8daf-ff523053f999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:29.200491 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d5e72-315d-4b1a-8daf-ff523053f999 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:29.219667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-999d5e72-315d-4b1a-8daf-ff523053f999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:29.219667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:29.219667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:29.219667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:29.219667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:29.219667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:29.219667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:29.219667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:29.219667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:29.219667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:29.219667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:29.219667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:29.219667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:06:29.219667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:06:29.219667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:29.225848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:29.226991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:06:29.226991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:06:29.226991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:29.226991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:29.226991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 532/1078] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:29.229983 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d5e72-315d-4b1a-8daf-ff523053f999 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:29.307240 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905d238-428b-4268-858b-d62113039520 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:29.351115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d5e72-315d-4b1a-8daf-ff523053f999 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:29.351437 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e0b1c-b743-40f3-8a48-b143fbc37ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:29.351921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e0b1c-b743-40f3-8a48-b143fbc37ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:29.352201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e0b1c-b743-40f3-8a48-b143fbc37ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:29.352518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e0b1c-b743-40f3-8a48-b143fbc37ca1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:29.363557 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e0b1c-b743-40f3-8a48-b143fbc37ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:06:29.371202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-4c1e0b1c-b743-40f3-8a48-b143fbc37ca1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:06:29.371202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:29.371202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:29.371202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:29.371202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:29.371202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:29.371202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:29.371202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:29.371202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:29.371202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:29.371202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:29.371202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:29.371202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:06:29.371202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:06:29.371202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:06:29.371202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:06:29.372212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:06:29.372212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:06:29.372212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:06:29.372212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:06:29.372212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:29.372212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:29.372212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:29.372212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:29.372212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:29.372212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:29.372212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:29.372212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:29.372212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:29.372212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:29.372212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:29.372212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:29.373154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:29.373154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:29.373154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:29.373154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:29.373154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:06:29.373154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:06:29.373154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:06:29.373154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:06:29.373154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:06:29.373154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:06:29.373154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:06:29.373154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:29.377654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:29.378064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 547/1079] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:06:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:29.378831 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e0b1c-b743-40f3-8a48-b143fbc37ca1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:29.392156 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a6695-1614-4fc7-bc30-a6a4766efc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:29.392860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a6695-1614-4fc7-bc30-a6a4766efc8d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:29.393136 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a6695-1614-4fc7-bc30-a6a4766efc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:29.393404 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a6695-1614-4fc7-bc30-a6a4766efc8d None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:29.394118 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a6695-1614-4fc7-bc30-a6a4766efc8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:29.394423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a6695-1614-4fc7-bc30-a6a4766efc8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:29.395808 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a6695-1614-4fc7-bc30-a6a4766efc8d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:29.416367 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 533/1080] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:29.433066 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:29.501354 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e0b1c-b743-40f3-8a48-b143fbc37ca1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:29.539480 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0e1aa-997b-4623-8269-8c15dde29da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:29.540164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0e1aa-997b-4623-8269-8c15dde29da9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:29.540477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0e1aa-997b-4623-8269-8c15dde29da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:29.540751 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0e1aa-997b-4623-8269-8c15dde29da9 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:29.541503 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0e1aa-997b-4623-8269-8c15dde29da9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:29.541808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0e1aa-997b-4623-8269-8c15dde29da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:29.543218 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0e1aa-997b-4623-8269-8c15dde29da9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:29.556659 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 548/1081] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:06:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:29.559850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a6695-1614-4fc7-bc30-a6a4766efc8d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:29.670269 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a6695-1614-4fc7-bc30-a6a4766efc8d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:29.709837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df624776-1578-49c5-8372-f1cbd90dfdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:29.710725 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df624776-1578-49c5-8372-f1cbd90dfdad None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:29.711004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df624776-1578-49c5-8372-f1cbd90dfdad None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:29.711274 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df624776-1578-49c5-8372-f1cbd90dfdad None admin] PATH_INFO: `/v3/users/28ece41c0c824be9930dbb9cdf2f52c3` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:29.712496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df624776-1578-49c5-8372-f1cbd90dfdad None admin] RBAC: Authorizing `identity:get_user(user_id=28ece41c0c824be9930dbb9cdf2f52c3)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:29.713936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df624776-1578-49c5-8372-f1cbd90dfdad None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:29.715728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 534/1082] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:06:29 2022] GET /identity/v3/users/28ece41c0c824be9930dbb9cdf2f52c3 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:29.722038 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0e1aa-997b-4623-8269-8c15dde29da9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:29.820271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0e1aa-997b-4623-8269-8c15dde29da9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:29.821816 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:29.855063 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba66b9f-9fa0-47bc-b6e0-f1ba7b123cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:29.855919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba66b9f-9fa0-47bc-b6e0-f1ba7b123cde None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:29.856202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba66b9f-9fa0-47bc-b6e0-f1ba7b123cde None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:29.856505 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba66b9f-9fa0-47bc-b6e0-f1ba7b123cde None admin] PATH_INFO: `/v3/projects/8db5ce99daab4453826ba40d5a7f8d61` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:29.857673 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba66b9f-9fa0-47bc-b6e0-f1ba7b123cde None admin] RBAC: Authorizing `identity:get_project(project_id=8db5ce99daab4453826ba40d5a7f8d61)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:29.859086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba66b9f-9fa0-47bc-b6e0-f1ba7b123cde None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:29.860808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 549/1083] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:06:29 2022] GET /identity/v3/projects/8db5ce99daab4453826ba40d5a7f8d61 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:29.867015 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df624776-1578-49c5-8372-f1cbd90dfdad None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:29.929835 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:29.990917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df624776-1578-49c5-8372-f1cbd90dfdad None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:30.027518 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f887baa-e057-4a9d-9ca0-ad259b2ef0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:30.028461 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f887baa-e057-4a9d-9ca0-ad259b2ef0a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:30.028738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f887baa-e057-4a9d-9ca0-ad259b2ef0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:30.029004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f887baa-e057-4a9d-9ca0-ad259b2ef0a7 None admin] PATH_INFO: `/v3/projects/8db5ce99daab4453826ba40d5a7f8d61/users/28ece41c0c824be9930dbb9cdf2f52c3/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:30.031681 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f887baa-e057-4a9d-9ca0-ad259b2ef0a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8db5ce99daab4453826ba40d5a7f8d61, user_id=28ece41c0c824be9930dbb9cdf2f52c3, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:30.033147 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f887baa-e057-4a9d-9ca0-ad259b2ef0a7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:30.046818 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 535/1084] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:06:29 2022] PUT /identity/v3/projects/8db5ce99daab4453826ba40d5a7f8d61/users/28ece41c0c824be9930dbb9cdf2f52c3/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:06:30.609719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804321a-63a4-4423-b573-49045eaa6f8a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:30.609929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804321a-63a4-4423-b573-49045eaa6f8a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:30.610185 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804321a-63a4-4423-b573-49045eaa6f8a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:30.611564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 550/1085] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:30.616930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e2e20-0526-45d2-a085-7974ca11e539 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:30.617221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e2e20-0526-45d2-a085-7974ca11e539 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:30.617522 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e2e20-0526-45d2-a085-7974ca11e539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:30.636811 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-652e2e20-0526-45d2-a085-7974ca11e539 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:30.638026 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-652e2e20-0526-45d2-a085-7974ca11e539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:30.711005 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 536/1086] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:30.734633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804321a-63a4-4423-b573-49045eaa6f8a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:30.835292 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804321a-63a4-4423-b573-49045eaa6f8a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:30.868813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d128f-2d49-4775-abe0-ed9c3da93ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:30.869573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d128f-2d49-4775-abe0-ed9c3da93ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:30.869855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d128f-2d49-4775-abe0-ed9c3da93ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:30.870133 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d128f-2d49-4775-abe0-ed9c3da93ba1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:30.879973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d128f-2d49-4775-abe0-ed9c3da93ba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:06:30.888106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-036d128f-2d49-4775-abe0-ed9c3da93ba1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 16:06:30.888106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:30.888106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:30.888106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:30.888106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:30.888106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:30.888106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:30.888106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:30.888106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:30.888106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:30.888106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:30.888106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:30.888106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:06:30.888106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:06:30.888106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:06:30.888106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:06:30.889105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:06:30.889105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:06:30.889105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:06:30.889105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:06:30.889105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:30.889105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:30.889105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:30.889105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:30.889105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:30.889105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:30.889105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:30.889105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:30.889105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:30.889105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:30.889105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:30.889105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:30.889960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:30.889960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:30.889960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:30.889960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:30.889960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:06:30.889960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:06:30.889960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:06:30.889960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:06:30.889960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:06:30.889960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:06:30.889960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 16:06:30.889960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:30.889960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 551/1087] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Jul 25 16:06:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:30.895899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e2e20-0526-45d2-a085-7974ca11e539 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:30.937543 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:30.994112 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e2e20-0526-45d2-a085-7974ca11e539 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:31.027915 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77402eb-268b-450d-9a43-62ad2d18f53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:31.028613 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77402eb-268b-450d-9a43-62ad2d18f53d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:31.028896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77402eb-268b-450d-9a43-62ad2d18f53d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:31.029170 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77402eb-268b-450d-9a43-62ad2d18f53d None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:31.029911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77402eb-268b-450d-9a43-62ad2d18f53d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:31.030238 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77402eb-268b-450d-9a43-62ad2d18f53d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:31.031607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77402eb-268b-450d-9a43-62ad2d18f53d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:31.039647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 537/1088] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jul 25 16:06:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:31.045317 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d128f-2d49-4775-abe0-ed9c3da93ba1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:31.075184 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:31.145378 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d128f-2d49-4775-abe0-ed9c3da93ba1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:31.182004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e07615-1084-4df8-9308-5585f0559443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:31.182804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e07615-1084-4df8-9308-5585f0559443 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:31.183085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e07615-1084-4df8-9308-5585f0559443 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:31.183363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e07615-1084-4df8-9308-5585f0559443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:31.195344 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e07615-1084-4df8-9308-5585f0559443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:31.196848 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e07615-1084-4df8-9308-5585f0559443 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:31.214971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-99e07615-1084-4df8-9308-5585f0559443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:31.214971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:31.214971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:31.214971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:31.214971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:31.214971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:31.214971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:31.214971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:31.214971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:31.214971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:31.214971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:31.214971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:31.214971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:06:31.214971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:06:31.214971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:31.216189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:31.217192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:06:31.217192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:06:31.217192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:31.217192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:31.220416 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 552/1089] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:31.222194 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77402eb-268b-450d-9a43-62ad2d18f53d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:31.327327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77402eb-268b-450d-9a43-62ad2d18f53d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:31.329456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:31.365269 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d877da-a323-4a3a-b4bb-c3183722503a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:31.365928 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d877da-a323-4a3a-b4bb-c3183722503a None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:31.366211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d877da-a323-4a3a-b4bb-c3183722503a None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:31.366484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d877da-a323-4a3a-b4bb-c3183722503a None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:31.367196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d877da-a323-4a3a-b4bb-c3183722503a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:31.367500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d877da-a323-4a3a-b4bb-c3183722503a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:31.368895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d877da-a323-4a3a-b4bb-c3183722503a None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:31.380297 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 538/1090] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:31.385954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e07615-1084-4df8-9308-5585f0559443 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:31.466855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:31.485276 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e07615-1084-4df8-9308-5585f0559443 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:31.517913 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3ce76-d145-482a-bbad-cfd5b60166a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:31.518713 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3ce76-d145-482a-bbad-cfd5b60166a4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:31.518998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3ce76-d145-482a-bbad-cfd5b60166a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:31.519273 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3ce76-d145-482a-bbad-cfd5b60166a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:31.527258 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3ce76-d145-482a-bbad-cfd5b60166a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:31.528752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3ce76-d145-482a-bbad-cfd5b60166a4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:31.542581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-95b3ce76-d145-482a-bbad-cfd5b60166a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:06:31.542581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:31.542581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:31.542581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:31.542581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:31.542581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:31.542581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:31.542581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:31.542581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:31.542581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:31.542581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:31.542581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:31.542581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:06:31.542581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:06:31.542581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:06:31.542581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:31.543680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:31.544652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:31.544652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:31.544652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:06:31.544652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:06:31.544652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:06:31.544652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:06:31.544652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:06:31.544652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:06:31.544652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 16:06:31.544652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:31.544652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 553/1091] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Jul 25 16:06:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:31.550267 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d877da-a323-4a3a-b4bb-c3183722503a None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:31.647164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d877da-a323-4a3a-b4bb-c3183722503a None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:31.681713 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb4d11-0334-4054-b74a-d5d1220e8206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:31.682375 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb4d11-0334-4054-b74a-d5d1220e8206 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:31.682654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb4d11-0334-4054-b74a-d5d1220e8206 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:31.682926 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb4d11-0334-4054-b74a-d5d1220e8206 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:31.683740 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb4d11-0334-4054-b74a-d5d1220e8206 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:31.684043 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb4d11-0334-4054-b74a-d5d1220e8206 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:31.685498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb4d11-0334-4054-b74a-d5d1220e8206 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:31.702221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 539/1092] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Jul 25 16:06:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:31.707944 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3ce76-d145-482a-bbad-cfd5b60166a4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:31.805792 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3ce76-d145-482a-bbad-cfd5b60166a4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:31.839474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701b61e-e70a-46b2-99fe-152829069f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:31.840121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701b61e-e70a-46b2-99fe-152829069f08 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:31.840427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701b61e-e70a-46b2-99fe-152829069f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:31.840702 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701b61e-e70a-46b2-99fe-152829069f08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:31.853899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:31.909262 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701b61e-e70a-46b2-99fe-152829069f08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:31.910736 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701b61e-e70a-46b2-99fe-152829069f08 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:32.005589 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 554/1093] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:06:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:06:32.011232 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb4d11-0334-4054-b74a-d5d1220e8206 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:32.033564 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:32.064826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683375c0-eb25-4d4f-85c8-06f88a0957dd None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:32.065040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683375c0-eb25-4d4f-85c8-06f88a0957dd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:32.065327 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683375c0-eb25-4d4f-85c8-06f88a0957dd None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:32.066693 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 555/1094] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:06:32.071497 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079b926-96d3-4ba3-94dd-eec8ee8d2f34 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:32.071791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079b926-96d3-4ba3-94dd-eec8ee8d2f34 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:32.072075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079b926-96d3-4ba3-94dd-eec8ee8d2f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:32.089733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7079b926-96d3-4ba3-94dd-eec8ee8d2f34 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:32.091018 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7079b926-96d3-4ba3-94dd-eec8ee8d2f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:32.110598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb4d11-0334-4054-b74a-d5d1220e8206 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:32.129880 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:32.147250 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f882f7-3ab1-4fc2-a827-e2c59ad51c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:32.148046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f882f7-3ab1-4fc2-a827-e2c59ad51c52 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:32.148354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f882f7-3ab1-4fc2-a827-e2c59ad51c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:32.148628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f882f7-3ab1-4fc2-a827-e2c59ad51c52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:32.158966 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f882f7-3ab1-4fc2-a827-e2c59ad51c52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:32.160435 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f882f7-3ab1-4fc2-a827-e2c59ad51c52 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:32.161131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 556/1095] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:06:32.178111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-00f882f7-3ab1-4fc2-a827-e2c59ad51c52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:32.178111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:32.178111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:32.178111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:32.178111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:32.178111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:32.178111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:32.178111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:32.178111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:32.178111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:32.178111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:32.178111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:32.178111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:06:32.178111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:06:32.178111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:32.179182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:32.180455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:06:32.180455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:06:32.180455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:06:32.180455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:32.180455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 540/1096] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:32.184174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079b926-96d3-4ba3-94dd-eec8ee8d2f34 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:32.184724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f882f7-3ab1-4fc2-a827-e2c59ad51c52 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:32.257122 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:32.287269 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f882f7-3ab1-4fc2-a827-e2c59ad51c52 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:32.287879 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079b926-96d3-4ba3-94dd-eec8ee8d2f34 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:32.325959 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb546f0-4117-4d4b-aab9-aa0565379328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:32.326207 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9074cdb-0efa-4b82-b0be-2cc917852c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:32.326387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb546f0-4117-4d4b-aab9-aa0565379328 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:32.326489 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9074cdb-0efa-4b82-b0be-2cc917852c2b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:32.326581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb546f0-4117-4d4b-aab9-aa0565379328 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:32.326669 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9074cdb-0efa-4b82-b0be-2cc917852c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:32.326768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb546f0-4117-4d4b-aab9-aa0565379328 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:32.326871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9074cdb-0efa-4b82-b0be-2cc917852c2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:32.326956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb546f0-4117-4d4b-aab9-aa0565379328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:32.326956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb546f0-4117-4d4b-aab9-aa0565379328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:32.326956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb546f0-4117-4d4b-aab9-aa0565379328 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:32.333985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9074cdb-0efa-4b82-b0be-2cc917852c2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:06:32.337963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 541/1097] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:32.341773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a9074cdb-0efa-4b82-b0be-2cc917852c2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:06:32.341773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:32.341773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:32.341773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:32.341773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:32.341773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:32.341773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:32.341773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:32.341773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:32.341773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:32.341773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:32.341773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:32.341773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:06:32.341773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:06:32.341773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:06:32.341773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:06:32.343182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:06:32.343182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:06:32.343182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:06:32.343182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:06:32.343182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:32.343182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:32.343182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:32.343182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:32.343182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:32.343182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:32.343182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:32.343182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:32.343182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:32.343182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:32.343182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:32.343182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:32.344049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:32.344049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:32.344049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:32.344049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:32.344049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:06:32.344049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:06:32.344049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:06:32.344049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:06:32.344049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:06:32.344049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:06:32.344049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:06:32.344049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:32.344049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 557/1098] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:06:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:32.344907 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb546f0-4117-4d4b-aab9-aa0565379328 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:32.348981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9074cdb-0efa-4b82-b0be-2cc917852c2b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:32.381242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:32.451901 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9074cdb-0efa-4b82-b0be-2cc917852c2b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:32.469395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb546f0-4117-4d4b-aab9-aa0565379328 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:32.488299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f8026-894f-4cf8-8235-b0c003c6e4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:32.488982 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f8026-894f-4cf8-8235-b0c003c6e4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:32.489269 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f8026-894f-4cf8-8235-b0c003c6e4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:32.489550 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f8026-894f-4cf8-8235-b0c003c6e4e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:32.490298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f8026-894f-4cf8-8235-b0c003c6e4e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:32.490609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f8026-894f-4cf8-8235-b0c003c6e4e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:32.492016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f8026-894f-4cf8-8235-b0c003c6e4e9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:32.500687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:32.501396 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 558/1099] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:06:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:32.506316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb303f00-e11f-4e40-8162-32aaf697bbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:32.507004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f8026-894f-4cf8-8235-b0c003c6e4e9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:32.507259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb303f00-e11f-4e40-8162-32aaf697bbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:32.507821 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb303f00-e11f-4e40-8162-32aaf697bbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:32.508296 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb303f00-e11f-4e40-8162-32aaf697bbc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:32.515897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb303f00-e11f-4e40-8162-32aaf697bbc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:32.517386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb303f00-e11f-4e40-8162-32aaf697bbc8 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:32.533059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-bb303f00-e11f-4e40-8162-32aaf697bbc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:06:32.533059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:32.533059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:32.533059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:32.533059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:32.533059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:32.533059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:32.533059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:32.533059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:32.533059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:32.533059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:32.533059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:32.533059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:06:32.533059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:06:32.533059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:32.534066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:32.539806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:06:32.539806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:06:32.539806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:06:32.539806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:06:32.539806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:06:32.539806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:06:32.539806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:06:32.539806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:32.539806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 542/1100] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:06:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:32.540352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb303f00-e11f-4e40-8162-32aaf697bbc8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:32.603294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:32.610819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f8026-894f-4cf8-8235-b0c003c6e4e9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:32.638715 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb303f00-e11f-4e40-8162-32aaf697bbc8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:32.643453 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0bf70-5c35-458c-a70a-566124dbe42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:32.644435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0bf70-5c35-458c-a70a-566124dbe42f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:32.644721 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0bf70-5c35-458c-a70a-566124dbe42f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:32.645027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0bf70-5c35-458c-a70a-566124dbe42f None admin] PATH_INFO: `/v3/users/28ece41c0c824be9930dbb9cdf2f52c3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:32.646221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0bf70-5c35-458c-a70a-566124dbe42f None admin] RBAC: Authorizing `identity:get_user(user_id=28ece41c0c824be9930dbb9cdf2f52c3)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:32.647650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0bf70-5c35-458c-a70a-566124dbe42f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:32.649314 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 559/1101] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:06:32 2022] GET /identity/v3/users/28ece41c0c824be9930dbb9cdf2f52c3 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:32.655133 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0bf70-5c35-458c-a70a-566124dbe42f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:32.673565 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb228d-1147-4eb0-94c7-b71b8c02bc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:32.674225 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb228d-1147-4eb0-94c7-b71b8c02bc78 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:32.674506 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb228d-1147-4eb0-94c7-b71b8c02bc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:32.674783 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb228d-1147-4eb0-94c7-b71b8c02bc78 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:32.675563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb228d-1147-4eb0-94c7-b71b8c02bc78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:32.675868 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb228d-1147-4eb0-94c7-b71b8c02bc78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:32.677336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb228d-1147-4eb0-94c7-b71b8c02bc78 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:32.693902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 543/1102] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:06:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:32.694891 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb228d-1147-4eb0-94c7-b71b8c02bc78 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:32.749577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:32.758044 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0bf70-5c35-458c-a70a-566124dbe42f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:32.791212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53375db9-8891-453e-8b87-f0a1729238a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:32.791856 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53375db9-8891-453e-8b87-f0a1729238a2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:32.792137 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53375db9-8891-453e-8b87-f0a1729238a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:32.792437 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53375db9-8891-453e-8b87-f0a1729238a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:32.797467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb228d-1147-4eb0-94c7-b71b8c02bc78 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:32.822611 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:32.831932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f31321-7770-47dd-9cc7-8a8eb524833e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:32.832632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31321-7770-47dd-9cc7-8a8eb524833e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:32.832920 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31321-7770-47dd-9cc7-8a8eb524833e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:32.833199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31321-7770-47dd-9cc7-8a8eb524833e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:32.834020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f31321-7770-47dd-9cc7-8a8eb524833e None admin] RBAC: Adding query filter params (role.id=a040806445b64d57b153293502c52634, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=c455f8d340444b068249213ff504895e) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:32.834336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f31321-7770-47dd-9cc7-8a8eb524833e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:32.835782 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f31321-7770-47dd-9cc7-8a8eb524833e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:32.841806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 544/1103] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:06:32 2022] GET /identity/v3/role_assignments?user.id=c455f8d340444b068249213ff504895e&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=a040806445b64d57b153293502c52634 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:32.862424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53375db9-8891-453e-8b87-f0a1729238a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:32.863826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53375db9-8891-453e-8b87-f0a1729238a2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:32.969524 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 560/1104] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:06:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 16:06:32.975651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f31321-7770-47dd-9cc7-8a8eb524833e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:33.080077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f31321-7770-47dd-9cc7-8a8eb524833e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:33.096897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:33.115468 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66178f3b-903f-4c5a-9858-e8f30616de01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:33.116285 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178f3b-903f-4c5a-9858-e8f30616de01 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:33.116567 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178f3b-903f-4c5a-9858-e8f30616de01 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:33.116840 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178f3b-903f-4c5a-9858-e8f30616de01 None admin] PATH_INFO: `/v3/projects/8db5ce99daab4453826ba40d5a7f8d61` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:33.118028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66178f3b-903f-4c5a-9858-e8f30616de01 None admin] RBAC: Authorizing `identity:get_project(project_id=8db5ce99daab4453826ba40d5a7f8d61)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:33.119487 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66178f3b-903f-4c5a-9858-e8f30616de01 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:33.121528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 545/1105] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:06:32 2022] GET /identity/v3/projects/8db5ce99daab4453826ba40d5a7f8d61 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:33.127783 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53375db9-8891-453e-8b87-f0a1729238a2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:33.191698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:33.232812 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53375db9-8891-453e-8b87-f0a1729238a2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:33.269353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87128a4-2b55-4811-b992-1bd7d4929d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:33.270011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87128a4-2b55-4811-b992-1bd7d4929d90 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:33.270295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87128a4-2b55-4811-b992-1bd7d4929d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:33.270572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87128a4-2b55-4811-b992-1bd7d4929d90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:33.272091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87128a4-2b55-4811-b992-1bd7d4929d90 None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=8db5ce99daab4453826ba40d5a7f8d61, user.id=28ece41c0c824be9930dbb9cdf2f52c3) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:33.272091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87128a4-2b55-4811-b992-1bd7d4929d90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:33.273181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87128a4-2b55-4811-b992-1bd7d4929d90 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:33.279615 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 561/1106] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:06:33 2022] GET /identity/v3/role_assignments?user.id=28ece41c0c824be9930dbb9cdf2f52c3&scope.project.id=8db5ce99daab4453826ba40d5a7f8d61&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:35.298796 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b17b97-202f-4aa5-ba97-17dcafa62e8b None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:35.299303 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b17b97-202f-4aa5-ba97-17dcafa62e8b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:35.299408 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b17b97-202f-4aa5-ba97-17dcafa62e8b None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:35.300731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 546/1107] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:35.305871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d191e-5113-4e25-a1a6-ba3b35b68966 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:35.306264 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d191e-5113-4e25-a1a6-ba3b35b68966 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:35.306437 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d191e-5113-4e25-a1a6-ba3b35b68966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:35.324956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ba6d191e-5113-4e25-a1a6-ba3b35b68966 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:35.326148 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ba6d191e-5113-4e25-a1a6-ba3b35b68966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:35.390518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 562/1108] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:35.414551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b17b97-202f-4aa5-ba97-17dcafa62e8b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:35.532016 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b17b97-202f-4aa5-ba97-17dcafa62e8b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:35.565553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fbeed-3bdf-4f2d-a41b-ca37bea7f11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:35.566337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fbeed-3bdf-4f2d-a41b-ca37bea7f11f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:35.566614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fbeed-3bdf-4f2d-a41b-ca37bea7f11f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:35.566884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fbeed-3bdf-4f2d-a41b-ca37bea7f11f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:35.568024 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fbeed-3bdf-4f2d-a41b-ca37bea7f11f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:35.569482 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fbeed-3bdf-4f2d-a41b-ca37bea7f11f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:35.571085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 547/1109] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:35.576918 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d191e-5113-4e25-a1a6-ba3b35b68966 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:35.632367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:35.676583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d191e-5113-4e25-a1a6-ba3b35b68966 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:35.708700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b0471-bef6-4e63-8c71-9e45677c417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:35.709358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b0471-bef6-4e63-8c71-9e45677c417e None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:35.709646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b0471-bef6-4e63-8c71-9e45677c417e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:35.709924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b0471-bef6-4e63-8c71-9e45677c417e None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:35.710630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b0471-bef6-4e63-8c71-9e45677c417e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:35.712041 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b0471-bef6-4e63-8c71-9e45677c417e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:35.734696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 563/1110] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:06:35 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:06:37.805826 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731a60e-cac7-4984-ad65-3775d4f3242b None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:37.806356 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731a60e-cac7-4984-ad65-3775d4f3242b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:37.806356 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731a60e-cac7-4984-ad65-3775d4f3242b None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:37.807736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 548/1111] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:37.813125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76734efe-ccf1-4575-882a-aba9cb8b685a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:37.813534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76734efe-ccf1-4575-882a-aba9cb8b685a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:37.813691 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76734efe-ccf1-4575-882a-aba9cb8b685a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:37.831364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-76734efe-ccf1-4575-882a-aba9cb8b685a None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:37.832586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-76734efe-ccf1-4575-882a-aba9cb8b685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:37.897050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 564/1112] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:06:37.920337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731a60e-cac7-4984-ad65-3775d4f3242b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:37.975036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:38.021207 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731a60e-cac7-4984-ad65-3775d4f3242b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:38.054770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e018654-1c66-4916-b468-3c8e78ecb7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:38.055624 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e018654-1c66-4916-b468-3c8e78ecb7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:38.055960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e018654-1c66-4916-b468-3c8e78ecb7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:38.056189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e018654-1c66-4916-b468-3c8e78ecb7a2 None admin] PATH_INFO: `/v3/roles/e4ade3cd570d4865b356cbe822b76fe9` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:38.057685 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e018654-1c66-4916-b468-3c8e78ecb7a2 None admin] RBAC: Authorizing `identity:get_role(role_id=e4ade3cd570d4865b356cbe822b76fe9)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:38.059056 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e018654-1c66-4916-b468-3c8e78ecb7a2 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:38.060460 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 549/1113] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:06:37 2022] GET /identity/v3/roles/e4ade3cd570d4865b356cbe822b76fe9 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:38.066329 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76734efe-ccf1-4575-882a-aba9cb8b685a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:38.108622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:38.164219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76734efe-ccf1-4575-882a-aba9cb8b685a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:38.195806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa07fa1-960f-48bc-8a17-90e3609a5650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:38.196709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa07fa1-960f-48bc-8a17-90e3609a5650 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:38.196995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa07fa1-960f-48bc-8a17-90e3609a5650 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:38.197272 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa07fa1-960f-48bc-8a17-90e3609a5650 None admin] PATH_INFO: `/v3/users/4ebb238bb12341fba1e01dbe8b069d3c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:38.210332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa07fa1-960f-48bc-8a17-90e3609a5650 None admin] RBAC: Authorizing `identity:get_user(user_id=4ebb238bb12341fba1e01dbe8b069d3c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:38.211778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa07fa1-960f-48bc-8a17-90e3609a5650 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:38.213521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 565/1114] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:06:38 2022] GET /identity/v3/users/4ebb238bb12341fba1e01dbe8b069d3c => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:38.219906 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e018654-1c66-4916-b468-3c8e78ecb7a2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:38.319724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e018654-1c66-4916-b468-3c8e78ecb7a2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:38.346432 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:38.361158 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c8854-08e9-458a-9a43-d778ed834440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:38.361875 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c8854-08e9-458a-9a43-d778ed834440 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:38.362202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c8854-08e9-458a-9a43-d778ed834440 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:38.362536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c8854-08e9-458a-9a43-d778ed834440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:38.431970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c8854-08e9-458a-9a43-d778ed834440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:38.433629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c8854-08e9-458a-9a43-d778ed834440 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:38.530586 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 550/1115] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:06:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:06:38.536550 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa07fa1-960f-48bc-8a17-90e3609a5650 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:38.633039 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:38.636144 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa07fa1-960f-48bc-8a17-90e3609a5650 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:38.677584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639de05-587f-41d3-9f8d-71a11e681c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:38.678571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639de05-587f-41d3-9f8d-71a11e681c11 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:38.678986 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639de05-587f-41d3-9f8d-71a11e681c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:38.679297 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639de05-587f-41d3-9f8d-71a11e681c11 None admin] PATH_INFO: `/v3/projects/8db5ce99daab4453826ba40d5a7f8d61` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:38.680855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639de05-587f-41d3-9f8d-71a11e681c11 None admin] RBAC: Authorizing `identity:get_project(project_id=8db5ce99daab4453826ba40d5a7f8d61)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:38.683682 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639de05-587f-41d3-9f8d-71a11e681c11 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:38.685810 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 566/1116] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:06:38 2022] GET /identity/v3/projects/8db5ce99daab4453826ba40d5a7f8d61 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:38.692628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c8854-08e9-458a-9a43-d778ed834440 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:38.713395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:38.789565 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c8854-08e9-458a-9a43-d778ed834440 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:38.822004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53585e85-8546-4ccb-9e01-df4721431781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:38.822641 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53585e85-8546-4ccb-9e01-df4721431781 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:38.822919 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53585e85-8546-4ccb-9e01-df4721431781 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:38.823190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53585e85-8546-4ccb-9e01-df4721431781 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:38.824019 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53585e85-8546-4ccb-9e01-df4721431781 None admin] RBAC: Adding query filter params (role.id=e4ade3cd570d4865b356cbe822b76fe9, scope.project.id=8db5ce99daab4453826ba40d5a7f8d61, user.id=4ebb238bb12341fba1e01dbe8b069d3c) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:38.824349 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53585e85-8546-4ccb-9e01-df4721431781 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:38.825772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53585e85-8546-4ccb-9e01-df4721431781 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:38.831745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 551/1117] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:06:38 2022] GET /identity/v3/role_assignments?user.id=4ebb238bb12341fba1e01dbe8b069d3c&scope.project.id=8db5ce99daab4453826ba40d5a7f8d61&role.id=e4ade3cd570d4865b356cbe822b76fe9 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:40.804915 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e06410-eedc-47b2-a544-0ea8f667894f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:40.805450 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e06410-eedc-47b2-a544-0ea8f667894f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:40.805565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e06410-eedc-47b2-a544-0ea8f667894f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:40.806845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 567/1118] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:40.812720 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3a189-a04f-4232-bd5b-62ed74b6dca6 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:40.813152 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3a189-a04f-4232-bd5b-62ed74b6dca6 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:40.813268 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3a189-a04f-4232-bd5b-62ed74b6dca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:40.831429 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-02d3a189-a04f-4232-bd5b-62ed74b6dca6 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:40.832643 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-02d3a189-a04f-4232-bd5b-62ed74b6dca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:40.895788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 552/1119] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:40.918205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e06410-eedc-47b2-a544-0ea8f667894f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:41.018817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e06410-eedc-47b2-a544-0ea8f667894f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:41.052697 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a96f2d-8981-4e4f-9cd3-386ba5907003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:41.053551 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a96f2d-8981-4e4f-9cd3-386ba5907003 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:41.053874 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a96f2d-8981-4e4f-9cd3-386ba5907003 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:41.054189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a96f2d-8981-4e4f-9cd3-386ba5907003 None admin] PATH_INFO: `/v3/roles/e4ade3cd570d4865b356cbe822b76fe9` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:41.055767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a96f2d-8981-4e4f-9cd3-386ba5907003 None admin] RBAC: Authorizing `identity:get_role(role_id=e4ade3cd570d4865b356cbe822b76fe9)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:41.057106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a96f2d-8981-4e4f-9cd3-386ba5907003 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:41.058500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 568/1120] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:06:40 2022] GET /identity/v3/roles/e4ade3cd570d4865b356cbe822b76fe9 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:41.064960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3a189-a04f-4232-bd5b-62ed74b6dca6 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:41.081160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:41.172776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3a189-a04f-4232-bd5b-62ed74b6dca6 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:41.205789 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd60f00-f799-49ab-8c76-24127f794c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:41.206662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd60f00-f799-49ab-8c76-24127f794c8c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:41.206942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd60f00-f799-49ab-8c76-24127f794c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:41.207216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd60f00-f799-49ab-8c76-24127f794c8c None admin] PATH_INFO: `/v3/users/4ebb238bb12341fba1e01dbe8b069d3c` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:41.208430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd60f00-f799-49ab-8c76-24127f794c8c None admin] RBAC: Authorizing `identity:get_user(user_id=4ebb238bb12341fba1e01dbe8b069d3c)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:41.209872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd60f00-f799-49ab-8c76-24127f794c8c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:41.211504 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 553/1121] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:06:41 2022] GET /identity/v3/users/4ebb238bb12341fba1e01dbe8b069d3c => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:41.217368 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a96f2d-8981-4e4f-9cd3-386ba5907003 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:41.253518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:41.317090 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a96f2d-8981-4e4f-9cd3-386ba5907003 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:41.349881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00495d-d963-4393-8146-e3d08c1499e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:41.350742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00495d-d963-4393-8146-e3d08c1499e5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:41.351024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00495d-d963-4393-8146-e3d08c1499e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:41.351300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00495d-d963-4393-8146-e3d08c1499e5 None admin] PATH_INFO: `/v3/projects/8db5ce99daab4453826ba40d5a7f8d61` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:41.352488 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00495d-d963-4393-8146-e3d08c1499e5 None admin] RBAC: Authorizing `identity:get_project(project_id=8db5ce99daab4453826ba40d5a7f8d61)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:41.353910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00495d-d963-4393-8146-e3d08c1499e5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:41.355601 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 569/1122] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:06:41 2022] GET /identity/v3/projects/8db5ce99daab4453826ba40d5a7f8d61 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:41.362246 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd60f00-f799-49ab-8c76-24127f794c8c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:41.449788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:41.472825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd60f00-f799-49ab-8c76-24127f794c8c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:41.508201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d46923-63f0-4ec8-8830-ed08074c2383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:41.509128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d46923-63f0-4ec8-8830-ed08074c2383 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:41.509408 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d46923-63f0-4ec8-8830-ed08074c2383 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:41.509681 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d46923-63f0-4ec8-8830-ed08074c2383 None admin] PATH_INFO: `/v3/projects/8db5ce99daab4453826ba40d5a7f8d61/users/4ebb238bb12341fba1e01dbe8b069d3c/roles/e4ade3cd570d4865b356cbe822b76fe9` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:41.511834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d46923-63f0-4ec8-8830-ed08074c2383 None admin] RBAC: Authorizing `identity:create_grant(project_id=8db5ce99daab4453826ba40d5a7f8d61, user_id=4ebb238bb12341fba1e01dbe8b069d3c, role_id=e4ade3cd570d4865b356cbe822b76fe9)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:41.513558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d46923-63f0-4ec8-8830-ed08074c2383 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:41.526481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 554/1123] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:06:41 2022] PUT /identity/v3/projects/8db5ce99daab4453826ba40d5a7f8d61/users/4ebb238bb12341fba1e01dbe8b069d3c/roles/e4ade3cd570d4865b356cbe822b76fe9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:06:43.567087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc07e0-4103-4ef0-ab3d-992e0080d89a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:43.567604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc07e0-4103-4ef0-ab3d-992e0080d89a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:43.567604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc07e0-4103-4ef0-ab3d-992e0080d89a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:43.568957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 570/1124] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:43.574202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c054da-bd22-44bb-af3e-5c0f4dc5a287 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:43.574617 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c054da-bd22-44bb-af3e-5c0f4dc5a287 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:43.574760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c054da-bd22-44bb-af3e-5c0f4dc5a287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:43.592463 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-77c054da-bd22-44bb-af3e-5c0f4dc5a287 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:43.593675 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-77c054da-bd22-44bb-af3e-5c0f4dc5a287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:43.658713 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 555/1125] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:43.681840 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc07e0-4103-4ef0-ab3d-992e0080d89a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:43.782240 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc07e0-4103-4ef0-ab3d-992e0080d89a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:43.784564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:43.816157 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f8a62-84a9-41ff-ad0c-84bd13217de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:43.817043 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f8a62-84a9-41ff-ad0c-84bd13217de3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:43.817410 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f8a62-84a9-41ff-ad0c-84bd13217de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:43.817622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f8a62-84a9-41ff-ad0c-84bd13217de3 None admin] PATH_INFO: `/v3/roles/e4ade3cd570d4865b356cbe822b76fe9` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:43.819163 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f8a62-84a9-41ff-ad0c-84bd13217de3 None admin] RBAC: Authorizing `identity:get_role(role_id=e4ade3cd570d4865b356cbe822b76fe9)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:43.820605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f8a62-84a9-41ff-ad0c-84bd13217de3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:43.821974 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 571/1126] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:06:43 2022] GET /identity/v3/roles/e4ade3cd570d4865b356cbe822b76fe9 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:43.827871 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c054da-bd22-44bb-af3e-5c0f4dc5a287 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:43.897536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:43.928483 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c054da-bd22-44bb-af3e-5c0f4dc5a287 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:43.961946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce62efd-77fa-47c4-8a0e-b12a0a554bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:43.962814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce62efd-77fa-47c4-8a0e-b12a0a554bdf None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:43.963102 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce62efd-77fa-47c4-8a0e-b12a0a554bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:43.963380 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce62efd-77fa-47c4-8a0e-b12a0a554bdf None admin] PATH_INFO: `/v3/users/4ebb238bb12341fba1e01dbe8b069d3c` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:43.964597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce62efd-77fa-47c4-8a0e-b12a0a554bdf None admin] RBAC: Authorizing `identity:get_user(user_id=4ebb238bb12341fba1e01dbe8b069d3c)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:43.966038 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce62efd-77fa-47c4-8a0e-b12a0a554bdf None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:43.968193 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 556/1127] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:06:43 2022] GET /identity/v3/users/4ebb238bb12341fba1e01dbe8b069d3c => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:43.974037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f8a62-84a9-41ff-ad0c-84bd13217de3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:44.072444 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f8a62-84a9-41ff-ad0c-84bd13217de3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:44.105131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603d991-43a7-4fea-9b83-98582859c465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:44.105780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603d991-43a7-4fea-9b83-98582859c465 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:44.106065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603d991-43a7-4fea-9b83-98582859c465 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:44.106345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603d991-43a7-4fea-9b83-98582859c465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:44.149685 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:44.177958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603d991-43a7-4fea-9b83-98582859c465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:44.179443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603d991-43a7-4fea-9b83-98582859c465 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:44.283740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 572/1128] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:06:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:06:44.289712 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce62efd-77fa-47c4-8a0e-b12a0a554bdf None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:44.386956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce62efd-77fa-47c4-8a0e-b12a0a554bdf None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:44.420835 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266e12b-3d7a-4120-92a8-8c4cbd9918da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:44.421693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266e12b-3d7a-4120-92a8-8c4cbd9918da None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:44.421976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266e12b-3d7a-4120-92a8-8c4cbd9918da None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:44.422255 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266e12b-3d7a-4120-92a8-8c4cbd9918da None admin] PATH_INFO: `/v3/projects/8db5ce99daab4453826ba40d5a7f8d61` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:44.423422 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266e12b-3d7a-4120-92a8-8c4cbd9918da None admin] RBAC: Authorizing `identity:get_project(project_id=8db5ce99daab4453826ba40d5a7f8d61)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:44.425197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266e12b-3d7a-4120-92a8-8c4cbd9918da None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:44.426901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 557/1129] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:06:44 2022] GET /identity/v3/projects/8db5ce99daab4453826ba40d5a7f8d61 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:44.433033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603d991-43a7-4fea-9b83-98582859c465 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:44.500622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:44.530014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603d991-43a7-4fea-9b83-98582859c465 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:44.563537 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a79fb4-11a6-4181-aee9-604699a3d5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:44.564198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a79fb4-11a6-4181-aee9-604699a3d5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:44.564508 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a79fb4-11a6-4181-aee9-604699a3d5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:44.564781 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a79fb4-11a6-4181-aee9-604699a3d5a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:44.565611 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a79fb4-11a6-4181-aee9-604699a3d5a3 None admin] RBAC: Adding query filter params (role.id=e4ade3cd570d4865b356cbe822b76fe9, scope.project.id=8db5ce99daab4453826ba40d5a7f8d61, user.id=4ebb238bb12341fba1e01dbe8b069d3c) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:44.566025 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a79fb4-11a6-4181-aee9-604699a3d5a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:44.567971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a79fb4-11a6-4181-aee9-604699a3d5a3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:44.575183 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 573/1130] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:06:44 2022] GET /identity/v3/role_assignments?user.id=4ebb238bb12341fba1e01dbe8b069d3c&scope.project.id=8db5ce99daab4453826ba40d5a7f8d61&role.id=e4ade3cd570d4865b356cbe822b76fe9 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:46.589348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15819e8-6ea7-4a98-99b1-999c891b1976 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:46.589860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15819e8-6ea7-4a98-99b1-999c891b1976 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:46.589860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15819e8-6ea7-4a98-99b1-999c891b1976 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:46.591203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 558/1131] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:46.597039 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65da0a-509f-448d-aecc-8c35674a2f17 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:46.597441 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65da0a-509f-448d-aecc-8c35674a2f17 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:46.597597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65da0a-509f-448d-aecc-8c35674a2f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:46.615427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2d65da0a-509f-448d-aecc-8c35674a2f17 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:46.616658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2d65da0a-509f-448d-aecc-8c35674a2f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:46.692766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 574/1132] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:46.716299 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15819e8-6ea7-4a98-99b1-999c891b1976 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:46.727634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:46.820920 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15819e8-6ea7-4a98-99b1-999c891b1976 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:46.856174 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a898c-1ea4-4a73-aa17-c53b86495ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:46.856914 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a898c-1ea4-4a73-aa17-c53b86495ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:46.857196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a898c-1ea4-4a73-aa17-c53b86495ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:46.857477 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a898c-1ea4-4a73-aa17-c53b86495ff3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:46.859426 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a898c-1ea4-4a73-aa17-c53b86495ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:46.860901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a898c-1ea4-4a73-aa17-c53b86495ff3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:46.862543 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 559/1133] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:46.868996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65da0a-509f-448d-aecc-8c35674a2f17 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:46.938636 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:46.975142 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65da0a-509f-448d-aecc-8c35674a2f17 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:47.012113 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c101e-1ac8-4250-a5da-404ae5e85cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:47.012805 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c101e-1ac8-4250-a5da-404ae5e85cf1 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:47.013090 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c101e-1ac8-4250-a5da-404ae5e85cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:47.013367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c101e-1ac8-4250-a5da-404ae5e85cf1 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:47.014075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c101e-1ac8-4250-a5da-404ae5e85cf1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:47.015561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c101e-1ac8-4250-a5da-404ae5e85cf1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:47.048900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 575/1134] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 25 16:06:46 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:06:49.092214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4c38f-a1d2-4e39-9617-63aabce3ec8c None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:49.092214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4c38f-a1d2-4e39-9617-63aabce3ec8c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:49.092214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4c38f-a1d2-4e39-9617-63aabce3ec8c None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:49.093394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 560/1135] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:49.099513 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e0f3a-448b-4b40-8e0a-31f0dd8371cd None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:49.100058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e0f3a-448b-4b40-8e0a-31f0dd8371cd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:49.100058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e0f3a-448b-4b40-8e0a-31f0dd8371cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:49.119708 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8e6e0f3a-448b-4b40-8e0a-31f0dd8371cd None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:49.121036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8e6e0f3a-448b-4b40-8e0a-31f0dd8371cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:49.193393 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 576/1136] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:06:49.218525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4c38f-a1d2-4e39-9617-63aabce3ec8c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:49.302480 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:49.328585 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4c38f-a1d2-4e39-9617-63aabce3ec8c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:49.364151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdb133-f87f-41e6-91e8-0ae43c31b3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:49.364893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdb133-f87f-41e6-91e8-0ae43c31b3bd None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:49.365177 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdb133-f87f-41e6-91e8-0ae43c31b3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:49.365455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdb133-f87f-41e6-91e8-0ae43c31b3bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:49.366665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fdb133-f87f-41e6-91e8-0ae43c31b3bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:49.368116 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fdb133-f87f-41e6-91e8-0ae43c31b3bd None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:49.370147 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 561/1137] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:06:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:49.377005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e0f3a-448b-4b40-8e0a-31f0dd8371cd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:49.429784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:49.493089 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e0f3a-448b-4b40-8e0a-31f0dd8371cd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:49.528632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f316a63-4194-4fd8-85fc-9b754f706634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:49.529315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f316a63-4194-4fd8-85fc-9b754f706634 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:49.529600 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f316a63-4194-4fd8-85fc-9b754f706634 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:49.529883 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f316a63-4194-4fd8-85fc-9b754f706634 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:49.530643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f316a63-4194-4fd8-85fc-9b754f706634 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:49.532197 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f316a63-4194-4fd8-85fc-9b754f706634 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:49.556287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 577/1138] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:06:49 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:06:51.739822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df55f7-42b6-4d90-91fb-596c3dd73035 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:51.740393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df55f7-42b6-4d90-91fb-596c3dd73035 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:51.740393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df55f7-42b6-4d90-91fb-596c3dd73035 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:51.741781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 562/1139] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:51.747088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b38440-9697-49c9-85e1-2566c47da9d1 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:51.747477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b38440-9697-49c9-85e1-2566c47da9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:51.747655 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b38440-9697-49c9-85e1-2566c47da9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:51.766078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-30b38440-9697-49c9-85e1-2566c47da9d1 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:51.767276 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-30b38440-9697-49c9-85e1-2566c47da9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:51.839051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 578/1140] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:06:51.865333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df55f7-42b6-4d90-91fb-596c3dd73035 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:51.970705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df55f7-42b6-4d90-91fb-596c3dd73035 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:52.005850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f8ce6-cbcf-4cb7-9a50-f5b0dc74b5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:52.006564 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f8ce6-cbcf-4cb7-9a50-f5b0dc74b5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:52.006845 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f8ce6-cbcf-4cb7-9a50-f5b0dc74b5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:52.007120 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f8ce6-cbcf-4cb7-9a50-f5b0dc74b5a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:52.018765 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f8ce6-cbcf-4cb7-9a50-f5b0dc74b5a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:06:52.027022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-8e4f8ce6-cbcf-4cb7-9a50-f5b0dc74b5a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:06:52.027022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:52.027022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:52.027022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:52.027022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:52.027022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:52.027022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:52.027022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:52.027022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:52.027022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:52.027022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:52.027022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:52.027022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:06:52.027022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:06:52.027022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:06:52.027022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:06:52.028192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:06:52.028192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:06:52.028192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:06:52.028192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:06:52.028192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:52.028192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:52.028192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:52.028192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:52.028192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:52.028192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:52.028192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:52.028192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:52.028192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:52.028192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:52.028192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:52.028192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:52.029115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:52.029115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:52.029115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:52.029115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:52.029115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:06:52.029115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:06:52.029115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:06:52.029115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:06:52.029115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:06:52.029115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:06:52.029115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:06:52.029115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:52.029115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 563/1141] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:06:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:52.034594 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b38440-9697-49c9-85e1-2566c47da9d1 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:52.069817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:52.143488 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b38440-9697-49c9-85e1-2566c47da9d1 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:52.181723 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ab7d6-4c7c-4a18-a8ad-2c5ecc5e60f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:52.182536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ab7d6-4c7c-4a18-a8ad-2c5ecc5e60f6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:52.182894 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ab7d6-4c7c-4a18-a8ad-2c5ecc5e60f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:52.183206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ab7d6-4c7c-4a18-a8ad-2c5ecc5e60f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:52.184150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ab7d6-4c7c-4a18-a8ad-2c5ecc5e60f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:52.184493 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ab7d6-4c7c-4a18-a8ad-2c5ecc5e60f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:52.186008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ab7d6-4c7c-4a18-a8ad-2c5ecc5e60f6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:52.195751 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 579/1142] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:06:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:52.201727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f8ce6-cbcf-4cb7-9a50-f5b0dc74b5a8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:52.206374 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:52.306356 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f8ce6-cbcf-4cb7-9a50-f5b0dc74b5a8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:52.340900 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71573fff-19ad-4dd7-b3d8-ce9351e310bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:52.341801 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71573fff-19ad-4dd7-b3d8-ce9351e310bb None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:52.342082 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71573fff-19ad-4dd7-b3d8-ce9351e310bb None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:52.342390 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71573fff-19ad-4dd7-b3d8-ce9351e310bb None admin] PATH_INFO: `/v3/users/4ef8d4e1ff384bbca5cffdd20930a163` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:52.356643 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71573fff-19ad-4dd7-b3d8-ce9351e310bb None admin] RBAC: Authorizing `identity:get_user(user_id=4ef8d4e1ff384bbca5cffdd20930a163)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:52.358630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71573fff-19ad-4dd7-b3d8-ce9351e310bb None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:52.360428 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 564/1143] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:06:52 2022] GET /identity/v3/users/4ef8d4e1ff384bbca5cffdd20930a163 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:52.366407 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ab7d6-4c7c-4a18-a8ad-2c5ecc5e60f6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:52.466441 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:52.476841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ab7d6-4c7c-4a18-a8ad-2c5ecc5e60f6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:52.515212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b9f44-8499-4a61-aeb3-d28a3978a133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:52.515862 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b9f44-8499-4a61-aeb3-d28a3978a133 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:52.516143 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b9f44-8499-4a61-aeb3-d28a3978a133 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:52.516445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b9f44-8499-4a61-aeb3-d28a3978a133 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:52.584397 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b9f44-8499-4a61-aeb3-d28a3978a133 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:52.585761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b9f44-8499-4a61-aeb3-d28a3978a133 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:52.676633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:52.683574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 580/1144] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:06:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:06:52.690212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71573fff-19ad-4dd7-b3d8-ce9351e310bb None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:52.754138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:52.810476 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71573fff-19ad-4dd7-b3d8-ce9351e310bb None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:52.848177 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a8788-1b75-4395-8ba5-a55ae2cd28da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:52.849009 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a8788-1b75-4395-8ba5-a55ae2cd28da None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:52.849293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a8788-1b75-4395-8ba5-a55ae2cd28da None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:52.849566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a8788-1b75-4395-8ba5-a55ae2cd28da None admin] PATH_INFO: `/v3/projects/121bfc042f3d47babd472b2313ff9343` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:52.850809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a8788-1b75-4395-8ba5-a55ae2cd28da None admin] RBAC: Authorizing `identity:get_project(project_id=121bfc042f3d47babd472b2313ff9343)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:52.852303 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a8788-1b75-4395-8ba5-a55ae2cd28da None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:52.854086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 565/1145] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:06:52 2022] GET /identity/v3/projects/121bfc042f3d47babd472b2313ff9343 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:52.861150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b9f44-8499-4a61-aeb3-d28a3978a133 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:52.968331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b9f44-8499-4a61-aeb3-d28a3978a133 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:53.005056 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d53bea-0398-489e-bdea-e02cbcbccd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:53.006426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d53bea-0398-489e-bdea-e02cbcbccd73 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:53.006721 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d53bea-0398-489e-bdea-e02cbcbccd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:53.007027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d53bea-0398-489e-bdea-e02cbcbccd73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:53.008617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d53bea-0398-489e-bdea-e02cbcbccd73 None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=121bfc042f3d47babd472b2313ff9343, user.id=4ef8d4e1ff384bbca5cffdd20930a163) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:53.009178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d53bea-0398-489e-bdea-e02cbcbccd73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:53.011873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d53bea-0398-489e-bdea-e02cbcbccd73 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:53.021616 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 581/1146] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:06:52 2022] GET /identity/v3/role_assignments?user.id=4ef8d4e1ff384bbca5cffdd20930a163&scope.project.id=121bfc042f3d47babd472b2313ff9343&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:55.042871 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00e111-ea99-4e43-a07d-7e5a01696c07 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:55.043434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00e111-ea99-4e43-a07d-7e5a01696c07 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:55.043434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00e111-ea99-4e43-a07d-7e5a01696c07 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:55.044927 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 566/1147] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:55.050638 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8197f-0de8-43b0-b8e1-59599748f702 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:55.051096 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8197f-0de8-43b0-b8e1-59599748f702 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:55.051200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8197f-0de8-43b0-b8e1-59599748f702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:55.069909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d3b8197f-0de8-43b0-b8e1-59599748f702 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:55.071106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d3b8197f-0de8-43b0-b8e1-59599748f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:55.129561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:55.142694 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 582/1148] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:06:55.165651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00e111-ea99-4e43-a07d-7e5a01696c07 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:55.270678 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00e111-ea99-4e43-a07d-7e5a01696c07 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:55.299824 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:55.306754 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5c919-3b81-4d11-b0c8-83f9795fa784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:55.307553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5c919-3b81-4d11-b0c8-83f9795fa784 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:55.307837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5c919-3b81-4d11-b0c8-83f9795fa784 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:55.308111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5c919-3b81-4d11-b0c8-83f9795fa784 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:55.319512 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5c919-3b81-4d11-b0c8-83f9795fa784 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:06:55.327830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-12d5c919-3b81-4d11-b0c8-83f9795fa784 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:06:55.327830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:55.327830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:55.327830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:55.327830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:55.327830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:55.327830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:55.327830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:55.327830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:55.327830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:55.327830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:55.327830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:55.327830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:06:55.327830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:06:55.327830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:06:55.327830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:06:55.328893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:06:55.328893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:06:55.328893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:06:55.328893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:06:55.328893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:55.328893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:55.328893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:55.328893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:55.328893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:55.328893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:55.328893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:55.328893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:55.328893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:55.328893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:55.328893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:55.328893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:55.329701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:55.329701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:55.329701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:55.329701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:55.329701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:06:55.329701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:06:55.329701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:06:55.329701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:06:55.329701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:06:55.329701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:06:55.329701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:06:55.329701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:06:55.329701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 567/1149] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:06:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:06:55.335418 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8197f-0de8-43b0-b8e1-59599748f702 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:55.437834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8197f-0de8-43b0-b8e1-59599748f702 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:55.474140 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cffdaf-a168-4169-81de-237ab39fa525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:55.474820 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cffdaf-a168-4169-81de-237ab39fa525 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:55.475107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cffdaf-a168-4169-81de-237ab39fa525 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:55.475382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cffdaf-a168-4169-81de-237ab39fa525 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:55.476131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cffdaf-a168-4169-81de-237ab39fa525 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:55.476473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cffdaf-a168-4169-81de-237ab39fa525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:55.477848 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cffdaf-a168-4169-81de-237ab39fa525 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:55.487710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 583/1150] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:06:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:55.494945 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5c919-3b81-4d11-b0c8-83f9795fa784 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:55.609377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5c919-3b81-4d11-b0c8-83f9795fa784 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:55.646094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b458b-ac21-46d9-9bfe-94691ce38f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:55.646990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b458b-ac21-46d9-9bfe-94691ce38f77 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:55.647275 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b458b-ac21-46d9-9bfe-94691ce38f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:55.647552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b458b-ac21-46d9-9bfe-94691ce38f77 None admin] PATH_INFO: `/v3/users/4ef8d4e1ff384bbca5cffdd20930a163` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:55.648813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b458b-ac21-46d9-9bfe-94691ce38f77 None admin] RBAC: Authorizing `identity:get_user(user_id=4ef8d4e1ff384bbca5cffdd20930a163)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:55.650273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b458b-ac21-46d9-9bfe-94691ce38f77 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:55.652266 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 568/1151] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:06:55 2022] GET /identity/v3/users/4ef8d4e1ff384bbca5cffdd20930a163 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:55.660984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cffdaf-a168-4169-81de-237ab39fa525 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:55.721076 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:55.771139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cffdaf-a168-4169-81de-237ab39fa525 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:55.808940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4a479-b0be-4421-a073-a5bcab0c3348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:55.809827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a479-b0be-4421-a073-a5bcab0c3348 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:55.810112 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a479-b0be-4421-a073-a5bcab0c3348 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:55.810390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a479-b0be-4421-a073-a5bcab0c3348 None admin] PATH_INFO: `/v3/projects/121bfc042f3d47babd472b2313ff9343` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:55.811633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4a479-b0be-4421-a073-a5bcab0c3348 None admin] RBAC: Authorizing `identity:get_project(project_id=121bfc042f3d47babd472b2313ff9343)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:55.813108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4a479-b0be-4421-a073-a5bcab0c3348 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:55.814886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 584/1152] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:06:55 2022] GET /identity/v3/projects/121bfc042f3d47babd472b2313ff9343 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:06:55.821727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b458b-ac21-46d9-9bfe-94691ce38f77 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:55.890294 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:55.946571 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b458b-ac21-46d9-9bfe-94691ce38f77 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:55.982776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b3671-9628-4a87-ae5f-6afb6827b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:55.984340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b3671-9628-4a87-ae5f-6afb6827b9b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:55.984625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b3671-9628-4a87-ae5f-6afb6827b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:55.984906 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b3671-9628-4a87-ae5f-6afb6827b9b7 None admin] PATH_INFO: `/v3/projects/121bfc042f3d47babd472b2313ff9343/users/4ef8d4e1ff384bbca5cffdd20930a163/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:55.986998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b3671-9628-4a87-ae5f-6afb6827b9b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=121bfc042f3d47babd472b2313ff9343, user_id=4ef8d4e1ff384bbca5cffdd20930a163, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:55.988495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b3671-9628-4a87-ae5f-6afb6827b9b7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:56.005333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 569/1153] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:06:55 2022] PUT /identity/v3/projects/121bfc042f3d47babd472b2313ff9343/users/4ef8d4e1ff384bbca5cffdd20930a163/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:06:58.116612 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3ce38-5ed1-4d6c-a150-dead056a17fb None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:58.117178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3ce38-5ed1-4d6c-a150-dead056a17fb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:58.117303 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3ce38-5ed1-4d6c-a150-dead056a17fb None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:58.118847 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 585/1154] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:06:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:06:58.125238 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555b5e0-1b68-40d0-8d5c-48fb0230869a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:58.125996 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555b5e0-1b68-40d0-8d5c-48fb0230869a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:58.126149 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555b5e0-1b68-40d0-8d5c-48fb0230869a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:58.145460 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a555b5e0-1b68-40d0-8d5c-48fb0230869a None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:06:58.146674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a555b5e0-1b68-40d0-8d5c-48fb0230869a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:06:58.219366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 570/1155] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:06:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:06:58.242862 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3ce38-5ed1-4d6c-a150-dead056a17fb None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:58.361598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3ce38-5ed1-4d6c-a150-dead056a17fb None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:58.385286 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:58.400890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbfb28-7cfd-476c-bdaf-082b06bc44d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:58.401964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbfb28-7cfd-476c-bdaf-082b06bc44d8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:58.402250 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbfb28-7cfd-476c-bdaf-082b06bc44d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:58.402528 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbfb28-7cfd-476c-bdaf-082b06bc44d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:58.413813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbfb28-7cfd-476c-bdaf-082b06bc44d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:06:58.422210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-0abbfb28-7cfd-476c-bdaf-082b06bc44d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:06:58.422210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:06:58.422210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:06:58.422210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:06:58.422210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:06:58.422210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:06:58.422210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:06:58.422210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:06:58.422210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:06:58.422210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:06:58.422210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:06:58.422210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:06:58.422210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:06:58.422210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:06:58.422210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:06:58.422210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:06:58.424083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:06:58.424083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:06:58.424083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:06:58.424083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:06:58.424083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:06:58.424083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:06:58.424083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:06:58.424083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:06:58.424083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:06:58.424083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:06:58.424083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:06:58.424083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:06:58.424083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:06:58.424083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:06:58.424083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:06:58.424083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:06:58.425815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:06:58.425815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:06:58.425815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:06:58.425815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:06:58.425815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:06:58.425815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:06:58.425815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:06:58.425815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:06:58.425815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:06:58.425815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:06:58.425815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:06:58.425815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:06:58.425815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 586/1156] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:06:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:06:58.429923 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555b5e0-1b68-40d0-8d5c-48fb0230869a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:58.481958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:58.536439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555b5e0-1b68-40d0-8d5c-48fb0230869a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:58.574424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d240358-e6e1-40c7-88d2-fd629880c8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:58.575106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240358-e6e1-40c7-88d2-fd629880c8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:58.575382 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240358-e6e1-40c7-88d2-fd629880c8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:58.575650 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d240358-e6e1-40c7-88d2-fd629880c8e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:58.576497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d240358-e6e1-40c7-88d2-fd629880c8e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:58.576792 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d240358-e6e1-40c7-88d2-fd629880c8e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:58.578180 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d240358-e6e1-40c7-88d2-fd629880c8e0 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:58.587095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 571/1157] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:06:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:58.593480 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbfb28-7cfd-476c-bdaf-082b06bc44d8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:58.702824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbfb28-7cfd-476c-bdaf-082b06bc44d8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:58.740899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b32865-84bb-4a29-bcb3-fbe9d607bc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:58.741795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b32865-84bb-4a29-bcb3-fbe9d607bc23 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:58.742077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b32865-84bb-4a29-bcb3-fbe9d607bc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:58.742367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b32865-84bb-4a29-bcb3-fbe9d607bc23 None admin] PATH_INFO: `/v3/users/4ef8d4e1ff384bbca5cffdd20930a163` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:58.743651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b32865-84bb-4a29-bcb3-fbe9d607bc23 None admin] RBAC: Authorizing `identity:get_user(user_id=4ef8d4e1ff384bbca5cffdd20930a163)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:58.745140 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b32865-84bb-4a29-bcb3-fbe9d607bc23 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:58.746881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 587/1158] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:06:58 2022] GET /identity/v3/users/4ef8d4e1ff384bbca5cffdd20930a163 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:58.753090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d240358-e6e1-40c7-88d2-fd629880c8e0 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:58.874988 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d240358-e6e1-40c7-88d2-fd629880c8e0 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:58.887431 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:58.914701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c5712-ff0b-4634-989a-c0b69acb920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:58.915459 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c5712-ff0b-4634-989a-c0b69acb920f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:58.915748 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c5712-ff0b-4634-989a-c0b69acb920f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:58.916072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c5712-ff0b-4634-989a-c0b69acb920f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:58.992796 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c5712-ff0b-4634-989a-c0b69acb920f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:58.994195 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c5712-ff0b-4634-989a-c0b69acb920f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:59.100907 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 572/1159] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:06:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:06:59.107021 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b32865-84bb-4a29-bcb3-fbe9d607bc23 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:59.161214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:59.215735 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b32865-84bb-4a29-bcb3-fbe9d607bc23 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:59.254556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e69b6a-a0b9-494b-b12c-1a7005489dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:59.255349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e69b6a-a0b9-494b-b12c-1a7005489dbe None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:59.255634 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e69b6a-a0b9-494b-b12c-1a7005489dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:59.255908 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e69b6a-a0b9-494b-b12c-1a7005489dbe None admin] PATH_INFO: `/v3/projects/121bfc042f3d47babd472b2313ff9343` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:59.257182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e69b6a-a0b9-494b-b12c-1a7005489dbe None admin] RBAC: Authorizing `identity:get_project(project_id=121bfc042f3d47babd472b2313ff9343)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:59.258618 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e69b6a-a0b9-494b-b12c-1a7005489dbe None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:59.260375 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 588/1160] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:06:59 2022] GET /identity/v3/projects/121bfc042f3d47babd472b2313ff9343 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:06:59.267555 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c5712-ff0b-4634-989a-c0b69acb920f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:06:59.280947 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:06:59.373761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c5712-ff0b-4634-989a-c0b69acb920f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:06:59.410826 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f838bc4-4028-4ac6-994f-2d340cea7426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:06:59.411492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f838bc4-4028-4ac6-994f-2d340cea7426 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:06:59.411782 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f838bc4-4028-4ac6-994f-2d340cea7426 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:06:59.412061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f838bc4-4028-4ac6-994f-2d340cea7426 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:06:59.412931 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f838bc4-4028-4ac6-994f-2d340cea7426 None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=121bfc042f3d47babd472b2313ff9343, user.id=4ef8d4e1ff384bbca5cffdd20930a163) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:06:59.413246 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f838bc4-4028-4ac6-994f-2d340cea7426 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:06:59.414690 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f838bc4-4028-4ac6-994f-2d340cea7426 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:06:59.421026 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 573/1161] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:06:59 2022] GET /identity/v3/role_assignments?user.id=4ef8d4e1ff384bbca5cffdd20930a163&scope.project.id=121bfc042f3d47babd472b2313ff9343&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:07:01.497158 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524731c-c4fe-4b87-a1cd-de2720ce2d12 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:01.497779 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524731c-c4fe-4b87-a1cd-de2720ce2d12 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:01.497779 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524731c-c4fe-4b87-a1cd-de2720ce2d12 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:01.499215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 589/1162] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:07:01.505160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5560ea-cd09-4183-b64b-fe421a31b676 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:01.505681 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5560ea-cd09-4183-b64b-fe421a31b676 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:01.505681 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5560ea-cd09-4183-b64b-fe421a31b676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:01.524627 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-bd5560ea-cd09-4183-b64b-fe421a31b676 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:07:01.525831 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bd5560ea-cd09-4183-b64b-fe421a31b676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:07:01.607394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 574/1163] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:07:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:07:01.631436 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524731c-c4fe-4b87-a1cd-de2720ce2d12 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:01.748728 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524731c-c4fe-4b87-a1cd-de2720ce2d12 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:01.768981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:01.802385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28730dd4-68b3-4677-812d-b220cfc6a00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:01.803109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28730dd4-68b3-4677-812d-b220cfc6a00d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:01.803359 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28730dd4-68b3-4677-812d-b220cfc6a00d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:01.803637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28730dd4-68b3-4677-812d-b220cfc6a00d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:01.884489 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28730dd4-68b3-4677-812d-b220cfc6a00d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:01.886186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28730dd4-68b3-4677-812d-b220cfc6a00d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:02.000881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 590/1164] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:07:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:07:02.007463 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5560ea-cd09-4183-b64b-fe421a31b676 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:02.010752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:02.123701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5560ea-cd09-4183-b64b-fe421a31b676 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:02.168546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf3773-f282-41c0-8e89-c59161967339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:02.169431 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf3773-f282-41c0-8e89-c59161967339 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:02.169719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf3773-f282-41c0-8e89-c59161967339 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:02.169996 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf3773-f282-41c0-8e89-c59161967339 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:02.178523 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf3773-f282-41c0-8e89-c59161967339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:02.180040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf3773-f282-41c0-8e89-c59161967339 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-7ccf3773-f282-41c0-8e89-c59161967339 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:07:02.195626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:07:02.197003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:07:02.197003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:07:02.197003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:07:02.197003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:07:02.197003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:07:02.197003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:07:02.197003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:07:02.197003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:07:02.197003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:07:02.197003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:07:02.197003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:07:02.197003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:07:02.197003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:07:02.197003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:07:02.197003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:07:02.197003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:07:02.197987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:07:02.197987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:07:02.197987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:07:02.197987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:07:02.197987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:07:02.197987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:07:02.197987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:07:02.197987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:07:02.197987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:07:02.197987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:07:02.197987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 25 16:07:02.197987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:07:02.197987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 16:07:02.197987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:07:02.197987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 575/1165] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 25 16:07:02 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:07:02.203967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28730dd4-68b3-4677-812d-b220cfc6a00d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:02.223399 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:02.321701 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28730dd4-68b3-4677-812d-b220cfc6a00d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:02.366108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f87e21-2625-41b5-a9cf-47423ac7b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:02.366799 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f87e21-2625-41b5-a9cf-47423ac7b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:02.367091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f87e21-2625-41b5-a9cf-47423ac7b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:02.367419 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f87e21-2625-41b5-a9cf-47423ac7b9b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:02.368162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f87e21-2625-41b5-a9cf-47423ac7b9b7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:07:02.368511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f87e21-2625-41b5-a9cf-47423ac7b9b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:02.369917 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f87e21-2625-41b5-a9cf-47423ac7b9b7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:02.378185 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 591/1166] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Jul 25 16:07:02 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:07:04.668202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52761d7-ca8a-4c67-9af8-2a72f8c1ea74 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:04.668746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52761d7-ca8a-4c67-9af8-2a72f8c1ea74 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:04.668746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52761d7-ca8a-4c67-9af8-2a72f8c1ea74 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:04.670675 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 576/1167] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:07:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:07:04.676059 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f72ff-0800-486a-a551-44aa13b3336f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:04.676553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f72ff-0800-486a-a551-44aa13b3336f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:04.676650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f72ff-0800-486a-a551-44aa13b3336f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:04.694491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9d8f72ff-0800-486a-a551-44aa13b3336f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:07:04.695677 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9d8f72ff-0800-486a-a551-44aa13b3336f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:07:04.762779 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 592/1168] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:07:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:07:04.786084 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52761d7-ca8a-4c67-9af8-2a72f8c1ea74 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:04.851983 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:04.900990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52761d7-ca8a-4c67-9af8-2a72f8c1ea74 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:04.936171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd52d33-9591-4b04-b5ba-7efabcea8c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:04.936874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd52d33-9591-4b04-b5ba-7efabcea8c12 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:04.937165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd52d33-9591-4b04-b5ba-7efabcea8c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:04.937444 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd52d33-9591-4b04-b5ba-7efabcea8c12 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:04.938182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd52d33-9591-4b04-b5ba-7efabcea8c12 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:04.939587 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd52d33-9591-4b04-b5ba-7efabcea8c12 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:04.957095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 577/1169] 10.222.0.70 () {60 vars in 1138 bytes} [Mon Jul 25 16:07:04 2022] POST /identity/v3/domains => generated 267 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:07:07.037909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed0a57-a6cf-4875-996c-b88053f3f49b None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:07.038478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed0a57-a6cf-4875-996c-b88053f3f49b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:07.038577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed0a57-a6cf-4875-996c-b88053f3f49b None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:07.040182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 593/1170] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:07:07.047504 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b5523-379f-4d8e-ae64-9d7cc48638cf None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:07.048015 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b5523-379f-4d8e-ae64-9d7cc48638cf None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:07.048131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b5523-379f-4d8e-ae64-9d7cc48638cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:07.070861 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3c3b5523-379f-4d8e-ae64-9d7cc48638cf None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:07:07.072432 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3c3b5523-379f-4d8e-ae64-9d7cc48638cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:07:07.149167 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 578/1171] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:07:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:07:07.172386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed0a57-a6cf-4875-996c-b88053f3f49b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:07.184493 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:07.290611 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed0a57-a6cf-4875-996c-b88053f3f49b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:07.328210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a84b8-60f2-4cfe-8c4e-191af9973ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:07.329086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a84b8-60f2-4cfe-8c4e-191af9973ace None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:07.329368 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a84b8-60f2-4cfe-8c4e-191af9973ace None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:07.329645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a84b8-60f2-4cfe-8c4e-191af9973ace None admin] PATH_INFO: `/v3/domains/3b8c05ea400744c597407bc2cfa3af41` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:07.339664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a84b8-60f2-4cfe-8c4e-191af9973ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=3b8c05ea400744c597407bc2cfa3af41)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:07.341124 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a84b8-60f2-4cfe-8c4e-191af9973ace None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:07.342762 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 594/1172] 10.222.0.70 () {56 vars in 1183 bytes} [Mon Jul 25 16:07:07 2022] GET /identity/v3/domains/3b8c05ea400744c597407bc2cfa3af41 => generated 267 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:07:07.348799 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b5523-379f-4d8e-ae64-9d7cc48638cf None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:07.402229 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:07.445653 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b5523-379f-4d8e-ae64-9d7cc48638cf None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:07.477373 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794a7e1-0082-4629-8e15-f2b1ac440ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:07.478028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794a7e1-0082-4629-8e15-f2b1ac440ca9 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:07.478308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794a7e1-0082-4629-8e15-f2b1ac440ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:07.478583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794a7e1-0082-4629-8e15-f2b1ac440ca9 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:07.479282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794a7e1-0082-4629-8e15-f2b1ac440ca9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:07.480735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794a7e1-0082-4629-8e15-f2b1ac440ca9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:07.507631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 579/1173] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 25 16:07:07 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:07:09.543128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215237-6412-4cac-aabe-1517cd7d9414 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:09.543633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215237-6412-4cac-aabe-1517cd7d9414 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:09.543633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215237-6412-4cac-aabe-1517cd7d9414 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:09.544968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 595/1174] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:07:09.550035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57a37d-ee1f-4be1-bc7f-2e4ba36e2ee0 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:09.550520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57a37d-ee1f-4be1-bc7f-2e4ba36e2ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:09.550626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57a37d-ee1f-4be1-bc7f-2e4ba36e2ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:09.568869 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-4b57a37d-ee1f-4be1-bc7f-2e4ba36e2ee0 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:07:09.570051 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4b57a37d-ee1f-4be1-bc7f-2e4ba36e2ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:07:09.634096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 580/1175] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:07:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:07:09.658484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21215237-6412-4cac-aabe-1517cd7d9414 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:09.727280 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:09.759635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21215237-6412-4cac-aabe-1517cd7d9414 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:09.792436 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29856d01-1636-422b-b9be-3cb3ab6d698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:09.793341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856d01-1636-422b-b9be-3cb3ab6d698e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:09.793571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856d01-1636-422b-b9be-3cb3ab6d698e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:09.793844 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29856d01-1636-422b-b9be-3cb3ab6d698e None admin] PATH_INFO: `/v3/domains/3b8c05ea400744c597407bc2cfa3af41` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:09.795539 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29856d01-1636-422b-b9be-3cb3ab6d698e None admin] RBAC: Authorizing `identity:get_domain(domain_id=3b8c05ea400744c597407bc2cfa3af41)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:09.796994 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29856d01-1636-422b-b9be-3cb3ab6d698e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:09.798599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 596/1176] 10.222.0.70 () {56 vars in 1183 bytes} [Mon Jul 25 16:07:09 2022] GET /identity/v3/domains/3b8c05ea400744c597407bc2cfa3af41 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:07:09.804709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57a37d-ee1f-4be1-bc7f-2e4ba36e2ee0 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:09.837730 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:09.901981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57a37d-ee1f-4be1-bc7f-2e4ba36e2ee0 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:09.934719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea41801-f595-4fd2-82fb-e09c021b897c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:09.935386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea41801-f595-4fd2-82fb-e09c021b897c None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:09.936175 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea41801-f595-4fd2-82fb-e09c021b897c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:09.936475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea41801-f595-4fd2-82fb-e09c021b897c None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:09.937180 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea41801-f595-4fd2-82fb-e09c021b897c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:09.938607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea41801-f595-4fd2-82fb-e09c021b897c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:09.960068 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 581/1177] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:07:09 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:07:12.000891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2e741-ba5e-49d0-ac87-effb682eb4fd None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:12.001422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2e741-ba5e-49d0-ac87-effb682eb4fd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:12.001422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2e741-ba5e-49d0-ac87-effb682eb4fd None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:12.002813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 597/1178] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:07:12.007834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a3f7e-0563-462a-bfc2-f0abf71b2753 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:12.008230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a3f7e-0563-462a-bfc2-f0abf71b2753 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:12.008433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a3f7e-0563-462a-bfc2-f0abf71b2753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:12.027352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-538a3f7e-0563-462a-bfc2-f0abf71b2753 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:07:12.028990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-538a3f7e-0563-462a-bfc2-f0abf71b2753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:07:12.102689 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 582/1179] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:07:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:07:12.126845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2e741-ba5e-49d0-ac87-effb682eb4fd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:12.245959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2e741-ba5e-49d0-ac87-effb682eb4fd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:12.294263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c5026-0f2e-4410-b173-cf3fac1e0da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:12.295390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c5026-0f2e-4410-b173-cf3fac1e0da3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:12.295806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c5026-0f2e-4410-b173-cf3fac1e0da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:12.296231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c5026-0f2e-4410-b173-cf3fac1e0da3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:12.305597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:12.311650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c5026-0f2e-4410-b173-cf3fac1e0da3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:07:12.319574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f26c5026-0f2e-4410-b173-cf3fac1e0da3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:07:12.319574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:07:12.319574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:07:12.319574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:07:12.319574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:07:12.319574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:07:12.319574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:07:12.319574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:07:12.319574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:07:12.319574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:07:12.319574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:07:12.319574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:07:12.319574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:07:12.319574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:07:12.319574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:07:12.319574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:07:12.320725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:07:12.320725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:07:12.320725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:07:12.320725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:07:12.320725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:07:12.320725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:07:12.320725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:07:12.320725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:07:12.320725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:07:12.320725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:07:12.320725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:07:12.320725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:07:12.320725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:07:12.320725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:07:12.320725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:07:12.320725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:07:12.321747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:07:12.321747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:07:12.321747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:07:12.321747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:07:12.321747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:07:12.321747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:07:12.321747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:07:12.321747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:07:12.321747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:07:12.321747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:07:12.321747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:07:12.321747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:07:12.321747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 598/1180] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:07:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:07:12.327673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a3f7e-0563-462a-bfc2-f0abf71b2753 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:12.350623 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:12.424370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a3f7e-0563-462a-bfc2-f0abf71b2753 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:12.462967 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa76eed-e2ad-48f9-a87a-a8250eaa944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:12.463634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa76eed-e2ad-48f9-a87a-a8250eaa944f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:12.463917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa76eed-e2ad-48f9-a87a-a8250eaa944f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:12.464191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa76eed-e2ad-48f9-a87a-a8250eaa944f None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:12.465032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa76eed-e2ad-48f9-a87a-a8250eaa944f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:07:12.465337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa76eed-e2ad-48f9-a87a-a8250eaa944f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:12.466727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa76eed-e2ad-48f9-a87a-a8250eaa944f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:12.475301 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 583/1181] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:07:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:07:12.481248 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c5026-0f2e-4410-b173-cf3fac1e0da3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:12.586460 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c5026-0f2e-4410-b173-cf3fac1e0da3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:12.627882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d818e2-69f8-40bc-87a3-c8fd62234594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:12.629128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d818e2-69f8-40bc-87a3-c8fd62234594 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:12.629411 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d818e2-69f8-40bc-87a3-c8fd62234594 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:12.629686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d818e2-69f8-40bc-87a3-c8fd62234594 None admin] PATH_INFO: `/v3/users/6fdd5910853a4b72b7996d3aa77ab426` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:12.643557 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d818e2-69f8-40bc-87a3-c8fd62234594 None admin] RBAC: Authorizing `identity:get_user(user_id=6fdd5910853a4b72b7996d3aa77ab426)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:12.645098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d818e2-69f8-40bc-87a3-c8fd62234594 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:12.646765 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 599/1182] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:07:12 2022] GET /identity/v3/users/6fdd5910853a4b72b7996d3aa77ab426 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:07:12.653266 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa76eed-e2ad-48f9-a87a-a8250eaa944f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:12.737598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:12.752768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa76eed-e2ad-48f9-a87a-a8250eaa944f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:12.786692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f6107-f750-4a73-858b-db9792ac7eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:12.787338 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6107-f750-4a73-858b-db9792ac7eed None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:12.787622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6107-f750-4a73-858b-db9792ac7eed None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:12.787899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6107-f750-4a73-858b-db9792ac7eed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:12.853749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f6107-f750-4a73-858b-db9792ac7eed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:12.855118 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f6107-f750-4a73-858b-db9792ac7eed None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:12.939286 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:12.956674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 584/1183] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:07:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:07:12.962718 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d818e2-69f8-40bc-87a3-c8fd62234594 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:13.026374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:13.074574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d818e2-69f8-40bc-87a3-c8fd62234594 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:13.108453 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707d8c9-6923-4c88-9924-7c19d30b7646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:13.109243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707d8c9-6923-4c88-9924-7c19d30b7646 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:13.109524 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707d8c9-6923-4c88-9924-7c19d30b7646 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:13.109803 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707d8c9-6923-4c88-9924-7c19d30b7646 None admin] PATH_INFO: `/v3/projects/594deb2796d94f0b8ddc512ce4aa7ea0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:13.111007 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707d8c9-6923-4c88-9924-7c19d30b7646 None admin] RBAC: Authorizing `identity:get_project(project_id=594deb2796d94f0b8ddc512ce4aa7ea0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:13.112473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707d8c9-6923-4c88-9924-7c19d30b7646 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:13.114184 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 600/1184] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:07:12 2022] GET /identity/v3/projects/594deb2796d94f0b8ddc512ce4aa7ea0 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:07:13.120454 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f6107-f750-4a73-858b-db9792ac7eed None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:13.217503 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f6107-f750-4a73-858b-db9792ac7eed None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:13.251790 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b4b84-a282-4f80-bda9-8b83bee919a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:13.252527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b4b84-a282-4f80-bda9-8b83bee919a1 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:13.252860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b4b84-a282-4f80-bda9-8b83bee919a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:13.253143 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b4b84-a282-4f80-bda9-8b83bee919a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:13.253963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b4b84-a282-4f80-bda9-8b83bee919a1 None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=594deb2796d94f0b8ddc512ce4aa7ea0, user.id=6fdd5910853a4b72b7996d3aa77ab426) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:07:13.254280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b4b84-a282-4f80-bda9-8b83bee919a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:13.255710 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b4b84-a282-4f80-bda9-8b83bee919a1 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:13.261299 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 585/1185] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:07:13 2022] GET /identity/v3/role_assignments?user.id=6fdd5910853a4b72b7996d3aa77ab426&scope.project.id=594deb2796d94f0b8ddc512ce4aa7ea0&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:07:15.264188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26657dc-abc7-414a-9111-9a02f698f6e2 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:15.264744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26657dc-abc7-414a-9111-9a02f698f6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:15.264849 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26657dc-abc7-414a-9111-9a02f698f6e2 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:15.266302 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 601/1186] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:07:15.271513 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6c2a7-8012-4c52-9193-d9a7a25a9d29 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:15.271934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6c2a7-8012-4c52-9193-d9a7a25a9d29 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:15.272073 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6c2a7-8012-4c52-9193-d9a7a25a9d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:15.290058 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a6a6c2a7-8012-4c52-9193-d9a7a25a9d29 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:07:15.291252 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a6a6c2a7-8012-4c52-9193-d9a7a25a9d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:07:15.334091 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:15.356624 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 586/1187] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:07:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:07:15.378759 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26657dc-abc7-414a-9111-9a02f698f6e2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:15.479440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26657dc-abc7-414a-9111-9a02f698f6e2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:15.502390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:15.513121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010d61b-1809-453e-967b-7ca9e07a5a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:15.514528 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010d61b-1809-453e-967b-7ca9e07a5a15 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:15.514891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010d61b-1809-453e-967b-7ca9e07a5a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:15.515095 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010d61b-1809-453e-967b-7ca9e07a5a15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:15.525004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010d61b-1809-453e-967b-7ca9e07a5a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:07:15.532871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-3010d61b-1809-453e-967b-7ca9e07a5a15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:07:15.532871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:07:15.532871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:07:15.532871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:07:15.532871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:07:15.532871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:07:15.532871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:07:15.532871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:07:15.532871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:07:15.532871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:07:15.532871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:07:15.532871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:07:15.532871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:07:15.532871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:07:15.532871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:07:15.532871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:07:15.533973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:07:15.533973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:07:15.533973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:07:15.533973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:07:15.533973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:07:15.533973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:07:15.533973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:07:15.533973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:07:15.533973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:07:15.533973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:07:15.533973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:07:15.533973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:07:15.533973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:07:15.533973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:07:15.533973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:07:15.533973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:07:15.534836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:07:15.534836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:07:15.534836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:07:15.534836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:07:15.534836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:07:15.534836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:07:15.534836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:07:15.534836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:07:15.534836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:07:15.534836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:07:15.534836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:07:15.534836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:07:15.534836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 602/1188] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:07:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:07:15.540063 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6c2a7-8012-4c52-9193-d9a7a25a9d29 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:15.634707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6c2a7-8012-4c52-9193-d9a7a25a9d29 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:15.666771 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320566e8-02ee-427c-ac44-f6dcfc3a3d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:15.667421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320566e8-02ee-427c-ac44-f6dcfc3a3d4e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:15.667699 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320566e8-02ee-427c-ac44-f6dcfc3a3d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:15.667972 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320566e8-02ee-427c-ac44-f6dcfc3a3d4e None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:15.668728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320566e8-02ee-427c-ac44-f6dcfc3a3d4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:07:15.669027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320566e8-02ee-427c-ac44-f6dcfc3a3d4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:15.670961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320566e8-02ee-427c-ac44-f6dcfc3a3d4e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:15.678725 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 587/1189] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:07:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:07:15.684506 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010d61b-1809-453e-967b-7ca9e07a5a15 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:15.783174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010d61b-1809-453e-967b-7ca9e07a5a15 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:15.814891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca77914-5f6f-4a49-bdfb-545395b66c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:15.815760 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca77914-5f6f-4a49-bdfb-545395b66c49 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:15.816045 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca77914-5f6f-4a49-bdfb-545395b66c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:15.816490 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca77914-5f6f-4a49-bdfb-545395b66c49 None admin] PATH_INFO: `/v3/users/6fdd5910853a4b72b7996d3aa77ab426` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:15.817668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca77914-5f6f-4a49-bdfb-545395b66c49 None admin] RBAC: Authorizing `identity:get_user(user_id=6fdd5910853a4b72b7996d3aa77ab426)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:15.819086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca77914-5f6f-4a49-bdfb-545395b66c49 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:15.820733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 603/1190] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:07:15 2022] GET /identity/v3/users/6fdd5910853a4b72b7996d3aa77ab426 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:07:15.827029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320566e8-02ee-427c-ac44-f6dcfc3a3d4e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:15.867223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:15.924102 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320566e8-02ee-427c-ac44-f6dcfc3a3d4e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:15.956943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3d9f4-bc56-4134-8f97-095170a5671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:15.957834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3d9f4-bc56-4134-8f97-095170a5671e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:15.958115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3d9f4-bc56-4134-8f97-095170a5671e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:15.958383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3d9f4-bc56-4134-8f97-095170a5671e None admin] PATH_INFO: `/v3/projects/594deb2796d94f0b8ddc512ce4aa7ea0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:15.959541 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3d9f4-bc56-4134-8f97-095170a5671e None admin] RBAC: Authorizing `identity:get_project(project_id=594deb2796d94f0b8ddc512ce4aa7ea0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:15.961001 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3d9f4-bc56-4134-8f97-095170a5671e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:15.962690 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 588/1191] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:07:15 2022] GET /identity/v3/projects/594deb2796d94f0b8ddc512ce4aa7ea0 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:07:15.969294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca77914-5f6f-4a49-bdfb-545395b66c49 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:16.020660 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:16.069651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca77914-5f6f-4a49-bdfb-545395b66c49 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:16.103061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b20fb2-3cb1-4533-b83a-43bcd295fd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:16.104071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b20fb2-3cb1-4533-b83a-43bcd295fd14 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:16.104401 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b20fb2-3cb1-4533-b83a-43bcd295fd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:16.104722 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b20fb2-3cb1-4533-b83a-43bcd295fd14 None admin] PATH_INFO: `/v3/projects/594deb2796d94f0b8ddc512ce4aa7ea0/users/6fdd5910853a4b72b7996d3aa77ab426/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:16.106844 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b20fb2-3cb1-4533-b83a-43bcd295fd14 None admin] RBAC: Authorizing `identity:create_grant(project_id=594deb2796d94f0b8ddc512ce4aa7ea0, user_id=6fdd5910853a4b72b7996d3aa77ab426, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:16.109088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b20fb2-3cb1-4533-b83a-43bcd295fd14 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:16.123271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 604/1192] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:07:15 2022] PUT /identity/v3/projects/594deb2796d94f0b8ddc512ce4aa7ea0/users/6fdd5910853a4b72b7996d3aa77ab426/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:07:18.179683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe8d69-7850-4cc4-935f-0e9c692bdd5a None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:18.180209 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe8d69-7850-4cc4-935f-0e9c692bdd5a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:18.180441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe8d69-7850-4cc4-935f-0e9c692bdd5a None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:18.181644 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 589/1193] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:07:18.187356 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565ad8d-114d-47b1-803b-bc2cb2942f36 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:18.187739 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565ad8d-114d-47b1-803b-bc2cb2942f36 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:18.187927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565ad8d-114d-47b1-803b-bc2cb2942f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:18.205725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6565ad8d-114d-47b1-803b-bc2cb2942f36 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:07:18.206960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6565ad8d-114d-47b1-803b-bc2cb2942f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:07:18.273153 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 605/1194] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:07:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:07:18.299588 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe8d69-7850-4cc4-935f-0e9c692bdd5a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:18.398714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe8d69-7850-4cc4-935f-0e9c692bdd5a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:18.408852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:18.433606 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079891d5-e04a-4a2c-8c16-9cf8ff2db586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:18.434399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079891d5-e04a-4a2c-8c16-9cf8ff2db586 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:18.434685 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079891d5-e04a-4a2c-8c16-9cf8ff2db586 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:18.434963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079891d5-e04a-4a2c-8c16-9cf8ff2db586 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:18.444943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079891d5-e04a-4a2c-8c16-9cf8ff2db586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:07:18.452620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-079891d5-e04a-4a2c-8c16-9cf8ff2db586 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:07:18.452620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:07:18.452620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:07:18.452620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:07:18.452620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:07:18.452620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:07:18.452620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:07:18.452620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:07:18.452620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:07:18.452620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:07:18.452620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:07:18.452620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:07:18.452620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:07:18.452620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:07:18.452620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:07:18.452620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:07:18.453665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:07:18.453665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:07:18.453665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:07:18.453665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:07:18.453665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:07:18.453665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:07:18.453665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:07:18.453665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:07:18.453665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:07:18.453665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:07:18.453665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:07:18.453665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:07:18.453665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:07:18.453665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:07:18.453665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:07:18.453665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:07:18.454702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:07:18.454702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:07:18.454702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:07:18.454702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:07:18.454702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:07:18.454702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:07:18.454702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:07:18.454702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:07:18.454702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:07:18.454702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:07:18.454702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:07:18.454702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:07:18.454702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 590/1195] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:07:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:07:18.459958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565ad8d-114d-47b1-803b-bc2cb2942f36 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:18.502031 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:18.556512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565ad8d-114d-47b1-803b-bc2cb2942f36 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:18.590447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f816578-f0ce-47ff-a9d0-637d1cf3d92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:18.591111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f816578-f0ce-47ff-a9d0-637d1cf3d92c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:18.591421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f816578-f0ce-47ff-a9d0-637d1cf3d92c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:18.591703 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f816578-f0ce-47ff-a9d0-637d1cf3d92c None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:18.592470 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f816578-f0ce-47ff-a9d0-637d1cf3d92c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:07:18.592780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f816578-f0ce-47ff-a9d0-637d1cf3d92c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:18.594146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f816578-f0ce-47ff-a9d0-637d1cf3d92c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:18.602003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 606/1196] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:07:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:07:18.608393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079891d5-e04a-4a2c-8c16-9cf8ff2db586 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:18.703909 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079891d5-e04a-4a2c-8c16-9cf8ff2db586 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:18.735563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae519a8-f2c9-445c-9456-4bed47d3fd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:18.736443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae519a8-f2c9-445c-9456-4bed47d3fd1d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:18.736730 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae519a8-f2c9-445c-9456-4bed47d3fd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:18.737003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae519a8-f2c9-445c-9456-4bed47d3fd1d None admin] PATH_INFO: `/v3/users/6fdd5910853a4b72b7996d3aa77ab426` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:18.738157 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae519a8-f2c9-445c-9456-4bed47d3fd1d None admin] RBAC: Authorizing `identity:get_user(user_id=6fdd5910853a4b72b7996d3aa77ab426)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:18.739579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae519a8-f2c9-445c-9456-4bed47d3fd1d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:18.741219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 591/1197] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Jul 25 16:07:18 2022] GET /identity/v3/users/6fdd5910853a4b72b7996d3aa77ab426 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:07:18.747007 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f816578-f0ce-47ff-a9d0-637d1cf3d92c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:18.844047 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f816578-f0ce-47ff-a9d0-637d1cf3d92c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:18.846290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:18.877109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d3ed1-c40d-440d-8dd5-c2646c58c515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:18.877781 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d3ed1-c40d-440d-8dd5-c2646c58c515 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:18.878082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d3ed1-c40d-440d-8dd5-c2646c58c515 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:18.878372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d3ed1-c40d-440d-8dd5-c2646c58c515 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:18.943747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d3ed1-c40d-440d-8dd5-c2646c58c515 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:18.945242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d3ed1-c40d-440d-8dd5-c2646c58c515 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:19.041496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 607/1198] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:07:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:07:19.047488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae519a8-f2c9-445c-9456-4bed47d3fd1d None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:19.086369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:19.151311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae519a8-f2c9-445c-9456-4bed47d3fd1d None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:19.184078 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06151e8-38f1-4892-84f9-6fde0de07146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:19.184969 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06151e8-38f1-4892-84f9-6fde0de07146 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:19.185789 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06151e8-38f1-4892-84f9-6fde0de07146 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:19.186063 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06151e8-38f1-4892-84f9-6fde0de07146 None admin] PATH_INFO: `/v3/projects/594deb2796d94f0b8ddc512ce4aa7ea0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:19.187230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06151e8-38f1-4892-84f9-6fde0de07146 None admin] RBAC: Authorizing `identity:get_project(project_id=594deb2796d94f0b8ddc512ce4aa7ea0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:19.188697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06151e8-38f1-4892-84f9-6fde0de07146 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:19.190383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 592/1199] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Jul 25 16:07:19 2022] GET /identity/v3/projects/594deb2796d94f0b8ddc512ce4aa7ea0 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:07:19.196608 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d3ed1-c40d-440d-8dd5-c2646c58c515 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:07:19.199761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:19.300735 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d3ed1-c40d-440d-8dd5-c2646c58c515 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:07:19.334524 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246a31d-a6dc-4c56-a4fb-5816447ab328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:07:19.335178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246a31d-a6dc-4c56-a4fb-5816447ab328 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:07:19.335462 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246a31d-a6dc-4c56-a4fb-5816447ab328 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:07:19.335735 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246a31d-a6dc-4c56-a4fb-5816447ab328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:07:19.336576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246a31d-a6dc-4c56-a4fb-5816447ab328 None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=594deb2796d94f0b8ddc512ce4aa7ea0, user.id=6fdd5910853a4b72b7996d3aa77ab426) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:07:19.336888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246a31d-a6dc-4c56-a4fb-5816447ab328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:07:19.338315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246a31d-a6dc-4c56-a4fb-5816447ab328 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:07:19.344063 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 608/1200] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:07:19 2022] GET /identity/v3/role_assignments?user.id=6fdd5910853a4b72b7996d3aa77ab426&scope.project.id=594deb2796d94f0b8ddc512ce4aa7ea0&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:07:29.179999 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=48 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:07:29.341408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=66 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:15.063399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054627b-671e-4453-a1ed-c8716534e084 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:15.063985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054627b-671e-4453-a1ed-c8716534e084 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:15.063985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054627b-671e-4453-a1ed-c8716534e084 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:15.065463 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 593/1201] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:08:15.072003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0c34a-3814-4378-affc-ae93bfc8f697 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:15.072656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0c34a-3814-4378-affc-ae93bfc8f697 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:15.072656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0c34a-3814-4378-affc-ae93bfc8f697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:15.094637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0ab0c34a-3814-4378-affc-ae93bfc8f697 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:08:15.095981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0ab0c34a-3814-4378-affc-ae93bfc8f697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:08:15.183811 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 609/1202] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:08:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:08:15.209511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054627b-671e-4453-a1ed-c8716534e084 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:15.350551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054627b-671e-4453-a1ed-c8716534e084 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:15.394751 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aa46b-e443-40fb-a602-f0aeccb4f2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:15.396568 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa46b-e443-40fb-a602-f0aeccb4f2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:15.396837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa46b-e443-40fb-a602-f0aeccb4f2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:15.397192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa46b-e443-40fb-a602-f0aeccb4f2c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:15.409955 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19aa46b-e443-40fb-a602-f0aeccb4f2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:15.411658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19aa46b-e443-40fb-a602-f0aeccb4f2c6 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:15.437670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-d19aa46b-e443-40fb-a602-f0aeccb4f2c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:15.437670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:15.437670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:15.437670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:15.437670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:15.437670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:15.437670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:15.437670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:15.437670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:15.437670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:15.437670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:15.437670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:15.437670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:08:15.437670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:08:15.437670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:15.438860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:15.439836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:08:15.439836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:08:15.439836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:15.439836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:08:15.439836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 594/1203] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:15.445577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0c34a-3814-4378-affc-ae93bfc8f697 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:15.591545 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0c34a-3814-4378-affc-ae93bfc8f697 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:15.631343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:15.647444 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fe4e5-28d9-4a57-a7ce-83049bcee20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:15.648169 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fe4e5-28d9-4a57-a7ce-83049bcee20b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:15.648510 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fe4e5-28d9-4a57-a7ce-83049bcee20b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:15.648794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fe4e5-28d9-4a57-a7ce-83049bcee20b None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:15.649596 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fe4e5-28d9-4a57-a7ce-83049bcee20b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:15.650029 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fe4e5-28d9-4a57-a7ce-83049bcee20b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:15.651648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fe4e5-28d9-4a57-a7ce-83049bcee20b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:15.668294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 610/1204] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:08:15.673235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aa46b-e443-40fb-a602-f0aeccb4f2c6 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:15.746820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:15.809940 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aa46b-e443-40fb-a602-f0aeccb4f2c6 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:15.855603 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b28459-f76c-4eb3-ab5f-67b5ebaf0a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:15.856786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b28459-f76c-4eb3-ab5f-67b5ebaf0a79 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:15.857373 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b28459-f76c-4eb3-ab5f-67b5ebaf0a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:15.857834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b28459-f76c-4eb3-ab5f-67b5ebaf0a79 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:15.858676 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b28459-f76c-4eb3-ab5f-67b5ebaf0a79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:15.860200 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b28459-f76c-4eb3-ab5f-67b5ebaf0a79 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:15.900672 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 595/1205] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Jul 25 16:08:15 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:08:18.378951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5f3ff-63a0-4e4c-9728-11977b5c6865 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:18.379483 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5f3ff-63a0-4e4c-9728-11977b5c6865 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:18.379572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5f3ff-63a0-4e4c-9728-11977b5c6865 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:18.381131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 611/1206] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:08:18.386953 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb8600-e64d-4270-b50d-78929f8753d9 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:18.387424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb8600-e64d-4270-b50d-78929f8753d9 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:18.387515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb8600-e64d-4270-b50d-78929f8753d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:18.412314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2ceb8600-e64d-4270-b50d-78929f8753d9 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:08:18.412314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2ceb8600-e64d-4270-b50d-78929f8753d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:08:18.500601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 596/1207] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:08:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:08:18.516439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5f3ff-63a0-4e4c-9728-11977b5c6865 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:18.641386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5f3ff-63a0-4e4c-9728-11977b5c6865 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:18.684346 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cbfe4-3609-4233-9ff1-8db758e89205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:18.685217 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cbfe4-3609-4233-9ff1-8db758e89205 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:18.685603 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cbfe4-3609-4233-9ff1-8db758e89205 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:18.685863 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cbfe4-3609-4233-9ff1-8db758e89205 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:18.699818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cbfe4-3609-4233-9ff1-8db758e89205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:08:18.708690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-222cbfe4-3609-4233-9ff1-8db758e89205 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:08:18.708690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:18.708690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:18.708690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:18.708690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:18.708690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:18.708690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:18.708690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:18.708690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:18.708690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:18.708690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:18.708690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:18.708690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:08:18.708690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:08:18.708690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:08:18.708690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:08:18.709851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:08:18.709851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:08:18.709851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:08:18.709851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:08:18.709851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:18.709851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:18.709851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:18.709851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:18.709851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:18.709851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:18.709851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:18.709851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:18.709851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:18.709851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:18.709851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:18.709851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:18.710914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:18.710914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:18.710914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:18.710914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:18.710914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:08:18.710914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:08:18.710914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:08:18.710914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:08:18.710914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:08:18.710914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:08:18.710914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:08:18.710914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:18.710914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 612/1208] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:08:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:18.717181 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb8600-e64d-4270-b50d-78929f8753d9 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:18.765393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:18.837956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb8600-e64d-4270-b50d-78929f8753d9 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:18.885589 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe9e26-bc07-451c-aaf7-970f94ed5c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:18.887234 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe9e26-bc07-451c-aaf7-970f94ed5c18 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:18.887695 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe9e26-bc07-451c-aaf7-970f94ed5c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:18.888184 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe9e26-bc07-451c-aaf7-970f94ed5c18 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:18.889374 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe9e26-bc07-451c-aaf7-970f94ed5c18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:18.889723 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe9e26-bc07-451c-aaf7-970f94ed5c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:18.891552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe9e26-bc07-451c-aaf7-970f94ed5c18 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:18.903429 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 597/1209] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:08:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:18.910643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cbfe4-3609-4233-9ff1-8db758e89205 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:18.981787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:19.043788 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cbfe4-3609-4233-9ff1-8db758e89205 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:19.089218 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97542a10-2049-47c6-998b-80b94df3a8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:19.090057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97542a10-2049-47c6-998b-80b94df3a8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:19.090345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97542a10-2049-47c6-998b-80b94df3a8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:19.090654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97542a10-2049-47c6-998b-80b94df3a8e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:19.104973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97542a10-2049-47c6-998b-80b94df3a8e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:19.106571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97542a10-2049-47c6-998b-80b94df3a8e0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:19.132340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-97542a10-2049-47c6-998b-80b94df3a8e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:19.132340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:19.132340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:19.132340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:19.132340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:19.132340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:19.132340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:19.132340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:19.132340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:19.132340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:19.132340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:19.132340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:19.132340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:08:19.132340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:08:19.132340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:19.133313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:19.134229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:08:19.134229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:08:19.134229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:19.134229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:19.134229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 613/1210] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:19.141486 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe9e26-bc07-451c-aaf7-970f94ed5c18 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:19.284392 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:19.297634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe9e26-bc07-451c-aaf7-970f94ed5c18 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:19.347992 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049707e-371b-4030-ab44-dc3059b350f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:19.348786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049707e-371b-4030-ab44-dc3059b350f2 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:19.349070 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049707e-371b-4030-ab44-dc3059b350f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:19.349346 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049707e-371b-4030-ab44-dc3059b350f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:19.350101 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049707e-371b-4030-ab44-dc3059b350f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:19.350448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049707e-371b-4030-ab44-dc3059b350f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:19.351955 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049707e-371b-4030-ab44-dc3059b350f2 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:19.369469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 598/1211] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:19.376209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97542a10-2049-47c6-998b-80b94df3a8e0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:19.497535 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97542a10-2049-47c6-998b-80b94df3a8e0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:19.499521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:19.535368 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60ccc5-83a3-4cba-bed5-475ad747cb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:19.536217 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60ccc5-83a3-4cba-bed5-475ad747cb77 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:19.536550 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60ccc5-83a3-4cba-bed5-475ad747cb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:19.536867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60ccc5-83a3-4cba-bed5-475ad747cb77 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:19.546027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60ccc5-83a3-4cba-bed5-475ad747cb77 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:19.547820 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60ccc5-83a3-4cba-bed5-475ad747cb77 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:19.568561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-9f60ccc5-83a3-4cba-bed5-475ad747cb77 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 16:08:19.568561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:19.568561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:19.568561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:19.568561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:19.568561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:19.568561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:19.568561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:19.568561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:19.568561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:19.568561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:19.568561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:19.568561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:08:19.568561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:08:19.568561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:08:19.568561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:19.569869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:19.570813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:19.570813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:19.570813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:08:19.570813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:08:19.570813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:08:19.570813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:08:19.570813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:08:19.570813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:08:19.570813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 16:08:19.570813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:19.570813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 614/1212] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:19.575898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049707e-371b-4030-ab44-dc3059b350f2 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:19.686761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049707e-371b-4030-ab44-dc3059b350f2 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:19.725162 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ece29-f322-4876-a017-86f6bacc4767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:19.725852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ece29-f322-4876-a017-86f6bacc4767 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:19.726147 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ece29-f322-4876-a017-86f6bacc4767 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:19.726420 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ece29-f322-4876-a017-86f6bacc4767 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:19.727266 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ece29-f322-4876-a017-86f6bacc4767 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:19.727574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ece29-f322-4876-a017-86f6bacc4767 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:19.729039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ece29-f322-4876-a017-86f6bacc4767 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:19.749566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 599/1213] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jul 25 16:08:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:08:19.755627 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60ccc5-83a3-4cba-bed5-475ad747cb77 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:19.879208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60ccc5-83a3-4cba-bed5-475ad747cb77 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:19.919308 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b219e72-1fb8-4798-9622-8318e3c439ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:19.920056 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b219e72-1fb8-4798-9622-8318e3c439ef None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:19.920406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b219e72-1fb8-4798-9622-8318e3c439ef None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:19.920710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b219e72-1fb8-4798-9622-8318e3c439ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:19.958893 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:20.006716 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b219e72-1fb8-4798-9622-8318e3c439ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:20.008180 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b219e72-1fb8-4798-9622-8318e3c439ef None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:20.121774 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 615/1214] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:08:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:08:20.127784 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ece29-f322-4876-a017-86f6bacc4767 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:20.153550 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:20.249421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ece29-f322-4876-a017-86f6bacc4767 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:20.294650 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32590f59-082d-4cf3-983d-51135c7d55f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:20.295507 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32590f59-082d-4cf3-983d-51135c7d55f5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:20.295925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32590f59-082d-4cf3-983d-51135c7d55f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:20.296215 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32590f59-082d-4cf3-983d-51135c7d55f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:20.309594 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32590f59-082d-4cf3-983d-51135c7d55f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:20.311083 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32590f59-082d-4cf3-983d-51135c7d55f5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:20.330823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-32590f59-082d-4cf3-983d-51135c7d55f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:20.330823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:20.330823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:20.330823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:20.330823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:20.330823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:20.330823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:20.330823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:20.330823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:20.330823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:20.330823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:20.330823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:20.330823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:08:20.330823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:08:20.330823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:20.331767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:20.332732 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:08:20.332732 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:08:20.332732 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:20.332732 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:08:20.332732 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 600/1215] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:20.338752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b219e72-1fb8-4798-9622-8318e3c439ef None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:20.411091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:20.463690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b219e72-1fb8-4798-9622-8318e3c439ef None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:20.517971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe5a8b-0d61-4064-8e91-00620a448d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:20.519080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe5a8b-0d61-4064-8e91-00620a448d48 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:20.519373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe5a8b-0d61-4064-8e91-00620a448d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:20.519661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe5a8b-0d61-4064-8e91-00620a448d48 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:20.520801 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe5a8b-0d61-4064-8e91-00620a448d48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:20.521125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe5a8b-0d61-4064-8e91-00620a448d48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:20.522927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe5a8b-0d61-4064-8e91-00620a448d48 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:20.544287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 616/1216] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:08:20.548809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32590f59-082d-4cf3-983d-51135c7d55f5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:20.645993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:20.687152 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32590f59-082d-4cf3-983d-51135c7d55f5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:20.726780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66e6b3-c3e9-4336-abea-bb03be661a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:20.727750 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66e6b3-c3e9-4336-abea-bb03be661a41 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:20.728032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66e6b3-c3e9-4336-abea-bb03be661a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:20.728335 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66e6b3-c3e9-4336-abea-bb03be661a41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:20.735519 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66e6b3-c3e9-4336-abea-bb03be661a41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:20.737009 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66e6b3-c3e9-4336-abea-bb03be661a41 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:20.753399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-1b66e6b3-c3e9-4336-abea-bb03be661a41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:08:20.753399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:20.753399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:20.753399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:20.753399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:20.753399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:20.753399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:20.753399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:20.753399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:20.753399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:20.753399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:20.753399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:20.753399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:08:20.753399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:08:20.753399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:20.754559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:20.755492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:08:20.755492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:08:20.755492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:08:20.755492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:08:20.755492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:08:20.755492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:08:20.755492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:08:20.755492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:08:20.755492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 601/1217] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:08:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:20.761347 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe5a8b-0d61-4064-8e91-00620a448d48 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:20.887964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe5a8b-0d61-4064-8e91-00620a448d48 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:20.912107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:20.927856 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e242c-d3ba-47a0-b3d4-6bce952cdaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:20.928644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e242c-d3ba-47a0-b3d4-6bce952cdaec None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:20.928843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e242c-d3ba-47a0-b3d4-6bce952cdaec None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:20.929126 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e242c-d3ba-47a0-b3d4-6bce952cdaec None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:20.929975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e242c-d3ba-47a0-b3d4-6bce952cdaec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:20.930342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e242c-d3ba-47a0-b3d4-6bce952cdaec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:20.932562 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e242c-d3ba-47a0-b3d4-6bce952cdaec None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:20.958268 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 617/1218] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:08:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:20.958454 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66e6b3-c3e9-4336-abea-bb03be661a41 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:21.070145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66e6b3-c3e9-4336-abea-bb03be661a41 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:21.100912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:21.113837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e32fec-de68-4997-b24e-8ea41695102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:21.114539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e32fec-de68-4997-b24e-8ea41695102c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:21.114869 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e32fec-de68-4997-b24e-8ea41695102c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:21.115081 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e32fec-de68-4997-b24e-8ea41695102c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:21.115922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e32fec-de68-4997-b24e-8ea41695102c None admin] RBAC: Adding query filter params (role.id=276de082c6c04d08a38361e8fea28a9a, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=ba3474e40117440498f0fe99f743df50) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:21.116235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e32fec-de68-4997-b24e-8ea41695102c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:21.117701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e32fec-de68-4997-b24e-8ea41695102c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:21.136429 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 602/1219] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:08:20 2022] GET /identity/v3/role_assignments?user.id=ba3474e40117440498f0fe99f743df50&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=276de082c6c04d08a38361e8fea28a9a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:23.203861 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6c4cf-c656-4a2a-8950-1254e37ab2bb None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:23.204449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6c4cf-c656-4a2a-8950-1254e37ab2bb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:23.204560 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6c4cf-c656-4a2a-8950-1254e37ab2bb None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:23.206155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 618/1220] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:08:23.211513 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce18ba3-39eb-42f8-b419-631c3b186de0 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:23.212002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce18ba3-39eb-42f8-b419-631c3b186de0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:23.212002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce18ba3-39eb-42f8-b419-631c3b186de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:23.230803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2ce18ba3-39eb-42f8-b419-631c3b186de0 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:08:23.231970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2ce18ba3-39eb-42f8-b419-631c3b186de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:08:23.305132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 603/1221] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:08:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:08:23.337086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6c4cf-c656-4a2a-8950-1254e37ab2bb None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:23.455919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6c4cf-c656-4a2a-8950-1254e37ab2bb None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:23.489666 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f875be-88f4-45be-bd12-a19afa08aa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:23.490467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f875be-88f4-45be-bd12-a19afa08aa28 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:23.490752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f875be-88f4-45be-bd12-a19afa08aa28 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:23.491031 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f875be-88f4-45be-bd12-a19afa08aa28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:23.503111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f875be-88f4-45be-bd12-a19afa08aa28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:08:23.511709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-92f875be-88f4-45be-bd12-a19afa08aa28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:08:23.511709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:23.511709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:23.511709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:23.511709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:23.511709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:23.511709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:23.511709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:23.511709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:23.511709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:23.511709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:23.511709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:23.511709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:08:23.511709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:08:23.511709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:08:23.511709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:08:23.514198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:08:23.514198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:08:23.514198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:08:23.514198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:08:23.514198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:23.514198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:23.514198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:23.514198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:23.514198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:23.514198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:23.514198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:23.514198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:23.514198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:23.514198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:23.514198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:23.514198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:23.516664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:23.516664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:23.516664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:23.516664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:23.516664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:08:23.516664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:08:23.516664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:08:23.516664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:08:23.516664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:08:23.516664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:08:23.516664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:08:23.516664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:23.516664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 619/1222] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:08:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:23.519132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce18ba3-39eb-42f8-b419-631c3b186de0 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:23.630495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce18ba3-39eb-42f8-b419-631c3b186de0 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:23.659951 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:23.673899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f651980-23c4-43e5-ac60-39730526ac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:23.674635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f651980-23c4-43e5-ac60-39730526ac7c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:23.674962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f651980-23c4-43e5-ac60-39730526ac7c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:23.675267 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f651980-23c4-43e5-ac60-39730526ac7c None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:23.676857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f651980-23c4-43e5-ac60-39730526ac7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:23.676857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f651980-23c4-43e5-ac60-39730526ac7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:23.677691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f651980-23c4-43e5-ac60-39730526ac7c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:23.689270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 604/1223] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:08:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:08:23.698460 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f875be-88f4-45be-bd12-a19afa08aa28 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:23.748763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:23.818587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f875be-88f4-45be-bd12-a19afa08aa28 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:23.856324 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c1c7-cc7d-4bb1-9ab6-9a3ee36fece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:23.857237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c1c7-cc7d-4bb1-9ab6-9a3ee36fece4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:23.857692 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c1c7-cc7d-4bb1-9ab6-9a3ee36fece4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:23.858038 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c1c7-cc7d-4bb1-9ab6-9a3ee36fece4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:23.870644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026c1c7-cc7d-4bb1-9ab6-9a3ee36fece4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:23.872498 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026c1c7-cc7d-4bb1-9ab6-9a3ee36fece4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:23.891595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e026c1c7-cc7d-4bb1-9ab6-9a3ee36fece4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:23.891595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:23.891595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:23.891595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:23.891595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:23.891595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:23.891595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:23.891595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:23.891595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:23.891595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:23.891595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:23.891595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:23.891595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:08:23.891595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:08:23.891595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:23.892824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:23.893866 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:08:23.893866 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:08:23.893866 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:23.893866 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:23.893866 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 620/1224] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:08:23.899078 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f651980-23c4-43e5-ac60-39730526ac7c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:24.010519 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f651980-23c4-43e5-ac60-39730526ac7c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:24.051147 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07a4a4-ffad-43ee-9f9b-f714c90892dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:24.052175 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07a4a4-ffad-43ee-9f9b-f714c90892dc None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:24.052718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07a4a4-ffad-43ee-9f9b-f714c90892dc None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:24.052975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07a4a4-ffad-43ee-9f9b-f714c90892dc None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:24.053715 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07a4a4-ffad-43ee-9f9b-f714c90892dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:24.054030 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07a4a4-ffad-43ee-9f9b-f714c90892dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:24.055409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07a4a4-ffad-43ee-9f9b-f714c90892dc None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:24.068553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 605/1225] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:24.074949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c1c7-cc7d-4bb1-9ab6-9a3ee36fece4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:24.195749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:24.214441 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c1c7-cc7d-4bb1-9ab6-9a3ee36fece4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:24.260997 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ab9df-7c3d-44ce-8059-8504edde5901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:24.261781 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ab9df-7c3d-44ce-8059-8504edde5901 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:24.262069 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ab9df-7c3d-44ce-8059-8504edde5901 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:24.262432 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ab9df-7c3d-44ce-8059-8504edde5901 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:24.270784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ab9df-7c3d-44ce-8059-8504edde5901 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:24.272236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ab9df-7c3d-44ce-8059-8504edde5901 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:24.287988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-619ab9df-7c3d-44ce-8059-8504edde5901 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 16:08:24.287988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:24.287988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:24.287988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:24.287988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:24.287988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:24.287988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:24.287988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:24.287988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:24.287988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:24.287988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:24.287988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:24.287988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:08:24.287988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:08:24.287988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:08:24.287988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:24.289241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:24.296024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:24.296024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:24.296024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:08:24.296024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:08:24.296024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:08:24.296024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:08:24.296024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:08:24.296024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:08:24.296024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 16:08:24.296024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:24.296024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 621/1226] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:24.297873 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07a4a4-ffad-43ee-9f9b-f714c90892dc None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:24.348736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:24.417670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07a4a4-ffad-43ee-9f9b-f714c90892dc None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:24.462613 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91373bdb-37b7-4353-adcf-ea43bc9efdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:24.463305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91373bdb-37b7-4353-adcf-ea43bc9efdbc None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:24.463588 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91373bdb-37b7-4353-adcf-ea43bc9efdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:24.463876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91373bdb-37b7-4353-adcf-ea43bc9efdbc None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:24.465265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91373bdb-37b7-4353-adcf-ea43bc9efdbc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:24.465567 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91373bdb-37b7-4353-adcf-ea43bc9efdbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:24.467036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91373bdb-37b7-4353-adcf-ea43bc9efdbc None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:24.487463 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 606/1227] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jul 25 16:08:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:24.493436 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ab9df-7c3d-44ce-8059-8504edde5901 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:24.610267 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ab9df-7c3d-44ce-8059-8504edde5901 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:24.646478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9cf59-9d81-4c62-8733-a9142b1576ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:24.647280 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9cf59-9d81-4c62-8733-a9142b1576ed None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:24.647565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9cf59-9d81-4c62-8733-a9142b1576ed None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:24.647841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9cf59-9d81-4c62-8733-a9142b1576ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:24.661490 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9cf59-9d81-4c62-8733-a9142b1576ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:24.663033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9cf59-9d81-4c62-8733-a9142b1576ed None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:24.682005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-8be9cf59-9d81-4c62-8733-a9142b1576ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:24.682005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:24.682005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:24.682005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:24.682005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:24.682005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:24.682005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:24.682005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:24.682005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:24.682005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:24.682005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:24.682005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:24.682005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:08:24.682005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:08:24.682005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:24.683030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:24.683901 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:08:24.683901 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:08:24.683901 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:24.683901 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:24.683901 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 622/1228] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:08:24.690172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91373bdb-37b7-4353-adcf-ea43bc9efdbc None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:24.800913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91373bdb-37b7-4353-adcf-ea43bc9efdbc None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:24.803508 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:24.838456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8fb5d-f901-4f94-b367-0a5ebb20addc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:24.839805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8fb5d-f901-4f94-b367-0a5ebb20addc None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:24.840100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8fb5d-f901-4f94-b367-0a5ebb20addc None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:24.840417 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8fb5d-f901-4f94-b367-0a5ebb20addc None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:24.841146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8fb5d-f901-4f94-b367-0a5ebb20addc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:24.841458 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8fb5d-f901-4f94-b367-0a5ebb20addc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:24.842985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8fb5d-f901-4f94-b367-0a5ebb20addc None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:24.857461 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 607/1229] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:24.863414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9cf59-9d81-4c62-8733-a9142b1576ed None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:24.874187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:24.987887 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9cf59-9d81-4c62-8733-a9142b1576ed None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:25.032759 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bf9ef-7988-4701-8a96-74ebb5e4818f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:25.033565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bf9ef-7988-4701-8a96-74ebb5e4818f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:25.033988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bf9ef-7988-4701-8a96-74ebb5e4818f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:25.034237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bf9ef-7988-4701-8a96-74ebb5e4818f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:25.041926 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bf9ef-7988-4701-8a96-74ebb5e4818f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:25.043417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bf9ef-7988-4701-8a96-74ebb5e4818f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:25.061745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-882bf9ef-7988-4701-8a96-74ebb5e4818f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:08:25.061745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:25.061745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:25.061745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:25.061745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:25.061745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:25.061745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:25.061745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:25.061745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:25.061745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:25.061745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:25.061745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:25.061745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:08:25.061745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:08:25.061745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:25.062878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:25.064385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:08:25.064385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:08:25.064385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:08:25.064385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:08:25.064385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:08:25.064385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:08:25.064385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:08:25.064385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:25.065341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 623/1230] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:08:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:25.071138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8fb5d-f901-4f94-b367-0a5ebb20addc None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:25.177068 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8fb5d-f901-4f94-b367-0a5ebb20addc None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:25.214619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358d7bf-704c-4ddd-b360-e0d1d2ea8ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:25.215294 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358d7bf-704c-4ddd-b360-e0d1d2ea8ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:25.215580 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358d7bf-704c-4ddd-b360-e0d1d2ea8ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:25.215891 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358d7bf-704c-4ddd-b360-e0d1d2ea8ab7 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:25.216703 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358d7bf-704c-4ddd-b360-e0d1d2ea8ab7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:25.217013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358d7bf-704c-4ddd-b360-e0d1d2ea8ab7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:25.218452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358d7bf-704c-4ddd-b360-e0d1d2ea8ab7 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:25.236294 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 608/1231] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:08:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:08:25.238219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bf9ef-7988-4701-8a96-74ebb5e4818f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:25.332935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:25.381099 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bf9ef-7988-4701-8a96-74ebb5e4818f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:25.426267 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1b71a-946b-4c2e-9dc7-4d5a7084f550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:25.427403 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1b71a-946b-4c2e-9dc7-4d5a7084f550 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:25.427630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1b71a-946b-4c2e-9dc7-4d5a7084f550 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:25.427911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1b71a-946b-4c2e-9dc7-4d5a7084f550 None admin] PATH_INFO: `/v3/projects/0c9d252e2e0347029d58192fab233f09/users/ba3474e40117440498f0fe99f743df50/roles/276de082c6c04d08a38361e8fea28a9a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:25.448893 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1b71a-946b-4c2e-9dc7-4d5a7084f550 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9d252e2e0347029d58192fab233f09, user_id=ba3474e40117440498f0fe99f743df50, role_id=276de082c6c04d08a38361e8fea28a9a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:25.450716 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1b71a-946b-4c2e-9dc7-4d5a7084f550 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:25.470902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 624/1232] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:08:25 2022] PUT /identity/v3/projects/0c9d252e2e0347029d58192fab233f09/users/ba3474e40117440498f0fe99f743df50/roles/276de082c6c04d08a38361e8fea28a9a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:08:27.642513 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08aabf-e7cb-4fa3-bace-8b241b7bbf00 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:27.643046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08aabf-e7cb-4fa3-bace-8b241b7bbf00 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:27.643046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08aabf-e7cb-4fa3-bace-8b241b7bbf00 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:27.644385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 609/1233] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:08:27.650434 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc7c6c-b34b-4c2a-8bb3-dc3c4d02ea5f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:27.650947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc7c6c-b34b-4c2a-8bb3-dc3c4d02ea5f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:27.651065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc7c6c-b34b-4c2a-8bb3-dc3c4d02ea5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:27.673670 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-74fc7c6c-b34b-4c2a-8bb3-dc3c4d02ea5f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:08:27.674917 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-74fc7c6c-b34b-4c2a-8bb3-dc3c4d02ea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:08:27.784064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 625/1234] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:08:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:08:27.811705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08aabf-e7cb-4fa3-bace-8b241b7bbf00 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:27.839459 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:27.962400 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08aabf-e7cb-4fa3-bace-8b241b7bbf00 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:28.027130 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75846452-9d67-4b09-a918-0be7d4762079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:28.028551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846452-9d67-4b09-a918-0be7d4762079 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:28.029054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846452-9d67-4b09-a918-0be7d4762079 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:28.029586 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846452-9d67-4b09-a918-0be7d4762079 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:28.049906 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75846452-9d67-4b09-a918-0be7d4762079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:08:28.069501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-75846452-9d67-4b09-a918-0be7d4762079 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:08:28.069501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:28.069501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:28.069501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:28.069501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:28.069501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:28.069501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:28.069501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:28.069501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:28.069501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:28.069501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:28.069501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:28.069501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:08:28.069501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:08:28.069501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:08:28.069501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:08:28.071280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:08:28.071280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:08:28.071280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:08:28.071280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:08:28.071280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:28.071280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:28.071280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:28.071280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:28.071280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:28.071280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:28.071280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:28.071280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:28.071280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:28.071280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:28.071280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:28.071280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:28.072389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:28.072389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:28.072389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:28.072389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:28.072389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:08:28.072389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:08:28.072389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:08:28.072389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:08:28.072389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:08:28.072389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:08:28.072389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 16:08:28.072389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:08:28.072389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 610/1235] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Jul 25 16:08:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 16:08:28.081641 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc7c6c-b34b-4c2a-8bb3-dc3c4d02ea5f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:28.137244 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:28.203753 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc7c6c-b34b-4c2a-8bb3-dc3c4d02ea5f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:28.249216 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211593fb-999a-4c1f-a160-021a1ed7d545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:28.250099 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211593fb-999a-4c1f-a160-021a1ed7d545 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:28.250423 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211593fb-999a-4c1f-a160-021a1ed7d545 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:28.250839 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211593fb-999a-4c1f-a160-021a1ed7d545 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:28.251952 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211593fb-999a-4c1f-a160-021a1ed7d545 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:28.252392 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211593fb-999a-4c1f-a160-021a1ed7d545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:28.254259 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211593fb-999a-4c1f-a160-021a1ed7d545 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:28.267400 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 626/1236] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Jul 25 16:08:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:08:28.273172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75846452-9d67-4b09-a918-0be7d4762079 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:28.367223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:28.386195 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75846452-9d67-4b09-a918-0be7d4762079 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:28.440308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ae44c-b30e-4a7d-b527-bd076ae0e756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:28.441149 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ae44c-b30e-4a7d-b527-bd076ae0e756 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:28.441456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ae44c-b30e-4a7d-b527-bd076ae0e756 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:28.441702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ae44c-b30e-4a7d-b527-bd076ae0e756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:28.454535 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ae44c-b30e-4a7d-b527-bd076ae0e756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:28.456428 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ae44c-b30e-4a7d-b527-bd076ae0e756 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:28.477138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-2d4ae44c-b30e-4a7d-b527-bd076ae0e756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:28.477138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:28.477138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:28.477138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:28.477138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:28.477138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:28.477138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:28.477138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:28.477138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:28.477138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:28.477138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:28.477138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:28.477138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:08:28.477138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:08:28.477138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:28.478185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:28.479066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:08:28.479066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:08:28.479066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:28.479066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:08:28.479066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 611/1237] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:28.485815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211593fb-999a-4c1f-a160-021a1ed7d545 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:28.606849 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211593fb-999a-4c1f-a160-021a1ed7d545 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:28.616675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:28.644759 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d75ff8-bcc4-40bf-9a0a-cc340a09ad28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:28.645435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d75ff8-bcc4-40bf-9a0a-cc340a09ad28 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:28.645722 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d75ff8-bcc4-40bf-9a0a-cc340a09ad28 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:28.645996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d75ff8-bcc4-40bf-9a0a-cc340a09ad28 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:28.646744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d75ff8-bcc4-40bf-9a0a-cc340a09ad28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:28.647021 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d75ff8-bcc4-40bf-9a0a-cc340a09ad28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:28.648406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d75ff8-bcc4-40bf-9a0a-cc340a09ad28 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:28.662904 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 627/1238] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:08:28.670825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ae44c-b30e-4a7d-b527-bd076ae0e756 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:28.796467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ae44c-b30e-4a7d-b527-bd076ae0e756 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:28.839895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68963a46-e0c9-4566-8f50-b83807b263fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:28.840862 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68963a46-e0c9-4566-8f50-b83807b263fd None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:28.841191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68963a46-e0c9-4566-8f50-b83807b263fd None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:28.841521 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68963a46-e0c9-4566-8f50-b83807b263fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:28.844799 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:28.852670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68963a46-e0c9-4566-8f50-b83807b263fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:28.854259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68963a46-e0c9-4566-8f50-b83807b263fd None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:28.871814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-68963a46-e0c9-4566-8f50-b83807b263fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 16:08:28.871814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:28.871814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:28.871814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:28.871814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:28.871814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:28.871814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:28.871814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:28.871814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:28.871814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:28.871814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:28.871814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:28.871814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:08:28.871814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:08:28.871814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:08:28.871814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:28.873075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:28.874343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:28.874343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:28.874343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:08:28.874343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:08:28.874343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:08:28.874343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:08:28.874343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:08:28.874343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:08:28.874343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 16:08:28.874343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:08:28.874343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 612/1239] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:28.882184 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d75ff8-bcc4-40bf-9a0a-cc340a09ad28 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:28.999321 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d75ff8-bcc4-40bf-9a0a-cc340a09ad28 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:29.038313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16c13d-7939-4453-a634-0752f515dcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:29.039005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c13d-7939-4453-a634-0752f515dcdd None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:29.039286 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c13d-7939-4453-a634-0752f515dcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:29.039569 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c13d-7939-4453-a634-0752f515dcdd None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:29.040454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16c13d-7939-4453-a634-0752f515dcdd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:29.040779 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16c13d-7939-4453-a634-0752f515dcdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:29.042754 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16c13d-7939-4453-a634-0752f515dcdd None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:29.062248 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 628/1240] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jul 25 16:08:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:29.068359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68963a46-e0c9-4566-8f50-b83807b263fd None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:29.181579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68963a46-e0c9-4566-8f50-b83807b263fd None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:29.220171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2592913-f525-49a6-8bc8-0c0fdfdd2e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:29.221079 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2592913-f525-49a6-8bc8-0c0fdfdd2e05 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:29.221374 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2592913-f525-49a6-8bc8-0c0fdfdd2e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:29.221679 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2592913-f525-49a6-8bc8-0c0fdfdd2e05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:29.312946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:29.321792 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2592913-f525-49a6-8bc8-0c0fdfdd2e05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:29.324034 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2592913-f525-49a6-8bc8-0c0fdfdd2e05 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:29.469394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 613/1241] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:08:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:08:29.475504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16c13d-7939-4453-a634-0752f515dcdd None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:29.512697 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:29.621863 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16c13d-7939-4453-a634-0752f515dcdd None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:29.664797 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccc381-fc78-4b56-a68a-4ddbb57c0051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:29.665630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccc381-fc78-4b56-a68a-4ddbb57c0051 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:29.665917 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccc381-fc78-4b56-a68a-4ddbb57c0051 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:29.666195 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccc381-fc78-4b56-a68a-4ddbb57c0051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:29.679172 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccc381-fc78-4b56-a68a-4ddbb57c0051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:29.680704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccc381-fc78-4b56-a68a-4ddbb57c0051 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:29.700661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-16ccc381-fc78-4b56-a68a-4ddbb57c0051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:29.700661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:29.700661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:29.700661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:29.700661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:29.700661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:29.700661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:29.700661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:29.700661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:29.700661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:29.700661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:29.700661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:29.700661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:08:29.700661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:08:29.700661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:29.702051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:29.703135 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:08:29.703135 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:08:29.703135 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:29.703135 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:29.703135 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 629/1242] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:29.708464 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2592913-f525-49a6-8bc8-0c0fdfdd2e05 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:29.812878 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:29.822705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2592913-f525-49a6-8bc8-0c0fdfdd2e05 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:29.876993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb9046-f243-431e-add4-6955e2a0cd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:29.877604 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb9046-f243-431e-add4-6955e2a0cd91 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:29.877957 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb9046-f243-431e-add4-6955e2a0cd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:29.878231 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb9046-f243-431e-add4-6955e2a0cd91 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:29.878960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb9046-f243-431e-add4-6955e2a0cd91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:29.879347 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb9046-f243-431e-add4-6955e2a0cd91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:29.880810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb9046-f243-431e-add4-6955e2a0cd91 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:29.906265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 614/1243] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:29.907975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccc381-fc78-4b56-a68a-4ddbb57c0051 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:30.019421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:30.051507 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccc381-fc78-4b56-a68a-4ddbb57c0051 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:30.096850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dca2a-d596-4791-a2e8-db0185540b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:30.097931 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dca2a-d596-4791-a2e8-db0185540b60 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:30.098345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dca2a-d596-4791-a2e8-db0185540b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:30.098628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dca2a-d596-4791-a2e8-db0185540b60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:30.107162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dca2a-d596-4791-a2e8-db0185540b60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:30.108796 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dca2a-d596-4791-a2e8-db0185540b60 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:30.124873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c22dca2a-d596-4791-a2e8-db0185540b60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:08:30.124873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:30.124873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:30.124873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:30.124873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:30.124873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:30.124873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:30.124873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:30.124873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:30.124873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:30.124873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:30.124873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:30.124873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:08:30.124873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:08:30.124873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:30.126255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:30.127658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:08:30.127658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:08:30.127658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:08:30.127658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:08:30.127658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:08:30.127658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:08:30.127658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:08:30.127658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:30.127658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 630/1244] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:08:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:30.132768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb9046-f243-431e-add4-6955e2a0cd91 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:30.293443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb9046-f243-431e-add4-6955e2a0cd91 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:30.335720 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579898c-4a84-478f-a13d-dc4e846441b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:30.336452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579898c-4a84-478f-a13d-dc4e846441b3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:30.336788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579898c-4a84-478f-a13d-dc4e846441b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:30.337071 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579898c-4a84-478f-a13d-dc4e846441b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:30.337962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579898c-4a84-478f-a13d-dc4e846441b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:30.338331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579898c-4a84-478f-a13d-dc4e846441b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:30.340040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579898c-4a84-478f-a13d-dc4e846441b3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:30.355684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 615/1245] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:08:30.366433 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dca2a-d596-4791-a2e8-db0185540b60 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:30.496663 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dca2a-d596-4791-a2e8-db0185540b60 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:30.543549 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62bdfb-ce16-428c-b778-ff0d8534d22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:30.544236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62bdfb-ce16-428c-b778-ff0d8534d22b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:30.544574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62bdfb-ce16-428c-b778-ff0d8534d22b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:30.544832 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62bdfb-ce16-428c-b778-ff0d8534d22b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:30.545674 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62bdfb-ce16-428c-b778-ff0d8534d22b None admin] RBAC: Adding query filter params (role.id=276de082c6c04d08a38361e8fea28a9a, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=ba3474e40117440498f0fe99f743df50) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:30.545985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62bdfb-ce16-428c-b778-ff0d8534d22b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:30.547658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62bdfb-ce16-428c-b778-ff0d8534d22b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:30.554920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 631/1246] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:08:30 2022] GET /identity/v3/role_assignments?user.id=ba3474e40117440498f0fe99f743df50&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=276de082c6c04d08a38361e8fea28a9a => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:32.855673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575adeb2-e39d-4a10-b691-574da639d17e None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:32.856355 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575adeb2-e39d-4a10-b691-574da639d17e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:32.856457 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575adeb2-e39d-4a10-b691-574da639d17e None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:32.857903 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 616/1247] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:08:32.864377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5821-cee4-4125-953e-94ed769df6f3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:32.864914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5821-cee4-4125-953e-94ed769df6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:32.865018 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a5821-cee4-4125-953e-94ed769df6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:32.872849 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:32.886144 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-108a5821-cee4-4125-953e-94ed769df6f3 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:08:32.887509 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-108a5821-cee4-4125-953e-94ed769df6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:08:32.986297 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 632/1248] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:08:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:08:33.011024 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575adeb2-e39d-4a10-b691-574da639d17e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:33.030898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:33.138245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575adeb2-e39d-4a10-b691-574da639d17e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:33.180483 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521238c8-cf82-4823-bef7-b0d0582bda6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:33.181444 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521238c8-cf82-4823-bef7-b0d0582bda6f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:33.181761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521238c8-cf82-4823-bef7-b0d0582bda6f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:33.182094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521238c8-cf82-4823-bef7-b0d0582bda6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:33.193638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521238c8-cf82-4823-bef7-b0d0582bda6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:08:33.202430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-521238c8-cf82-4823-bef7-b0d0582bda6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:08:33.202430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:33.202430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:33.202430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:33.202430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:33.202430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:33.202430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:33.202430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:33.202430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:33.202430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:33.202430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:33.202430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:33.202430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:08:33.202430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:08:33.202430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:08:33.202430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:08:33.203666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:08:33.203666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:08:33.203666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:08:33.203666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:08:33.203666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:33.203666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:33.203666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:33.203666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:33.203666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:33.203666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:33.203666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:33.203666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:33.203666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:33.203666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:33.203666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:33.203666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:33.204785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:33.204785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:33.204785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:33.204785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:33.204785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:08:33.204785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:08:33.204785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:08:33.204785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:08:33.204785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:08:33.204785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:08:33.204785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:08:33.204785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:08:33.204785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 617/1249] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:08:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:33.209950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a5821-cee4-4125-953e-94ed769df6f3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:33.322964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a5821-cee4-4125-953e-94ed769df6f3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:33.362864 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:33.369381 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d43bfd-28d6-4484-b2a9-8b54de560af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:33.371213 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d43bfd-28d6-4484-b2a9-8b54de560af9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:33.371761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d43bfd-28d6-4484-b2a9-8b54de560af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:33.372390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d43bfd-28d6-4484-b2a9-8b54de560af9 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:33.374170 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d43bfd-28d6-4484-b2a9-8b54de560af9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:33.374708 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d43bfd-28d6-4484-b2a9-8b54de560af9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:33.376692 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d43bfd-28d6-4484-b2a9-8b54de560af9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:33.391412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 633/1250] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:08:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:33.397961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521238c8-cf82-4823-bef7-b0d0582bda6f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:33.518091 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:33.557850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521238c8-cf82-4823-bef7-b0d0582bda6f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:33.604359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8171ed3-774b-4869-bef2-109018b57548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:33.605176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8171ed3-774b-4869-bef2-109018b57548 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:33.605512 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8171ed3-774b-4869-bef2-109018b57548 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:33.605803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8171ed3-774b-4869-bef2-109018b57548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:33.618882 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8171ed3-774b-4869-bef2-109018b57548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:33.620495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8171ed3-774b-4869-bef2-109018b57548 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:33.642151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-b8171ed3-774b-4869-bef2-109018b57548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:33.642151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:33.642151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:33.642151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:33.642151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:33.642151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:33.642151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:33.642151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:33.642151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:33.642151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:33.642151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:33.642151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:33.642151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:08:33.642151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:08:33.642151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:33.643439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:33.644511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:08:33.644511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:08:33.644511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:33.644511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:08:33.644511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 618/1251] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:33.649484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d43bfd-28d6-4484-b2a9-8b54de560af9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:33.790800 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d43bfd-28d6-4484-b2a9-8b54de560af9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:33.834687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3cfc-713d-472f-862f-224c02773e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:33.835400 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3cfc-713d-472f-862f-224c02773e2e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:33.835713 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3cfc-713d-472f-862f-224c02773e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:33.836043 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec3cfc-713d-472f-862f-224c02773e2e None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:33.836943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec3cfc-713d-472f-862f-224c02773e2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:33.837293 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec3cfc-713d-472f-862f-224c02773e2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:33.839853 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec3cfc-713d-472f-862f-224c02773e2e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:33.853696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 634/1252] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:08:33.859780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8171ed3-774b-4869-bef2-109018b57548 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:33.987048 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8171ed3-774b-4869-bef2-109018b57548 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:34.020864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:34.032736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071dfa5-ffe6-4204-846a-e0d37f397ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:34.034271 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071dfa5-ffe6-4204-846a-e0d37f397ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:34.034679 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071dfa5-ffe6-4204-846a-e0d37f397ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:34.034982 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071dfa5-ffe6-4204-846a-e0d37f397ad3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:34.044994 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071dfa5-ffe6-4204-846a-e0d37f397ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:34.046496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071dfa5-ffe6-4204-846a-e0d37f397ad3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:34.069500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-d071dfa5-ffe6-4204-846a-e0d37f397ad3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 16:08:34.069500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:34.069500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:34.069500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:34.069500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:34.069500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:34.069500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:34.069500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:34.069500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:34.069500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:34.069500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:34.069500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:34.069500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:08:34.069500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:08:34.069500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:08:34.069500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:34.079436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:34.081357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:34.081357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:34.081357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:08:34.081357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:08:34.081357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:08:34.081357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:08:34.081357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:08:34.081357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:08:34.081357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 16:08:34.081357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:08:34.081357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 619/1253] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:34.082705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3cfc-713d-472f-862f-224c02773e2e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:34.171292 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:34.236609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec3cfc-713d-472f-862f-224c02773e2e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:34.285676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15da5e-3392-4094-bb43-4026cccf92b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:34.286315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15da5e-3392-4094-bb43-4026cccf92b3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:34.286613 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15da5e-3392-4094-bb43-4026cccf92b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:34.286888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15da5e-3392-4094-bb43-4026cccf92b3 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:34.287746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15da5e-3392-4094-bb43-4026cccf92b3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:34.288057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15da5e-3392-4094-bb43-4026cccf92b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:34.289572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15da5e-3392-4094-bb43-4026cccf92b3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:34.311598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 635/1254] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jul 25 16:08:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:34.317921 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071dfa5-ffe6-4204-846a-e0d37f397ad3 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:34.461363 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071dfa5-ffe6-4204-846a-e0d37f397ad3 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:34.518314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202f019-e775-455b-b0e3-dbe7e0c7bc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:34.518977 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202f019-e775-455b-b0e3-dbe7e0c7bc0e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:34.519258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202f019-e775-455b-b0e3-dbe7e0c7bc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:34.519531 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202f019-e775-455b-b0e3-dbe7e0c7bc0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:34.589496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:34.605572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202f019-e775-455b-b0e3-dbe7e0c7bc0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:34.608194 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202f019-e775-455b-b0e3-dbe7e0c7bc0e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:34.736385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 620/1255] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:08:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:08:34.742386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15da5e-3392-4094-bb43-4026cccf92b3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:34.862300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15da5e-3392-4094-bb43-4026cccf92b3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:34.878326 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:34.905096 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865ccf6-6112-47b1-91ee-ab4265724401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:34.905910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865ccf6-6112-47b1-91ee-ab4265724401 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:34.906192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865ccf6-6112-47b1-91ee-ab4265724401 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:34.906459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865ccf6-6112-47b1-91ee-ab4265724401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:34.919340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865ccf6-6112-47b1-91ee-ab4265724401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:34.921037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865ccf6-6112-47b1-91ee-ab4265724401 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:34.943360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-8865ccf6-6112-47b1-91ee-ab4265724401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:34.943360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:34.943360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:34.943360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:34.943360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:34.943360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:34.943360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:34.943360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:34.943360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:34.943360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:34.943360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:34.943360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:34.943360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:08:34.943360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:08:34.943360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:34.945679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:34.947591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:08:34.947591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:08:34.947591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:34.947591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:34.947591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 636/1256] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:34.955030 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202f019-e775-455b-b0e3-dbe7e0c7bc0e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:35.099707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:35.113958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202f019-e775-455b-b0e3-dbe7e0c7bc0e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:35.153940 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d7f60-aaf9-41aa-89d7-a4062a226fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:35.154916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d7f60-aaf9-41aa-89d7-a4062a226fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:35.155330 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d7f60-aaf9-41aa-89d7-a4062a226fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:35.155731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d7f60-aaf9-41aa-89d7-a4062a226fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:35.157522 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d7f60-aaf9-41aa-89d7-a4062a226fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:35.158034 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d7f60-aaf9-41aa-89d7-a4062a226fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:35.159956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d7f60-aaf9-41aa-89d7-a4062a226fd5 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:35.175588 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 621/1257] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:35.181438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865ccf6-6112-47b1-91ee-ab4265724401 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:35.308820 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865ccf6-6112-47b1-91ee-ab4265724401 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:35.351474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bd6b2-333a-46e1-bc51-8b2d5515d3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:35.352517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bd6b2-333a-46e1-bc51-8b2d5515d3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:35.352928 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bd6b2-333a-46e1-bc51-8b2d5515d3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:35.353213 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bd6b2-333a-46e1-bc51-8b2d5515d3f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:35.365721 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bd6b2-333a-46e1-bc51-8b2d5515d3f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:35.367110 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bd6b2-333a-46e1-bc51-8b2d5515d3f3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:35.382261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-cc3bd6b2-333a-46e1-bc51-8b2d5515d3f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:08:35.382261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:35.382261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:35.382261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:35.382261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:35.382261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:35.382261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:35.382261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:35.382261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:35.382261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:35.382261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:35.382261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:35.382261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:08:35.382261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:08:35.382261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:35.383421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:35.384335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:08:35.384335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:08:35.384335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:08:35.384335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:08:35.384335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:08:35.384335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:08:35.384335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:08:35.384335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:35.384335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 637/1258] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:08:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:35.389936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d7f60-aaf9-41aa-89d7-a4062a226fd5 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:35.530298 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d7f60-aaf9-41aa-89d7-a4062a226fd5 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:35.575999 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a46660-a9dd-4932-be8e-611b1b05bbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:35.576715 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a46660-a9dd-4932-be8e-611b1b05bbdc None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:35.577153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a46660-a9dd-4932-be8e-611b1b05bbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:35.577250 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a46660-a9dd-4932-be8e-611b1b05bbdc None admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:35.578456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a46660-a9dd-4932-be8e-611b1b05bbdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:35.578839 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a46660-a9dd-4932-be8e-611b1b05bbdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:35.580511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a46660-a9dd-4932-be8e-611b1b05bbdc None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:35.596847 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 622/1259] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:08:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:35.607768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bd6b2-333a-46e1-bc51-8b2d5515d3f3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:35.650296 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:35.748781 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bd6b2-333a-46e1-bc51-8b2d5515d3f3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:35.794867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097278e-2c60-4f34-bebd-3ce6baef9ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:35.796734 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097278e-2c60-4f34-bebd-3ce6baef9ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:35.796734 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097278e-2c60-4f34-bebd-3ce6baef9ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:35.796734 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097278e-2c60-4f34-bebd-3ce6baef9ec9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:35.796950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097278e-2c60-4f34-bebd-3ce6baef9ec9 None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=ba3474e40117440498f0fe99f743df50) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:35.797255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097278e-2c60-4f34-bebd-3ce6baef9ec9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:35.798746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097278e-2c60-4f34-bebd-3ce6baef9ec9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:35.805369 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 638/1260] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:08:35 2022] GET /identity/v3/role_assignments?user.id=ba3474e40117440498f0fe99f743df50&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:37.836395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10020179-0a18-445e-84c0-f1d96ebd6bbf None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:37.836952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10020179-0a18-445e-84c0-f1d96ebd6bbf None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:37.836952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10020179-0a18-445e-84c0-f1d96ebd6bbf None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:37.838338 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 623/1261] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:08:37.843875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb3fd0-282c-4b4e-a019-2107ef9f71c1 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:37.844322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb3fd0-282c-4b4e-a019-2107ef9f71c1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:37.844466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb3fd0-282c-4b4e-a019-2107ef9f71c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:37.862846 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ecfb3fd0-282c-4b4e-a019-2107ef9f71c1 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:08:37.864021 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ecfb3fd0-282c-4b4e-a019-2107ef9f71c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:08:37.931126 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 639/1262] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:08:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:08:37.969612 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10020179-0a18-445e-84c0-f1d96ebd6bbf None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:37.980887 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:38.068913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10020179-0a18-445e-84c0-f1d96ebd6bbf None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:38.101309 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e96236-9004-4070-9e5d-b36f811257b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:38.102029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e96236-9004-4070-9e5d-b36f811257b8 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:38.102302 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e96236-9004-4070-9e5d-b36f811257b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:38.102573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e96236-9004-4070-9e5d-b36f811257b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:38.112895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e96236-9004-4070-9e5d-b36f811257b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:08:38.121197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-19e96236-9004-4070-9e5d-b36f811257b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:08:38.121197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:38.121197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:38.121197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:38.121197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:38.121197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:38.121197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:38.121197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:38.121197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:38.121197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:38.121197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:38.121197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:38.121197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:08:38.121197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:08:38.121197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:08:38.121197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:08:38.122132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:08:38.122132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:08:38.122132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:08:38.122132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:08:38.122132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:38.122132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:38.122132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:38.122132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:38.122132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:38.122132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:38.122132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:38.122132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:38.122132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:38.122132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:38.122132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:38.122132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:38.122958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:38.122958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:38.122958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:38.122958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:38.122958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:08:38.122958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:08:38.122958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:08:38.122958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:08:38.122958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:08:38.122958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:08:38.122958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:08:38.122958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:08:38.122958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 624/1263] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:08:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:38.128436 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb3fd0-282c-4b4e-a019-2107ef9f71c1 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:38.146293 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:38.223400 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb3fd0-282c-4b4e-a019-2107ef9f71c1 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:38.258925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f1c6f-fb9b-416a-bf57-87d5b3fe4392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:38.259595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f1c6f-fb9b-416a-bf57-87d5b3fe4392 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:38.259876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f1c6f-fb9b-416a-bf57-87d5b3fe4392 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:38.260148 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f1c6f-fb9b-416a-bf57-87d5b3fe4392 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:38.260959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f1c6f-fb9b-416a-bf57-87d5b3fe4392 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:38.261265 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f1c6f-fb9b-416a-bf57-87d5b3fe4392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:38.262616 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f1c6f-fb9b-416a-bf57-87d5b3fe4392 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:38.270483 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 640/1264] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:08:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:38.276214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e96236-9004-4070-9e5d-b36f811257b8 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:38.341056 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:38.375477 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e96236-9004-4070-9e5d-b36f811257b8 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:38.409462 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b614f-32f9-436e-92dc-d17d48e13ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:38.410281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b614f-32f9-436e-92dc-d17d48e13ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:38.410594 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b614f-32f9-436e-92dc-d17d48e13ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:38.410881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b614f-32f9-436e-92dc-d17d48e13ad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:38.427362 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b614f-32f9-436e-92dc-d17d48e13ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:38.428874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b614f-32f9-436e-92dc-d17d48e13ad9 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:38.447433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-a44b614f-32f9-436e-92dc-d17d48e13ad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:38.447433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:38.447433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:38.447433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:38.447433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:38.447433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:38.447433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:38.447433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:38.447433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:38.447433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:38.447433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:38.447433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:38.447433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:08:38.447433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:08:38.447433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:38.448864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:38.450032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:08:38.450032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:08:38.450032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:38.450032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:08:38.450032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 625/1265] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:38.454553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f1c6f-fb9b-416a-bf57-87d5b3fe4392 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:38.539795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:38.559425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f1c6f-fb9b-416a-bf57-87d5b3fe4392 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:38.591951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9062a4-f664-48a2-bd11-22c6ef53a320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:38.592628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9062a4-f664-48a2-bd11-22c6ef53a320 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:38.592910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9062a4-f664-48a2-bd11-22c6ef53a320 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:38.593183 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9062a4-f664-48a2-bd11-22c6ef53a320 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:38.593885 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9062a4-f664-48a2-bd11-22c6ef53a320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:38.594181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9062a4-f664-48a2-bd11-22c6ef53a320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:38.595523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9062a4-f664-48a2-bd11-22c6ef53a320 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:38.608369 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 641/1266] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:38.614426 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b614f-32f9-436e-92dc-d17d48e13ad9 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:38.711436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b614f-32f9-436e-92dc-d17d48e13ad9 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:38.731351 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:38.745818 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dee389-3d3e-4e42-8bf8-be8f852f093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:38.746549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dee389-3d3e-4e42-8bf8-be8f852f093f None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:38.746835 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dee389-3d3e-4e42-8bf8-be8f852f093f None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:38.747109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dee389-3d3e-4e42-8bf8-be8f852f093f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:38.754496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dee389-3d3e-4e42-8bf8-be8f852f093f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:38.755938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dee389-3d3e-4e42-8bf8-be8f852f093f None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:38.770236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-05dee389-3d3e-4e42-8bf8-be8f852f093f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 16:08:38.770236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:38.770236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:38.770236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:38.770236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:38.770236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:38.770236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:38.770236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:38.770236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:38.770236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:38.770236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:38.770236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:38.770236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:08:38.770236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:08:38.770236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:08:38.770236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:38.771305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:38.772228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:38.772228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:38.772228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:08:38.772228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:08:38.772228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:08:38.772228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:08:38.772228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:08:38.772228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:08:38.772228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 16:08:38.772228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:08:38.772228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 626/1267] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:38.778082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9062a4-f664-48a2-bd11-22c6ef53a320 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:38.882302 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9062a4-f664-48a2-bd11-22c6ef53a320 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:38.916380 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403aa20-f70e-4967-82eb-cfdf96795bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:38.917077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403aa20-f70e-4967-82eb-cfdf96795bdd None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:38.917365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403aa20-f70e-4967-82eb-cfdf96795bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:38.917650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403aa20-f70e-4967-82eb-cfdf96795bdd None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:38.918478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403aa20-f70e-4967-82eb-cfdf96795bdd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:38.918788 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403aa20-f70e-4967-82eb-cfdf96795bdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:38.920207 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403aa20-f70e-4967-82eb-cfdf96795bdd None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:38.929474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:38.938979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 642/1268] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jul 25 16:08:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:38.945210 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dee389-3d3e-4e42-8bf8-be8f852f093f None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:39.053461 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dee389-3d3e-4e42-8bf8-be8f852f093f None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:39.087865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b510d7-8c7a-495e-9a67-b71cae26b4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:39.089273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b510d7-8c7a-495e-9a67-b71cae26b4db None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:39.089555 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b510d7-8c7a-495e-9a67-b71cae26b4db None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:39.089836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b510d7-8c7a-495e-9a67-b71cae26b4db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:39.100838 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b510d7-8c7a-495e-9a67-b71cae26b4db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:39.102347 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b510d7-8c7a-495e-9a67-b71cae26b4db None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:39.119282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-d0b510d7-8c7a-495e-9a67-b71cae26b4db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:39.119282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:39.119282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:39.119282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:39.119282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:39.119282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:39.119282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:39.119282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:39.119282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:39.119282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:39.119282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:39.119282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:39.119282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:08:39.119282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:08:39.119282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:39.120424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:39.121559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:08:39.121559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:08:39.121559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:39.121559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:08:39.121559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 627/1269] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:39.126453 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403aa20-f70e-4967-82eb-cfdf96795bdd None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:39.231104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403aa20-f70e-4967-82eb-cfdf96795bdd None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:39.266415 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5aa040-0c18-40b3-b313-b42606ea1b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:39.267139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aa040-0c18-40b3-b313-b42606ea1b2c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:39.267458 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aa040-0c18-40b3-b313-b42606ea1b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:39.267767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aa040-0c18-40b3-b313-b42606ea1b2c None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:39.268513 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5aa040-0c18-40b3-b313-b42606ea1b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:39.268822 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5aa040-0c18-40b3-b313-b42606ea1b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:39.270175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5aa040-0c18-40b3-b313-b42606ea1b2c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:39.281616 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 643/1270] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:39.287393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b510d7-8c7a-495e-9a67-b71cae26b4db None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:39.321904 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:39.390143 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b510d7-8c7a-495e-9a67-b71cae26b4db None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:39.422590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28570a-f37b-4e14-8749-6899aeb222dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:39.423379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28570a-f37b-4e14-8749-6899aeb222dc None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:39.423662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28570a-f37b-4e14-8749-6899aeb222dc None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:39.423937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28570a-f37b-4e14-8749-6899aeb222dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:39.430371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28570a-f37b-4e14-8749-6899aeb222dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:39.431830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28570a-f37b-4e14-8749-6899aeb222dc None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:39.446341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-ac28570a-f37b-4e14-8749-6899aeb222dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:08:39.446341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:39.446341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:39.446341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:39.446341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:39.446341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:39.446341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:39.446341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:39.446341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:39.446341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:39.446341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:39.446341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:39.446341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:08:39.446341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:08:39.446341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:39.447383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:39.449040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:08:39.449040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:08:39.449040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:08:39.449040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:08:39.449040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:08:39.449040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:08:39.449040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:08:39.449040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:08:39.449040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 628/1271] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:08:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:39.453967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5aa040-0c18-40b3-b313-b42606ea1b2c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:39.514549 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:39.562289 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5aa040-0c18-40b3-b313-b42606ea1b2c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:39.598320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eba465-bb4c-4e02-9bfb-d971f0fdec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:39.598950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eba465-bb4c-4e02-9bfb-d971f0fdec9b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:39.599186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eba465-bb4c-4e02-9bfb-d971f0fdec9b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:39.599463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eba465-bb4c-4e02-9bfb-d971f0fdec9b None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:39.600289 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eba465-bb4c-4e02-9bfb-d971f0fdec9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:39.600593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eba465-bb4c-4e02-9bfb-d971f0fdec9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:39.602026 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eba465-bb4c-4e02-9bfb-d971f0fdec9b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:39.616189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 644/1272] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:08:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:39.623221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28570a-f37b-4e14-8749-6899aeb222dc None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:39.729496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:39.738588 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28570a-f37b-4e14-8749-6899aeb222dc None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:39.775368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95a1ec-60a2-43cb-90ac-65fdfe8fb96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:39.777151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95a1ec-60a2-43cb-90ac-65fdfe8fb96b None admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:39.777437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95a1ec-60a2-43cb-90ac-65fdfe8fb96b None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:39.777714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95a1ec-60a2-43cb-90ac-65fdfe8fb96b None admin] PATH_INFO: `/v3/projects/0c9d252e2e0347029d58192fab233f09/users/ba3474e40117440498f0fe99f743df50/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:39.779782 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95a1ec-60a2-43cb-90ac-65fdfe8fb96b None admin] RBAC: Authorizing `identity:create_grant(project_id=0c9d252e2e0347029d58192fab233f09, user_id=ba3474e40117440498f0fe99f743df50, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:39.781256 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95a1ec-60a2-43cb-90ac-65fdfe8fb96b None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:39.794496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 629/1273] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Jul 25 16:08:39 2022] PUT /identity/v3/projects/0c9d252e2e0347029d58192fab233f09/users/ba3474e40117440498f0fe99f743df50/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:08:41.803401 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f077f2c-abe4-4c1e-83e5-46400e59e6a0 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:41.803930 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f077f2c-abe4-4c1e-83e5-46400e59e6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:41.803930 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f077f2c-abe4-4c1e-83e5-46400e59e6a0 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:41.805327 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 645/1274] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:08:41.810670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c8746-483f-4157-9cff-b53bb79f88d4 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:41.811139 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c8746-483f-4157-9cff-b53bb79f88d4 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:41.811233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c8746-483f-4157-9cff-b53bb79f88d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:41.829754 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-581c8746-483f-4157-9cff-b53bb79f88d4 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:08:41.830935 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-581c8746-483f-4157-9cff-b53bb79f88d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:08:41.898183 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 630/1275] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:08:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:08:41.921522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f077f2c-abe4-4c1e-83e5-46400e59e6a0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:42.042348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f077f2c-abe4-4c1e-83e5-46400e59e6a0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:42.059858 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:42.077034 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e2145-0ed8-42cb-a8d2-add6a07ae3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:42.077834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e2145-0ed8-42cb-a8d2-add6a07ae3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:42.078118 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e2145-0ed8-42cb-a8d2-add6a07ae3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:42.078392 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e2145-0ed8-42cb-a8d2-add6a07ae3d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:42.089126 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e2145-0ed8-42cb-a8d2-add6a07ae3d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 16:08:42.096933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b05e2145-0ed8-42cb-a8d2-add6a07ae3d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:08:42.096933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:42.096933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:42.096933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:42.096933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:42.096933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:42.096933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:42.096933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:42.096933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:42.096933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:42.096933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:42.096933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:42.096933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 16:08:42.096933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 16:08:42.096933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 16:08:42.096933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 16:08:42.098079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 16:08:42.098079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 16:08:42.098079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 16:08:42.098079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 16:08:42.098079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:42.098079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:42.098079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:42.098079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:42.098079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:42.098079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:42.098079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:42.098079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:42.098079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:42.098079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:42.098079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:42.098079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:42.099093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:42.099093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:42.099093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:42.099093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:42.099093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 16:08:42.099093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 16:08:42.099093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 16:08:42.099093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 16:08:42.099093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 16:08:42.099093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 16:08:42.099093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 16:08:42.099093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:42.099093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 646/1276] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Jul 25 16:08:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:42.104494 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c8746-483f-4157-9cff-b53bb79f88d4 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:42.184730 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:42.204065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c8746-483f-4157-9cff-b53bb79f88d4 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:42.238922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0bd48-86f1-4eae-96d9-be60d70e1d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:42.239604 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0bd48-86f1-4eae-96d9-be60d70e1d56 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:42.239889 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0bd48-86f1-4eae-96d9-be60d70e1d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:42.240167 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0bd48-86f1-4eae-96d9-be60d70e1d56 None admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:42.240941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0bd48-86f1-4eae-96d9-be60d70e1d56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:42.241250 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0bd48-86f1-4eae-96d9-be60d70e1d56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:42.242622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0bd48-86f1-4eae-96d9-be60d70e1d56 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:42.251264 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 631/1277] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Jul 25 16:08:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:42.257141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e2145-0ed8-42cb-a8d2-add6a07ae3d7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:42.358850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e2145-0ed8-42cb-a8d2-add6a07ae3d7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:42.391397 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d656f6f-b198-46bf-b90e-75158d561a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:42.392176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d656f6f-b198-46bf-b90e-75158d561a8a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:42.392487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d656f6f-b198-46bf-b90e-75158d561a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:42.392766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d656f6f-b198-46bf-b90e-75158d561a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:42.403173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d656f6f-b198-46bf-b90e-75158d561a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:42.404634 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d656f6f-b198-46bf-b90e-75158d561a8a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:42.420964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-5d656f6f-b198-46bf-b90e-75158d561a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:42.420964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:42.420964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:42.420964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:42.420964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:42.420964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:42.420964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:42.420964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:42.420964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:42.420964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:42.420964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:42.420964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:42.420964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:08:42.420964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:08:42.420964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:42.421992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:42.422973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:08:42.422973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:08:42.422973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:42.422973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:42.422973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 647/1278] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:42.427928 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0bd48-86f1-4eae-96d9-be60d70e1d56 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:42.525741 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0bd48-86f1-4eae-96d9-be60d70e1d56 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:42.558495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9dc4e-27b7-45d4-acb9-0c621c1f355e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:42.559146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9dc4e-27b7-45d4-acb9-0c621c1f355e None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:42.559428 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9dc4e-27b7-45d4-acb9-0c621c1f355e None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:42.559703 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9dc4e-27b7-45d4-acb9-0c621c1f355e None admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:42.560443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9dc4e-27b7-45d4-acb9-0c621c1f355e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:42.560748 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9dc4e-27b7-45d4-acb9-0c621c1f355e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:42.562115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9dc4e-27b7-45d4-acb9-0c621c1f355e None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:42.574263 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 632/1279] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:42.580141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d656f6f-b198-46bf-b90e-75158d561a8a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:42.610851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:42.680728 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d656f6f-b198-46bf-b90e-75158d561a8a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:42.714370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e0e99-3556-422e-a312-b9339bfcf274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:42.715164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e0e99-3556-422e-a312-b9339bfcf274 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:42.715452 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e0e99-3556-422e-a312-b9339bfcf274 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:42.715732 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e0e99-3556-422e-a312-b9339bfcf274 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:42.723046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e0e99-3556-422e-a312-b9339bfcf274 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:42.724519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e0e99-3556-422e-a312-b9339bfcf274 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:42.738935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-eb3e0e99-3556-422e-a312-b9339bfcf274 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 16:08:42.738935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:42.738935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:42.738935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:42.738935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:42.738935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:42.738935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:42.738935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:42.738935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:42.738935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:42.738935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:42.738935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:42.738935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 16:08:42.738935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 16:08:42.738935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 16:08:42.738935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:42.740079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:42.741219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:42.741219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:42.741219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 16:08:42.741219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 16:08:42.741219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 16:08:42.741219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 16:08:42.741219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 16:08:42.741219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 16:08:42.741219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 16:08:42.741219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:42.741219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 648/1280] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:42.746167 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9dc4e-27b7-45d4-acb9-0c621c1f355e None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:42.750108 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:42.846035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9dc4e-27b7-45d4-acb9-0c621c1f355e None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:42.879131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f72477-7d28-4be5-9991-b1137eeea303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:42.879725 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f72477-7d28-4be5-9991-b1137eeea303 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:42.880010 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f72477-7d28-4be5-9991-b1137eeea303 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:42.880364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f72477-7d28-4be5-9991-b1137eeea303 None admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:42.881148 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f72477-7d28-4be5-9991-b1137eeea303 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:42.881458 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f72477-7d28-4be5-9991-b1137eeea303 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:42.882899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f72477-7d28-4be5-9991-b1137eeea303 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:42.899955 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 633/1281] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Jul 25 16:08:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:42.906634 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e0e99-3556-422e-a312-b9339bfcf274 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:43.001572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:43.012711 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e0e99-3556-422e-a312-b9339bfcf274 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:43.046946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff72fa-c732-4171-8d89-c877f1f9392a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:43.047598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff72fa-c732-4171-8d89-c877f1f9392a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:43.047882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff72fa-c732-4171-8d89-c877f1f9392a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:43.048160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff72fa-c732-4171-8d89-c877f1f9392a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:43.120578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff72fa-c732-4171-8d89-c877f1f9392a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:43.122013 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff72fa-c732-4171-8d89-c877f1f9392a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:43.212782 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:43.223564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 649/1282] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Jul 25 16:08:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 16:08:43.229483 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f72477-7d28-4be5-9991-b1137eeea303 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:43.294598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:43.333296 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f72477-7d28-4be5-9991-b1137eeea303 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:43.370625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef3517-bc25-41aa-adaa-49fa312a9110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:43.371432 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef3517-bc25-41aa-adaa-49fa312a9110 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:43.371719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef3517-bc25-41aa-adaa-49fa312a9110 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:43.372000 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef3517-bc25-41aa-adaa-49fa312a9110 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:43.383704 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef3517-bc25-41aa-adaa-49fa312a9110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:43.385228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef3517-bc25-41aa-adaa-49fa312a9110 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:43.403709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-8fef3517-bc25-41aa-adaa-49fa312a9110 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:43.403709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:43.403709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:43.403709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:43.403709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:43.403709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:43.403709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:43.403709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:43.403709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:43.403709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:43.403709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:43.403709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:43.403709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 16:08:43.403709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 16:08:43.403709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:43.404830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:43.405859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 16:08:43.405859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 16:08:43.405859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 16:08:43.405859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:08:43.405859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 634/1283] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:43.410895 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff72fa-c732-4171-8d89-c877f1f9392a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:43.510099 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff72fa-c732-4171-8d89-c877f1f9392a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:43.545049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5c49c-2c60-466d-b739-2f28a66eddda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:43.546000 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5c49c-2c60-466d-b739-2f28a66eddda None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:43.546290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5c49c-2c60-466d-b739-2f28a66eddda None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:43.546569 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5c49c-2c60-466d-b739-2f28a66eddda None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:43.547281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5c49c-2c60-466d-b739-2f28a66eddda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:43.547590 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5c49c-2c60-466d-b739-2f28a66eddda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:43.548987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5c49c-2c60-466d-b739-2f28a66eddda None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:43.561003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 650/1284] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Jul 25 16:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:43.568678 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef3517-bc25-41aa-adaa-49fa312a9110 None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:43.670634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef3517-bc25-41aa-adaa-49fa312a9110 None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:43.685172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:43.704787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a027c-397f-4f2b-8f84-e719a79e170c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:43.705583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a027c-397f-4f2b-8f84-e719a79e170c None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:43.705878 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a027c-397f-4f2b-8f84-e719a79e170c None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:43.706150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a027c-397f-4f2b-8f84-e719a79e170c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:43.712691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a027c-397f-4f2b-8f84-e719a79e170c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:43.714667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a027c-397f-4f2b-8f84-e719a79e170c None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:43.728140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application [None req-e15a027c-397f-4f2b-8f84-e719a79e170c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:08:43.728140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:43.728140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:43.728140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:43.728140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:43.728140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:43.728140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:43.728140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:43.728140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:43.728140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:43.728140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:43.728140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:43.728140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 16:08:43.728140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 16:08:43.728140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:43.729212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:43.730354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 16:08:43.730354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 16:08:43.730354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 16:08:43.730354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 16:08:43.730354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 16:08:43.730354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 16:08:43.730354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 16:08:43.730354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: ERROR keystone.server.flask.application Jul 25 16:08:43.730354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 635/1285] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Jul 25 16:08:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:43.735987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5c49c-2c60-466d-b739-2f28a66eddda None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:43.785836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:43.833964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5c49c-2c60-466d-b739-2f28a66eddda None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:43.867515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fb7e6-a8ab-4a94-b78a-f4ab7d80d69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:43.868177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fb7e6-a8ab-4a94-b78a-f4ab7d80d69d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:43.868479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fb7e6-a8ab-4a94-b78a-f4ab7d80d69d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:43.868754 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fb7e6-a8ab-4a94-b78a-f4ab7d80d69d None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:43.869563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fb7e6-a8ab-4a94-b78a-f4ab7d80d69d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:43.869870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fb7e6-a8ab-4a94-b78a-f4ab7d80d69d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:43.871290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fb7e6-a8ab-4a94-b78a-f4ab7d80d69d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:43.883790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 651/1286] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Jul 25 16:08:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:08:43.890162 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a027c-397f-4f2b-8f84-e719a79e170c None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:43.992105 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a027c-397f-4f2b-8f84-e719a79e170c None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:44.023469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdaa7a-ac58-4e36-a0e5-7b486356d156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:44.024112 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdaa7a-ac58-4e36-a0e5-7b486356d156 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:44.024422 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdaa7a-ac58-4e36-a0e5-7b486356d156 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:44.024693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdaa7a-ac58-4e36-a0e5-7b486356d156 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:44.025500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdaa7a-ac58-4e36-a0e5-7b486356d156 None admin] RBAC: Adding query filter params (role.id=35424ae154084f97aaf54f3fa3c37725, scope.project.id=0c9d252e2e0347029d58192fab233f09, user.id=ba3474e40117440498f0fe99f743df50) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:44.026493 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdaa7a-ac58-4e36-a0e5-7b486356d156 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:44.028290 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdaa7a-ac58-4e36-a0e5-7b486356d156 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:44.034125 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 636/1287] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Jul 25 16:08:43 2022] GET /identity/v3/role_assignments?user.id=ba3474e40117440498f0fe99f743df50&scope.project.id=0c9d252e2e0347029d58192fab233f09&role.id=35424ae154084f97aaf54f3fa3c37725 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:46.094715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0dcca-0a5e-498c-880b-c5007181c6c3 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:46.095285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0dcca-0a5e-498c-880b-c5007181c6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:46.095285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0dcca-0a5e-498c-880b-c5007181c6c3 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:46.096736 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 652/1288] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:08:46.102414 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd61fc2-4c2b-4bdb-a912-4217cbcc660d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:46.102912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd61fc2-4c2b-4bdb-a912-4217cbcc660d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:46.103013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd61fc2-4c2b-4bdb-a912-4217cbcc660d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:46.122474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-fcd61fc2-4c2b-4bdb-a912-4217cbcc660d None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:08:46.123710 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-fcd61fc2-4c2b-4bdb-a912-4217cbcc660d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:08:46.154294 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:46.193448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 637/1289] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:08:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:08:46.216092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0dcca-0a5e-498c-880b-c5007181c6c3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:46.321877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0dcca-0a5e-498c-880b-c5007181c6c3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:46.334626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:46.359011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060eba94-3b4e-4f2a-8d05-2a8e05bbad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:46.359731 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060eba94-3b4e-4f2a-8d05-2a8e05bbad34 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:46.360012 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060eba94-3b4e-4f2a-8d05-2a8e05bbad34 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:46.360313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060eba94-3b4e-4f2a-8d05-2a8e05bbad34 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:46.360992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060eba94-3b4e-4f2a-8d05-2a8e05bbad34 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:46.362343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060eba94-3b4e-4f2a-8d05-2a8e05bbad34 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-060eba94-3b4e-4f2a-8d05-2a8e05bbad34 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:46.374888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:46.376128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:46.376128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:46.376128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:46.376128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:46.376128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:46.376128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:46.376128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:08:46.376128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:08:46.376128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:08:46.376128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:08:46.376128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:46.376128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:46.376128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:46.376128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:46.376128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:46.376128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:46.377181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:46.377181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:46.377181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:46.377181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:46.377181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:46.377181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:46.377181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:46.377181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:46.377181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:46.377181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:46.377181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:08:46.377181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:08:46.377181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 16:08:46.377181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:46.377181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 653/1290] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 25 16:08:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:46.382195 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd61fc2-4c2b-4bdb-a912-4217cbcc660d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:46.482925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd61fc2-4c2b-4bdb-a912-4217cbcc660d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:46.516689 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8901df8-1ced-4294-9ad7-1036b873b284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:46.517358 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8901df8-1ced-4294-9ad7-1036b873b284 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:46.517647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8901df8-1ced-4294-9ad7-1036b873b284 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:46.517923 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8901df8-1ced-4294-9ad7-1036b873b284 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:46.518626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8901df8-1ced-4294-9ad7-1036b873b284 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:46.518933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8901df8-1ced-4294-9ad7-1036b873b284 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:46.520324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8901df8-1ced-4294-9ad7-1036b873b284 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:46.525176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 638/1291] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Jul 25 16:08:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:08:46.531472 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060eba94-3b4e-4f2a-8d05-2a8e05bbad34 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:46.634540 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060eba94-3b4e-4f2a-8d05-2a8e05bbad34 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:46.668502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f0bd3-e6d8-40fd-bf42-7d351c29112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:46.669181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f0bd3-e6d8-40fd-bf42-7d351c29112e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:46.669462 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f0bd3-e6d8-40fd-bf42-7d351c29112e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:46.669766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f0bd3-e6d8-40fd-bf42-7d351c29112e None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:46.670604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f0bd3-e6d8-40fd-bf42-7d351c29112e None admin] RBAC: Adding query filter params (type=placement) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:46.670908 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f0bd3-e6d8-40fd-bf42-7d351c29112e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:46.672289 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f0bd3-e6d8-40fd-bf42-7d351c29112e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:46.676911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 654/1292] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Jul 25 16:08:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:48.677918 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a109a-ac10-4b62-a3e9-138e0c8ea57b None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:48.678432 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a109a-ac10-4b62-a3e9-138e0c8ea57b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:48.678432 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a109a-ac10-4b62-a3e9-138e0c8ea57b None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:48.679757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 639/1293] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:08:48.685077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c331bf3-4de1-4d4c-985e-e7512141512d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:48.685489 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c331bf3-4de1-4d4c-985e-e7512141512d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:48.685643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c331bf3-4de1-4d4c-985e-e7512141512d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:48.704221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5c331bf3-4de1-4d4c-985e-e7512141512d None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:08:48.705478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5c331bf3-4de1-4d4c-985e-e7512141512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:08:48.734326 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:48.771758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 655/1294] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:08:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:08:48.795372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a109a-ac10-4b62-a3e9-138e0c8ea57b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:48.825931 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:48.894304 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a109a-ac10-4b62-a3e9-138e0c8ea57b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:48.927447 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2b6d7-e938-4b46-835b-f2e047eaeb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:48.928232 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2b6d7-e938-4b46-835b-f2e047eaeb47 None admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:48.928503 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2b6d7-e938-4b46-835b-f2e047eaeb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:48.928819 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2b6d7-e938-4b46-835b-f2e047eaeb47 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:48.929581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2b6d7-e938-4b46-835b-f2e047eaeb47 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:48.931123 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2b6d7-e938-4b46-835b-f2e047eaeb47 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:48.949416 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 640/1295] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Jul 25 16:08:48 2022] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:08:51.050613 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754446d-e0f4-465f-a5fc-fba0f7a003b0 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:51.051203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754446d-e0f4-465f-a5fc-fba0f7a003b0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:51.051203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754446d-e0f4-465f-a5fc-fba0f7a003b0 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:51.052577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 656/1296] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:08:51.057811 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33a531-3fe6-413d-85e5-4ac16075ae6c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:51.058227 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33a531-3fe6-413d-85e5-4ac16075ae6c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:51.058375 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33a531-3fe6-413d-85e5-4ac16075ae6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:51.076575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-aa33a531-3fe6-413d-85e5-4ac16075ae6c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:08:51.077844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-aa33a531-3fe6-413d-85e5-4ac16075ae6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:08:51.147944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 641/1297] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:08:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 16:08:51.170694 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754446d-e0f4-465f-a5fc-fba0f7a003b0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:51.270771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754446d-e0f4-465f-a5fc-fba0f7a003b0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:51.303865 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0c1cf-4993-47b6-b49b-904e5febec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:51.304619 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0c1cf-4993-47b6-b49b-904e5febec80 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:51.304905 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0c1cf-4993-47b6-b49b-904e5febec80 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:51.305181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0c1cf-4993-47b6-b49b-904e5febec80 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:51.305832 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0c1cf-4993-47b6-b49b-904e5febec80 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:51.307702 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0c1cf-4993-47b6-b49b-904e5febec80 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-59e0c1cf-4993-47b6-b49b-904e5febec80 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:51.319890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:51.321046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:51.321046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:51.321046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:51.321046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:51.321046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:51.321046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:51.321046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:08:51.321046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:08:51.321046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:08:51.321046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:08:51.321046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:51.321046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:51.321046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:51.321046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:51.321046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:51.321046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:51.322046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:51.322046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:51.322046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:51.322046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:51.322046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:51.322046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:51.322046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:51.322046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:51.322046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:51.322046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:51.322046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:08:51.322046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:08:51.322046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 16:08:51.322046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:51.322046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 657/1298] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 25 16:08:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:51.327844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33a531-3fe6-413d-85e5-4ac16075ae6c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:51.345392 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:51.425771 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33a531-3fe6-413d-85e5-4ac16075ae6c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:51.459242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb4f60-c8d7-4377-8538-d5ad009e78de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:51.459940 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb4f60-c8d7-4377-8538-d5ad009e78de None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:51.460216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb4f60-c8d7-4377-8538-d5ad009e78de None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:51.460524 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb4f60-c8d7-4377-8538-d5ad009e78de None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:51.461224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb4f60-c8d7-4377-8538-d5ad009e78de None admin] RBAC: Adding query filter params (name=placement) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:51.461527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb4f60-c8d7-4377-8538-d5ad009e78de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:51.462940 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb4f60-c8d7-4377-8538-d5ad009e78de None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:51.467956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 642/1299] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Jul 25 16:08:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:51.474033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0c1cf-4993-47b6-b49b-904e5febec80 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:51.507046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:51.576870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0c1cf-4993-47b6-b49b-904e5febec80 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:51.610027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5a033-59fb-4318-a369-a1c85c66cc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:51.610674 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5a033-59fb-4318-a369-a1c85c66cc4a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:51.610962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5a033-59fb-4318-a369-a1c85c66cc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:51.611240 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5a033-59fb-4318-a369-a1c85c66cc4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:51.612021 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5a033-59fb-4318-a369-a1c85c66cc4a None admin] RBAC: Adding query filter params (interface=public, service_id=19b06d441cd2427f9086f8d23ec34423, region_id=RegionOne) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:51.612361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5a033-59fb-4318-a369-a1c85c66cc4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:51.613719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5a033-59fb-4318-a369-a1c85c66cc4a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:51.619763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 658/1300] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Jul 25 16:08:51 2022] GET /identity/v3/endpoints?service_id=19b06d441cd2427f9086f8d23ec34423&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:51.625494 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb4f60-c8d7-4377-8538-d5ad009e78de None admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:51.703708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:51.722036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb4f60-c8d7-4377-8538-d5ad009e78de None admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:51.755532 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659d440-b40b-42fb-aa66-06ede6c1e8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:51.756229 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659d440-b40b-42fb-aa66-06ede6c1e8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:51.756579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659d440-b40b-42fb-aa66-06ede6c1e8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:51.756860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659d440-b40b-42fb-aa66-06ede6c1e8a3 None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:51.757574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659d440-b40b-42fb-aa66-06ede6c1e8a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:51.759007 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659d440-b40b-42fb-aa66-06ede6c1e8a3 None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:51.766759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 643/1301] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Jul 25 16:08:51 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:08:53.789252 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b5c2-7caa-4fc1-86a6-82c417f45ae2 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:53.789857 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b5c2-7caa-4fc1-86a6-82c417f45ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:53.789857 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b5c2-7caa-4fc1-86a6-82c417f45ae2 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:53.791240 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 659/1302] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:08:53.797875 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b968653-ca89-462f-82b8-556cc6d5942d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:53.798309 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b968653-ca89-462f-82b8-556cc6d5942d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:53.798516 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b968653-ca89-462f-82b8-556cc6d5942d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:53.816995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-5b968653-ca89-462f-82b8-556cc6d5942d None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:08:53.818180 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5b968653-ca89-462f-82b8-556cc6d5942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:08:53.884023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 644/1303] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:08:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 16:08:53.906607 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4b5c2-7caa-4fc1-86a6-82c417f45ae2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:54.000714 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:54.007491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4b5c2-7caa-4fc1-86a6-82c417f45ae2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:54.040088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e4651-8e58-4016-b78c-403d57c4f0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:54.040844 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4651-8e58-4016-b78c-403d57c4f0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:54.041664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4651-8e58-4016-b78c-403d57c4f0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:54.041942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4651-8e58-4016-b78c-403d57c4f0d3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:54.042585 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e4651-8e58-4016-b78c-403d57c4f0d3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:54.043940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e4651-8e58-4016-b78c-403d57c4f0d3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-210e4651-8e58-4016-b78c-403d57c4f0d3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 16:08:54.055876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 16:08:54.057707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 16:08:54.057707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 16:08:54.057707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 16:08:54.057707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 16:08:54.057707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 16:08:54.057707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 16:08:54.057707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 16:08:54.057707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 16:08:54.057707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 16:08:54.057707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 16:08:54.057707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 16:08:54.057707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 16:08:54.057707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 16:08:54.057707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 16:08:54.057707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 16:08:54.057707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 16:08:54.059035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 16:08:54.059035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( Jul 25 16:08:54.059035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 16:08:54.059035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() Jul 25 16:08:54.059035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 16:08:54.059035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 16:08:54.059035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 16:08:54.059035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() Jul 25 16:08:54.059035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 16:08:54.059035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( Jul 25 16:08:54.059035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 16:08:54.059035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 16:08:54.059035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 16:08:54.059035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Jul 25 16:08:54.059035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 660/1304] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Jul 25 16:08:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 16:08:54.063954 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b968653-ca89-462f-82b8-556cc6d5942d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:54.138938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:08:54.162312 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b968653-ca89-462f-82b8-556cc6d5942d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:54.195850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54184e58-ebaa-496f-bb9c-2aa1a82fc45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:54.196531 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54184e58-ebaa-496f-bb9c-2aa1a82fc45d None admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:54.196819 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54184e58-ebaa-496f-bb9c-2aa1a82fc45d None admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:54.197132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54184e58-ebaa-496f-bb9c-2aa1a82fc45d None admin] PATH_INFO: `/v3/services` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:54.197989 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54184e58-ebaa-496f-bb9c-2aa1a82fc45d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:08:54.198292 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54184e58-ebaa-496f-bb9c-2aa1a82fc45d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:54.199655 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54184e58-ebaa-496f-bb9c-2aa1a82fc45d None admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:54.204686 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 645/1305] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Jul 25 16:08:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:08:54.210495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e4651-8e58-4016-b78c-403d57c4f0d3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:08:54.313040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e4651-8e58-4016-b78c-403d57c4f0d3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:08:54.350027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f7f86-63ed-400e-acc0-6fc155399483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:08:54.350687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f7f86-63ed-400e-acc0-6fc155399483 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:08:54.350972 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f7f86-63ed-400e-acc0-6fc155399483 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:08:54.351248 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f7f86-63ed-400e-acc0-6fc155399483 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:08:54.351991 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f7f86-63ed-400e-acc0-6fc155399483 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:08:54.353469 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f7f86-63ed-400e-acc0-6fc155399483 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:08:54.381424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 661/1306] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:08:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:09:04.202793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=30 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:09:04.370065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:09:58.966177 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e87e9b-a05c-4121-a419-d78f25975b90 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:09:58.967255 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e87e9b-a05c-4121-a419-d78f25975b90 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:09:58.967775 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e87e9b-a05c-4121-a419-d78f25975b90 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:09:58.974800 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b721e79-fcb0-4163-8710-ac565360830f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:09:58.975719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b721e79-fcb0-4163-8710-ac565360830f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:09:58.976960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b721e79-fcb0-4163-8710-ac565360830f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:09:58.980592 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 646/1307] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:09:58 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:09:59.075043 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9b721e79-fcb0-4163-8710-ac565360830f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:09:59.076808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9b721e79-fcb0-4163-8710-ac565360830f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:09:59.215037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 662/1308] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:09:59.288941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d405ad6-eb7d-4d74-987c-0135137fc18a None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:09:59.289945 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d405ad6-eb7d-4d74-987c-0135137fc18a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:09:59.290439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d405ad6-eb7d-4d74-987c-0135137fc18a None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:09:59.292540 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 647/1309] 10.222.0.70 () {54 vars in 965 bytes} [Mon Jul 25 16:09:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:09:59.298663 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac6197-786c-4a0e-85a4-0f5deec9501f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:09:59.298973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac6197-786c-4a0e-85a4-0f5deec9501f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:09:59.299249 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac6197-786c-4a0e-85a4-0f5deec9501f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:09:59.412130 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-28ac6197-786c-4a0e-85a4-0f5deec9501f None None] MFA Rules not processed for user `ad22a7d1e01c4c40b7cbefe971755148`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:09:59.413367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-28ac6197-786c-4a0e-85a4-0f5deec9501f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:09:59.436712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:09:59.514690 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d405ad6-eb7d-4d74-987c-0135137fc18a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:09:59.516558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9d405ad6-eb7d-4d74-987c-0135137fc18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:09:59.524688 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 663/1310] 10.222.0.70 () {58 vars in 1062 bytes} [Mon Jul 25 16:09:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:09:59.653280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d405ad6-eb7d-4d74-987c-0135137fc18a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:09:59.731398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5b481-2818-4a4d-b530-0dd4ed7cd9cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:09:59.732063 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5b481-2818-4a4d-b530-0dd4ed7cd9cf service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:09:59.732372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5b481-2818-4a4d-b530-0dd4ed7cd9cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:09:59.732654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5b481-2818-4a4d-b530-0dd4ed7cd9cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:09:59.734295 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3dd5b481-2818-4a4d-b530-0dd4ed7cd9cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:09:59.790758 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:09:59.849830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5b481-2818-4a4d-b530-0dd4ed7cd9cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:09:59.851342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5b481-2818-4a4d-b530-0dd4ed7cd9cf service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:09:59.883351 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 648/1311] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:10:02.234507 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa0b87-c468-489d-8871-24bff75ea377 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:02.234914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa0b87-c468-489d-8871-24bff75ea377 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:02.235104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa0b87-c468-489d-8871-24bff75ea377 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:02.236820 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 664/1312] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:02.242795 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9166a9-2814-4b56-a5ba-b28d53b1c55a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:02.243323 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9166a9-2814-4b56-a5ba-b28d53b1c55a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:02.243323 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9166a9-2814-4b56-a5ba-b28d53b1c55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:02.322888 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-4a9166a9-2814-4b56-a5ba-b28d53b1c55a None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:02.323534 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4a9166a9-2814-4b56-a5ba-b28d53b1c55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:02.426937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 649/1313] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:10:02.466116 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa0b87-c468-489d-8871-24bff75ea377 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:10:02.467695 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ccfa0b87-c468-489d-8871-24bff75ea377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:02.579637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa0b87-c468-489d-8871-24bff75ea377 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:10:02.664321 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:02.666912 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f46ad-d89d-43e2-aa21-29b31c1c1e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:10:02.667569 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f46ad-d89d-43e2-aa21-29b31c1c1e7b service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:02.667939 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f46ad-d89d-43e2-aa21-29b31c1c1e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:02.668104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f46ad-d89d-43e2-aa21-29b31c1c1e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:02.670199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-216f46ad-d89d-43e2-aa21-29b31c1c1e7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:02.794215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f46ad-d89d-43e2-aa21-29b31c1c1e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:10:02.795691 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f46ad-d89d-43e2-aa21-29b31c1c1e7b service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:10:02.816624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 665/1314] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:10:05.195770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae986-2f4c-4b43-8713-e588b344114f None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:05.196380 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae986-2f4c-4b43-8713-e588b344114f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:05.196380 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae986-2f4c-4b43-8713-e588b344114f None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:05.197708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 650/1315] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:05.202778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0a92-f45b-44b5-a713-e11885a9bec0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:05.203194 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0a92-f45b-44b5-a713-e11885a9bec0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:05.203339 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0a92-f45b-44b5-a713-e11885a9bec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:05.268633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-010d0a92-f45b-44b5-a713-e11885a9bec0 None None] MFA Rules not processed for user `a7a1941bc6e143339ac7d433511016f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:05.269863 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-010d0a92-f45b-44b5-a713-e11885a9bec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:05.320961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:05.365221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 666/1316] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:10:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:10:05.419453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ab08c-efda-437a-9cf4-ccacb5b61a68 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:05.419738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ab08c-efda-437a-9cf4-ccacb5b61a68 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:05.420015 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ab08c-efda-437a-9cf4-ccacb5b61a68 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:05.421420 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 651/1317] 10.222.0.70 () {54 vars in 965 bytes} [Mon Jul 25 16:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:05.427385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0b2f5-60a6-47a3-aa15-40ac0eea47ad None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:05.427684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0b2f5-60a6-47a3-aa15-40ac0eea47ad None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:05.427966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0b2f5-60a6-47a3-aa15-40ac0eea47ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:05.501947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3ee0b2f5-60a6-47a3-aa15-40ac0eea47ad None None] MFA Rules not processed for user `ad22a7d1e01c4c40b7cbefe971755148`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:05.503152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3ee0b2f5-60a6-47a3-aa15-40ac0eea47ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:05.578031 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 667/1318] 10.222.0.70 () {58 vars in 1062 bytes} [Mon Jul 25 16:10:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:10:05.587789 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ab08c-efda-437a-9cf4-ccacb5b61a68 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:10:05.589382 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4b5ab08c-efda-437a-9cf4-ccacb5b61a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:05.598898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:05.690215 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ab08c-efda-437a-9cf4-ccacb5b61a68 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:10:05.765080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf43c9-2d3a-4197-8e00-0b8d46f1ad56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:10:05.765744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf43c9-2d3a-4197-8e00-0b8d46f1ad56 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:05.766024 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf43c9-2d3a-4197-8e00-0b8d46f1ad56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:05.766300 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf43c9-2d3a-4197-8e00-0b8d46f1ad56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:05.767940 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-00bf43c9-2d3a-4197-8e00-0b8d46f1ad56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:05.831725 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:05.880773 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf43c9-2d3a-4197-8e00-0b8d46f1ad56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:10:05.882278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf43c9-2d3a-4197-8e00-0b8d46f1ad56 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:10:05.902008 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 652/1319] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:10:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:10:08.852179 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc35a2e-d431-488c-9ef7-957e3fdbeba0 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:08.852747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc35a2e-d431-488c-9ef7-957e3fdbeba0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:08.852747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc35a2e-d431-488c-9ef7-957e3fdbeba0 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:08.854743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 668/1320] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:10:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:08.860310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfffbab-783a-4f17-a30f-18f5e513763e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:08.860899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfffbab-783a-4f17-a30f-18f5e513763e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:08.861063 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfffbab-783a-4f17-a30f-18f5e513763e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:08.931540 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-4dfffbab-783a-4f17-a30f-18f5e513763e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:08.933057 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4dfffbab-783a-4f17-a30f-18f5e513763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:09.029385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 653/1321] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:10:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:10:09.068040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc35a2e-d431-488c-9ef7-957e3fdbeba0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:10:09.070212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4dc35a2e-d431-488c-9ef7-957e3fdbeba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:09.121150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:09.174748 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc35a2e-d431-488c-9ef7-957e3fdbeba0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:10:09.252449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf448b2-30ca-4f01-9e92-fa7d356579e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:10:09.253105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf448b2-30ca-4f01-9e92-fa7d356579e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:09.253387 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf448b2-30ca-4f01-9e92-fa7d356579e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:09.253667 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf448b2-30ca-4f01-9e92-fa7d356579e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:09.255279 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ddf448b2-30ca-4f01-9e92-fa7d356579e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:09.349985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:09.363901 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf448b2-30ca-4f01-9e92-fa7d356579e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:10:09.365378 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf448b2-30ca-4f01-9e92-fa7d356579e8 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:10:09.383796 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 669/1322] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:10:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:10:12.084133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5742c7a-9cb2-4841-976e-73a629f5b17e None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:12.084727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5742c7a-9cb2-4841-976e-73a629f5b17e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:12.084820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5742c7a-9cb2-4841-976e-73a629f5b17e None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:12.087027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 654/1323] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:10:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:12.092165 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9b9cb-a0d7-47e4-a2c6-579117188786 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:12.092632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9b9cb-a0d7-47e4-a2c6-579117188786 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:12.092860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9b9cb-a0d7-47e4-a2c6-579117188786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:12.160446 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-95a9b9cb-a0d7-47e4-a2c6-579117188786 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:12.161660 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-95a9b9cb-a0d7-47e4-a2c6-579117188786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:12.272278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 670/1324] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:10:12.312790 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5742c7a-9cb2-4841-976e-73a629f5b17e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:10:12.314334 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f5742c7a-9cb2-4841-976e-73a629f5b17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:12.338624 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:12.436545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5742c7a-9cb2-4841-976e-73a629f5b17e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:10:12.510555 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cb8a7-0d46-48ec-a42c-3c9b81d4714b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:10:12.511212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cb8a7-0d46-48ec-a42c-3c9b81d4714b service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:12.511497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cb8a7-0d46-48ec-a42c-3c9b81d4714b service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:12.511776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cb8a7-0d46-48ec-a42c-3c9b81d4714b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:12.513460 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bf1cb8a7-0d46-48ec-a42c-3c9b81d4714b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:12.584816 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:12.625624 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cb8a7-0d46-48ec-a42c-3c9b81d4714b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:10:12.626978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cb8a7-0d46-48ec-a42c-3c9b81d4714b service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:10:12.645813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 655/1325] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:10:14.851387 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15efdb4-e585-42f4-9524-f3e2d0b6c06e None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:14.851929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15efdb4-e585-42f4-9524-f3e2d0b6c06e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:14.851929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15efdb4-e585-42f4-9524-f3e2d0b6c06e None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:14.853796 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 671/1326] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:14.859263 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d26d97-d3b2-4108-a89f-169d1c84b890 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:14.859730 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d26d97-d3b2-4108-a89f-169d1c84b890 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:14.859827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d26d97-d3b2-4108-a89f-169d1c84b890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:14.926981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-f5d26d97-d3b2-4108-a89f-169d1c84b890 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:14.928213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f5d26d97-d3b2-4108-a89f-169d1c84b890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:15.027277 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 656/1327] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:10:15.063128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15efdb4-e585-42f4-9524-f3e2d0b6c06e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:10:15.064757 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c15efdb4-e585-42f4-9524-f3e2d0b6c06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:15.131525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:15.183258 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15efdb4-e585-42f4-9524-f3e2d0b6c06e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:10:15.270896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c80b2-0ab3-4857-909d-e389ac896e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:10:15.271594 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c80b2-0ab3-4857-909d-e389ac896e09 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:15.271904 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c80b2-0ab3-4857-909d-e389ac896e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:15.272229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c80b2-0ab3-4857-909d-e389ac896e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:15.274590 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-562c80b2-0ab3-4857-909d-e389ac896e09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:15.399715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:15.403083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c80b2-0ab3-4857-909d-e389ac896e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:10:15.404780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c80b2-0ab3-4857-909d-e389ac896e09 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:10:15.424619 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 672/1328] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:10:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:10:17.500308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca3f7c-cc1c-4c67-a4f2-ea44ee51ace4 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:17.500910 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca3f7c-cc1c-4c67-a4f2-ea44ee51ace4 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:17.500910 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca3f7c-cc1c-4c67-a4f2-ea44ee51ace4 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:17.502233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 657/1329] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:17.508007 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17330b-92a3-4d8c-98fb-b07457fffbc3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:17.508545 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17330b-92a3-4d8c-98fb-b07457fffbc3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:17.508782 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17330b-92a3-4d8c-98fb-b07457fffbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:17.579513 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8d17330b-92a3-4d8c-98fb-b07457fffbc3 None None] MFA Rules not processed for user `a7a1941bc6e143339ac7d433511016f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:17.580777 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8d17330b-92a3-4d8c-98fb-b07457fffbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:17.688456 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 673/1330] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:10:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:10:17.729837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca3f7c-cc1c-4c67-a4f2-ea44ee51ace4 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:10:17.731397 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ccca3f7c-cc1c-4c67-a4f2-ea44ee51ace4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:17.765595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:17.838291 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca3f7c-cc1c-4c67-a4f2-ea44ee51ace4 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:10:17.913653 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781904a-3d4b-432e-99bb-fce26428dc0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:10:17.914364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781904a-3d4b-432e-99bb-fce26428dc0c service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:17.914843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781904a-3d4b-432e-99bb-fce26428dc0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:17.915084 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781904a-3d4b-432e-99bb-fce26428dc0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:17.916855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d781904a-3d4b-432e-99bb-fce26428dc0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:18.003642 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:18.038596 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781904a-3d4b-432e-99bb-fce26428dc0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:10:18.040169 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781904a-3d4b-432e-99bb-fce26428dc0c service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:10:18.072744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 658/1331] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:10:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:10:20.404085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caed913-1c46-4b6b-9107-1191c2967e56 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:20.404661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caed913-1c46-4b6b-9107-1191c2967e56 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:20.404661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caed913-1c46-4b6b-9107-1191c2967e56 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:20.406058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 674/1332] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:20.411261 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586052ff-9a7a-4ab1-9f4f-35c263e7367e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:20.411651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586052ff-9a7a-4ab1-9f4f-35c263e7367e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:20.411821 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586052ff-9a7a-4ab1-9f4f-35c263e7367e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:20.477804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-586052ff-9a7a-4ab1-9f4f-35c263e7367e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:20.479018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-586052ff-9a7a-4ab1-9f4f-35c263e7367e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:20.573699 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 659/1333] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:10:20.609812 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caed913-1c46-4b6b-9107-1191c2967e56 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:10:20.611350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7caed913-1c46-4b6b-9107-1191c2967e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:20.680454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:20.715466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caed913-1c46-4b6b-9107-1191c2967e56 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:10:20.787136 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b7f19-b628-498a-8372-e6ca8c8c34bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:10:20.787812 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b7f19-b628-498a-8372-e6ca8c8c34bb service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:20.788096 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b7f19-b628-498a-8372-e6ca8c8c34bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:20.788402 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b7f19-b628-498a-8372-e6ca8c8c34bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:20.790037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3f6b7f19-b628-498a-8372-e6ca8c8c34bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:20.897871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b7f19-b628-498a-8372-e6ca8c8c34bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:10:20.899207 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b7f19-b628-498a-8372-e6ca8c8c34bb service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:10:20.909648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:20.919774 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 675/1334] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:10:23.029868 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543614e5-af7f-4792-83bc-d55da39a94c1 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:23.030402 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543614e5-af7f-4792-83bc-d55da39a94c1 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:23.030402 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543614e5-af7f-4792-83bc-d55da39a94c1 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:23.031810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 660/1335] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:23.036982 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ad584-31ff-40e6-a570-56210fa2a5d4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:23.037411 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ad584-31ff-40e6-a570-56210fa2a5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:23.037542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ad584-31ff-40e6-a570-56210fa2a5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:23.109662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-195ad584-31ff-40e6-a570-56210fa2a5d4 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:23.110911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-195ad584-31ff-40e6-a570-56210fa2a5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:23.207864 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 676/1336] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:10:23.249421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543614e5-af7f-4792-83bc-d55da39a94c1 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:10:23.251006 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-543614e5-af7f-4792-83bc-d55da39a94c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:23.299524 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:23.377685 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543614e5-af7f-4792-83bc-d55da39a94c1 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:10:23.465887 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde45ce5-44d9-4926-940f-dbf5028518fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:10:23.466604 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde45ce5-44d9-4926-940f-dbf5028518fa service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:23.466921 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde45ce5-44d9-4926-940f-dbf5028518fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:23.467230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde45ce5-44d9-4926-940f-dbf5028518fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:23.469023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-fde45ce5-44d9-4926-940f-dbf5028518fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:23.551517 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:23.578766 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde45ce5-44d9-4926-940f-dbf5028518fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:10:23.580218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde45ce5-44d9-4926-940f-dbf5028518fa service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:10:23.599429 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 661/1337] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:10:25.989999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399aade7-260e-4d81-81b6-d6ceeaa72a9d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:25.990537 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399aade7-260e-4d81-81b6-d6ceeaa72a9d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:25.990669 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399aade7-260e-4d81-81b6-d6ceeaa72a9d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:25.992602 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 677/1338] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:10:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:10:25.997783 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f35cd-e90d-4985-a3a5-70ccbf2878ef None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:25.998243 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f35cd-e90d-4985-a3a5-70ccbf2878ef None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:25.998353 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f35cd-e90d-4985-a3a5-70ccbf2878ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:26.063667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d10f35cd-e90d-4985-a3a5-70ccbf2878ef None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:26.064925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d10f35cd-e90d-4985-a3a5-70ccbf2878ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:26.165702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 662/1339] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:10:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:10:26.201590 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399aade7-260e-4d81-81b6-d6ceeaa72a9d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:10:26.203116 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-399aade7-260e-4d81-81b6-d6ceeaa72a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:26.279390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:26.306698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399aade7-260e-4d81-81b6-d6ceeaa72a9d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:10:26.378049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f4692-d505-48cb-a581-0e8d07412aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:10:26.378698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f4692-d505-48cb-a581-0e8d07412aec service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:26.379175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f4692-d505-48cb-a581-0e8d07412aec service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:26.379329 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f4692-d505-48cb-a581-0e8d07412aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:26.380970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e51f4692-d505-48cb-a581-0e8d07412aec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:26.486287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f4692-d505-48cb-a581-0e8d07412aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:10:26.487626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f4692-d505-48cb-a581-0e8d07412aec service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:10:26.505458 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 678/1340] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:10:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:10:30.711737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e65f80-f92c-4f95-b0f0-e695641a8787 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:30.712318 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e65f80-f92c-4f95-b0f0-e695641a8787 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:30.712432 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e65f80-f92c-4f95-b0f0-e695641a8787 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:30.714641 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 663/1341] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:10:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:30.720098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca7076-3aee-458b-a92c-d4bcea4a507c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:30.720640 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca7076-3aee-458b-a92c-d4bcea4a507c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:30.720755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca7076-3aee-458b-a92c-d4bcea4a507c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:30.726302 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:30.791110 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-deca7076-3aee-458b-a92c-d4bcea4a507c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:30.792351 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-deca7076-3aee-458b-a92c-d4bcea4a507c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:30.888166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 679/1342] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:10:30.926041 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e65f80-f92c-4f95-b0f0-e695641a8787 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:10:30.927553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a9e65f80-f92c-4f95-b0f0-e695641a8787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:30.980243 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:31.035878 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e65f80-f92c-4f95-b0f0-e695641a8787 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:10:31.118572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded5b4f-7718-430c-bf3e-e1d43378ce3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:10:31.119230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded5b4f-7718-430c-bf3e-e1d43378ce3f service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:31.119571 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded5b4f-7718-430c-bf3e-e1d43378ce3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:31.119883 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded5b4f-7718-430c-bf3e-e1d43378ce3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:31.121629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1ded5b4f-7718-430c-bf3e-e1d43378ce3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:31.220454 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:31.239388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded5b4f-7718-430c-bf3e-e1d43378ce3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:10:31.241689 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded5b4f-7718-430c-bf3e-e1d43378ce3f service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:10:31.259654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 664/1343] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:10:33.910256 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e2ecd-8342-41bb-b94b-1d35f838c842 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:33.910828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e2ecd-8342-41bb-b94b-1d35f838c842 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:33.910828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e2ecd-8342-41bb-b94b-1d35f838c842 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:33.912174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 680/1344] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:33.918633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463a686-ba0a-4403-ae15-c7aed3ca3c82 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:33.918633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463a686-ba0a-4403-ae15-c7aed3ca3c82 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:33.919215 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463a686-ba0a-4403-ae15-c7aed3ca3c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:33.991083 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a463a686-ba0a-4403-ae15-c7aed3ca3c82 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:33.992385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a463a686-ba0a-4403-ae15-c7aed3ca3c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:34.114963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 665/1345] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:10:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:10:34.162664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e2ecd-8342-41bb-b94b-1d35f838c842 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:10:34.164168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a51e2ecd-8342-41bb-b94b-1d35f838c842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:34.260586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:34.279235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e2ecd-8342-41bb-b94b-1d35f838c842 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:10:34.352186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81964da3-68d5-41ea-ab52-d40edaaef4d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:10:34.352857 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81964da3-68d5-41ea-ab52-d40edaaef4d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:34.353137 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81964da3-68d5-41ea-ab52-d40edaaef4d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:34.353411 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81964da3-68d5-41ea-ab52-d40edaaef4d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:34.355060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-81964da3-68d5-41ea-ab52-d40edaaef4d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:34.471886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81964da3-68d5-41ea-ab52-d40edaaef4d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:10:34.473352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81964da3-68d5-41ea-ab52-d40edaaef4d0 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:10:34.492125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 681/1346] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:10:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:10:38.899724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55b273-5812-45ed-89fc-a2eb7676bde6 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:38.900205 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55b273-5812-45ed-89fc-a2eb7676bde6 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:38.900439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55b273-5812-45ed-89fc-a2eb7676bde6 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:38.901978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 666/1347] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:38.907574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef660ba1-289d-4f0c-a898-3578c539f040 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:38.908109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef660ba1-289d-4f0c-a898-3578c539f040 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:38.908109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef660ba1-289d-4f0c-a898-3578c539f040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:38.927769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:39.015170 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ef660ba1-289d-4f0c-a898-3578c539f040 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:39.016658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ef660ba1-289d-4f0c-a898-3578c539f040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:39.152550 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 682/1348] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:10:39.186379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55b273-5812-45ed-89fc-a2eb7676bde6 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:10:39.190102 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ab55b273-5812-45ed-89fc-a2eb7676bde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:39.262908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:39.322716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55b273-5812-45ed-89fc-a2eb7676bde6 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:10:39.408771 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d550923-7e42-40bb-9b01-e5c2c5da0400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:10:39.409550 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d550923-7e42-40bb-9b01-e5c2c5da0400 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:39.409840 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d550923-7e42-40bb-9b01-e5c2c5da0400 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:39.410172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d550923-7e42-40bb-9b01-e5c2c5da0400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:39.412606 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1d550923-7e42-40bb-9b01-e5c2c5da0400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:39.535600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:39.540188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d550923-7e42-40bb-9b01-e5c2c5da0400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:10:39.541709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d550923-7e42-40bb-9b01-e5c2c5da0400 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:10:39.560720 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 667/1349] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:10:44.591706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce724460-81b5-4ee7-b0de-8d72a4f90def None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:44.592193 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce724460-81b5-4ee7-b0de-8d72a4f90def None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:44.592340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce724460-81b5-4ee7-b0de-8d72a4f90def None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:44.594085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 683/1350] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 25 16:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:44.600907 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e5e62-acb4-4d09-85b0-53673282e9d0 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:44.601353 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e5e62-acb4-4d09-85b0-53673282e9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:44.601475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e5e62-acb4-4d09-85b0-53673282e9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:44.748847 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-235e5e62-acb4-4d09-85b0-53673282e9d0 None None] MFA Rules not processed for user `ba3474e40117440498f0fe99f743df50`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:44.750328 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-235e5e62-acb4-4d09-85b0-53673282e9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:44.902374 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 668/1351] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 25 16:10:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:10:49.140364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=59 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:49.242063 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890f90b-3362-4993-8768-446a7600b0b9 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:49.242265 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890f90b-3362-4993-8768-446a7600b0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:49.242545 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890f90b-3362-4993-8768-446a7600b0b9 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:49.245086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 684/1352] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 25 16:10:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:49.251802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae4761-539d-4562-a26a-3ba2dfc101ee None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:49.252514 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae4761-539d-4562-a26a-3ba2dfc101ee None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:49.252514 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae4761-539d-4562-a26a-3ba2dfc101ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:49.321367 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:49.349343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3eae4761-539d-4562-a26a-3ba2dfc101ee None None] MFA Rules not processed for user `ba3474e40117440498f0fe99f743df50`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:49.350561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3eae4761-539d-4562-a26a-3ba2dfc101ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:49.486847 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 669/1353] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 25 16:10:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:10:50.950158 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b7c29-16f7-4d4f-a924-6178557581a4 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:50.950833 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b7c29-16f7-4d4f-a924-6178557581a4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:50.950833 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b7c29-16f7-4d4f-a924-6178557581a4 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:50.953276 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 685/1354] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 25 16:10:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:10:50.961614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b0d27-80b0-45c3-9f60-dd58b045b300 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:50.962285 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b0d27-80b0-45c3-9f60-dd58b045b300 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:50.962285 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b0d27-80b0-45c3-9f60-dd58b045b300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:51.049319 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3e6b0d27-80b0-45c3-9f60-dd58b045b300 None None] MFA Rules not processed for user `ba3474e40117440498f0fe99f743df50`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:51.050506 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3e6b0d27-80b0-45c3-9f60-dd58b045b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:51.102055 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:51.178281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 670/1355] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 25 16:10:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:10:54.848280 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2b01e-32b5-461e-984b-644dd07dcb51 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:54.848781 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2b01e-32b5-461e-984b-644dd07dcb51 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:54.848781 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2b01e-32b5-461e-984b-644dd07dcb51 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:54.850576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 686/1356] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:54.856016 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06733f-6ae5-461c-b044-a555652ef276 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:54.856528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06733f-6ae5-461c-b044-a555652ef276 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:54.856616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06733f-6ae5-461c-b044-a555652ef276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:54.927666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3f06733f-6ae5-461c-b044-a555652ef276 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:54.928904 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3f06733f-6ae5-461c-b044-a555652ef276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:55.044662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 671/1357] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:10:55.090009 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db29ae-d1db-486d-ba8e-9842dc17f2a8 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:55.090884 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db29ae-d1db-486d-ba8e-9842dc17f2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:55.091443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db29ae-d1db-486d-ba8e-9842dc17f2a8 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:55.093662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 687/1358] 10.222.0.70 () {54 vars in 962 bytes} [Mon Jul 25 16:10:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:55.103209 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee891b-7e97-477d-818f-fa62e97afd78 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:55.103573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee891b-7e97-477d-818f-fa62e97afd78 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:55.103900 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee891b-7e97-477d-818f-fa62e97afd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:55.134308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:55.329311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c4ee891b-7e97-477d-818f-fa62e97afd78 None None] MFA Rules not processed for user `c455f8d340444b068249213ff504895e`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:55.330572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c4ee891b-7e97-477d-818f-fa62e97afd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:55.457576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 672/1359] 10.222.0.70 () {58 vars in 1059 bytes} [Mon Jul 25 16:10:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:10:55.466910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db29ae-d1db-486d-ba8e-9842dc17f2a8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:10:55.468429 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b0db29ae-d1db-486d-ba8e-9842dc17f2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:55.622586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db29ae-d1db-486d-ba8e-9842dc17f2a8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:10:55.703955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:55.752907 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e737c12-5c66-49b8-a6b7-e641ebdecefa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:10:55.753700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e737c12-5c66-49b8-a6b7-e641ebdecefa service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:55.754054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e737c12-5c66-49b8-a6b7-e641ebdecefa service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:55.754401 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e737c12-5c66-49b8-a6b7-e641ebdecefa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:55.756704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6e737c12-5c66-49b8-a6b7-e641ebdecefa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:55.852912 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e737c12-5c66-49b8-a6b7-e641ebdecefa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:10:55.855369 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e737c12-5c66-49b8-a6b7-e641ebdecefa service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:10:55.875276 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 688/1360] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:10:58.195603 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29ffea-9b0b-4c34-88bf-5aacfb50865e None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:58.196190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29ffea-9b0b-4c34-88bf-5aacfb50865e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:58.196190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29ffea-9b0b-4c34-88bf-5aacfb50865e None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:58.200577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 673/1361] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:10:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:10:58.202655 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d39ef-eb13-4b2c-a3ee-42e5ffaa3071 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:58.204141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d39ef-eb13-4b2c-a3ee-42e5ffaa3071 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:58.204141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d39ef-eb13-4b2c-a3ee-42e5ffaa3071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:58.279623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ed7d39ef-eb13-4b2c-a3ee-42e5ffaa3071 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:10:58.280646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ed7d39ef-eb13-4b2c-a3ee-42e5ffaa3071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:58.325352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:58.406578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 689/1362] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:10:58.453399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29ffea-9b0b-4c34-88bf-5aacfb50865e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:10:58.454990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ac29ffea-9b0b-4c34-88bf-5aacfb50865e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:58.542699 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:58.635635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29ffea-9b0b-4c34-88bf-5aacfb50865e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:10:58.764567 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9ab46-6df7-4245-8e6c-65ece9aadbd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:10:58.765235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9ab46-6df7-4245-8e6c-65ece9aadbd2 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:10:58.765579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9ab46-6df7-4245-8e6c-65ece9aadbd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:10:58.765924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9ab46-6df7-4245-8e6c-65ece9aadbd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:10:58.767987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-84e9ab46-6df7-4245-8e6c-65ece9aadbd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:10:58.794139 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:10:58.883802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9ab46-6df7-4245-8e6c-65ece9aadbd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:10:58.885464 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9ab46-6df7-4245-8e6c-65ece9aadbd2 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:10:58.909143 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 674/1363] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:01.367073 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c75a8-b18f-45b2-a502-54bf9b2bf14a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:01.367951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c75a8-b18f-45b2-a502-54bf9b2bf14a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:01.368482 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c75a8-b18f-45b2-a502-54bf9b2bf14a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:01.369919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 690/1364] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:01.375961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465ffe5-df0d-4a22-a43f-d27097b5ca96 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:01.376561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465ffe5-df0d-4a22-a43f-d27097b5ca96 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:01.376941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465ffe5-df0d-4a22-a43f-d27097b5ca96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:01.461622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-4465ffe5-df0d-4a22-a43f-d27097b5ca96 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:01.463080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4465ffe5-df0d-4a22-a43f-d27097b5ca96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:01.581405 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:01.595331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 675/1365] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:01.633108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229ff61-da89-4365-b213-8a9e017acf0b None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:01.633418 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229ff61-da89-4365-b213-8a9e017acf0b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:01.633733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229ff61-da89-4365-b213-8a9e017acf0b None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:01.635235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 691/1366] 10.222.0.70 () {54 vars in 962 bytes} [Mon Jul 25 16:11:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:01.640863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490768b-8a0f-4905-91d0-c67d1a1a7975 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:01.641281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490768b-8a0f-4905-91d0-c67d1a1a7975 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:01.641564 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490768b-8a0f-4905-91d0-c67d1a1a7975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:01.722924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c490768b-8a0f-4905-91d0-c67d1a1a7975 None None] MFA Rules not processed for user `c455f8d340444b068249213ff504895e`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:01.724691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c490768b-8a0f-4905-91d0-c67d1a1a7975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:01.851174 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 676/1367] 10.222.0.70 () {58 vars in 1059 bytes} [Mon Jul 25 16:11:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:01.859101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229ff61-da89-4365-b213-8a9e017acf0b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:01.860640 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1229ff61-da89-4365-b213-8a9e017acf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:02.028844 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229ff61-da89-4365-b213-8a9e017acf0b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:02.050692 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:02.153872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bf867-9c6b-4743-92da-b9750a18c4dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:02.154554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bf867-9c6b-4743-92da-b9750a18c4dd service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:02.154839 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bf867-9c6b-4743-92da-b9750a18c4dd service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:02.155119 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bf867-9c6b-4743-92da-b9750a18c4dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:02.156789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3c7bf867-9c6b-4743-92da-b9750a18c4dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:02.260376 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bf867-9c6b-4743-92da-b9750a18c4dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:02.262099 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bf867-9c6b-4743-92da-b9750a18c4dd service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:02.283101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 692/1368] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:03.259693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e858f5-4b0f-4653-86a4-2a68e23693ff None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:03.260223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e858f5-4b0f-4653-86a4-2a68e23693ff None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:03.260223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e858f5-4b0f-4653-86a4-2a68e23693ff None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:03.261727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 677/1369] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:03.268052 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e756e2c-20b2-4bc7-b770-aaa829a129a7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:03.268662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e756e2c-20b2-4bc7-b770-aaa829a129a7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:03.268662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e756e2c-20b2-4bc7-b770-aaa829a129a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:03.305231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:03.343945 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8e756e2c-20b2-4bc7-b770-aaa829a129a7 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:03.345236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8e756e2c-20b2-4bc7-b770-aaa829a129a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:03.464134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 693/1370] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:03.808218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c95b51-d1c9-476c-84a1-68240350823f None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:03.808218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c95b51-d1c9-476c-84a1-68240350823f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:03.808218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c95b51-d1c9-476c-84a1-68240350823f None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:03.810943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 678/1371] 10.222.0.70 () {54 vars in 964 bytes} [Mon Jul 25 16:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:03.814910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a602fd0-0e52-41f2-860b-7ef4d60ddb4b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:03.815199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a602fd0-0e52-41f2-860b-7ef4d60ddb4b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:03.815474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a602fd0-0e52-41f2-860b-7ef4d60ddb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:03.904149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6a602fd0-0e52-41f2-860b-7ef4d60ddb4b None None] MFA Rules not processed for user `b419d3dba854407f97f16fac79910d25`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:03.905393 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6a602fd0-0e52-41f2-860b-7ef4d60ddb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:03.957464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:03.994621 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 694/1372] 10.222.0.70 () {58 vars in 1061 bytes} [Mon Jul 25 16:11:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:04.002209 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c95b51-d1c9-476c-84a1-68240350823f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:04.003752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-35c95b51-d1c9-476c-84a1-68240350823f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:04.059200 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:04.120552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c95b51-d1c9-476c-84a1-68240350823f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:04.199687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2c8f0-98a6-4e86-84a0-836b95182fb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:04.200378 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2c8f0-98a6-4e86-84a0-836b95182fb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:04.200655 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2c8f0-98a6-4e86-84a0-836b95182fb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:04.200923 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2c8f0-98a6-4e86-84a0-836b95182fb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:04.202547 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-edc2c8f0-98a6-4e86-84a0-836b95182fb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:04.324347 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:04.340035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2c8f0-98a6-4e86-84a0-836b95182fb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:04.341531 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2c8f0-98a6-4e86-84a0-836b95182fb1 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:04.360978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 679/1373] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:04.694726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a128d2-9f53-4e79-a60f-5d0b59096064 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:04.695294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a128d2-9f53-4e79-a60f-5d0b59096064 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:04.695294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a128d2-9f53-4e79-a60f-5d0b59096064 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:04.696699 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 695/1374] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:04.702035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a5390-c945-4056-8b18-1e2fed477fcc None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:04.702600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a5390-c945-4056-8b18-1e2fed477fcc None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:04.702880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a5390-c945-4056-8b18-1e2fed477fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:04.772926 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-919a5390-c945-4056-8b18-1e2fed477fcc None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:04.774220 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-919a5390-c945-4056-8b18-1e2fed477fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:04.869610 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 680/1375] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:11:04.914357 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a128d2-9f53-4e79-a60f-5d0b59096064 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:04.915851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-16a128d2-9f53-4e79-a60f-5d0b59096064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:05.065041 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a128d2-9f53-4e79-a60f-5d0b59096064 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:05.130900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:05.198255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10398df7-c66a-407d-968d-0de6ef1ddfbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:05.198904 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10398df7-c66a-407d-968d-0de6ef1ddfbc service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:05.199186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10398df7-c66a-407d-968d-0de6ef1ddfbc service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:05.199462 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10398df7-c66a-407d-968d-0de6ef1ddfbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:05.201135 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-10398df7-c66a-407d-968d-0de6ef1ddfbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:05.294512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10398df7-c66a-407d-968d-0de6ef1ddfbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:05.296086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10398df7-c66a-407d-968d-0de6ef1ddfbc service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:05.314664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 696/1376] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:07.410220 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4b636-3128-4604-ac4e-a886693ffd0c None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:07.410753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4b636-3128-4604-ac4e-a886693ffd0c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:07.410753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4b636-3128-4604-ac4e-a886693ffd0c None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:07.412738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 681/1377] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:07.419225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51784d7-8acd-4072-bf51-38a9f60960e4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:07.419225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51784d7-8acd-4072-bf51-38a9f60960e4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:07.419225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51784d7-8acd-4072-bf51-38a9f60960e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:07.498039 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a51784d7-8acd-4072-bf51-38a9f60960e4 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:07.499469 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a51784d7-8acd-4072-bf51-38a9f60960e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:07.515517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:07.619186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 697/1378] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:07.664564 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4b636-3128-4604-ac4e-a886693ffd0c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:07.666116 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-73f4b636-3128-4604-ac4e-a886693ffd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:07.727551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:07.825810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4b636-3128-4604-ac4e-a886693ffd0c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:07.966927 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300d92e-8e3f-4f78-b502-8cbf0a723903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:07.967689 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300d92e-8e3f-4f78-b502-8cbf0a723903 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:07.968484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300d92e-8e3f-4f78-b502-8cbf0a723903 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:07.968484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300d92e-8e3f-4f78-b502-8cbf0a723903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:07.971237 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5300d92e-8e3f-4f78-b502-8cbf0a723903 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:08.004658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:08.095377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300d92e-8e3f-4f78-b502-8cbf0a723903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:08.097634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300d92e-8e3f-4f78-b502-8cbf0a723903 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:08.120445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 682/1379] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:10.192912 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485feb5-807f-4d5f-9bdf-ffbd2ffefd3b None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:10.193477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485feb5-807f-4d5f-9bdf-ffbd2ffefd3b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:10.193738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485feb5-807f-4d5f-9bdf-ffbd2ffefd3b None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:10.195365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 698/1380] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:10.200559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187d2e1-aa7d-43b4-980b-279cb3107eb7 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:10.201027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187d2e1-aa7d-43b4-980b-279cb3107eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:10.201304 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187d2e1-aa7d-43b4-980b-279cb3107eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:10.275366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6187d2e1-aa7d-43b4-980b-279cb3107eb7 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:10.276718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6187d2e1-aa7d-43b4-980b-279cb3107eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:10.380018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:10.388676 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 683/1381] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:11:10.435014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485feb5-807f-4d5f-9bdf-ffbd2ffefd3b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:10.436602 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f485feb5-807f-4d5f-9bdf-ffbd2ffefd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:10.588398 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:10.601923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485feb5-807f-4d5f-9bdf-ffbd2ffefd3b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:10.728193 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3ad1d-26b1-49c9-83f7-77761c4a73dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:10.728871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3ad1d-26b1-49c9-83f7-77761c4a73dc service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:10.729153 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3ad1d-26b1-49c9-83f7-77761c4a73dc service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:10.729429 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3ad1d-26b1-49c9-83f7-77761c4a73dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:10.731067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bff3ad1d-26b1-49c9-83f7-77761c4a73dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:10.824837 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3ad1d-26b1-49c9-83f7-77761c4a73dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:10.826342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3ad1d-26b1-49c9-83f7-77761c4a73dc service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:10.837171 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:10.852521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 699/1382] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:11:12.979001 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c699c28-5489-4366-ba6f-1c13ebf37813 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:12.979708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c699c28-5489-4366-ba6f-1c13ebf37813 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:12.979708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c699c28-5489-4366-ba6f-1c13ebf37813 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:12.981111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 684/1383] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:12.986565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53132e-8c2c-4b4b-b53c-2a140ff395d0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:12.987167 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53132e-8c2c-4b4b-b53c-2a140ff395d0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:12.987167 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53132e-8c2c-4b4b-b53c-2a140ff395d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:13.057364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2b53132e-8c2c-4b4b-b53c-2a140ff395d0 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:13.058629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2b53132e-8c2c-4b4b-b53c-2a140ff395d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:13.174009 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 700/1384] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:13.216752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c699c28-5489-4366-ba6f-1c13ebf37813 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:13.218781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5c699c28-5489-4366-ba6f-1c13ebf37813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:13.378218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c699c28-5489-4366-ba6f-1c13ebf37813 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:13.448612 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:13.504820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb66af-4ee1-4f32-85bc-7032fb1d21a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:13.506378 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb66af-4ee1-4f32-85bc-7032fb1d21a7 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:13.506745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb66af-4ee1-4f32-85bc-7032fb1d21a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:13.507018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb66af-4ee1-4f32-85bc-7032fb1d21a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:13.513038 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6fcb66af-4ee1-4f32-85bc-7032fb1d21a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:13.609976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb66af-4ee1-4f32-85bc-7032fb1d21a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:13.611602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb66af-4ee1-4f32-85bc-7032fb1d21a7 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:13.646817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 685/1385] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:15.664857 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4513e5-f00c-42ee-98eb-851d5c6a04e8 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:15.665463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4513e5-f00c-42ee-98eb-851d5c6a04e8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:15.665463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4513e5-f00c-42ee-98eb-851d5c6a04e8 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:15.666809 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 701/1386] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:15.672431 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb350da-4207-44d4-9577-d99df37dafdd None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:15.673075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb350da-4207-44d4-9577-d99df37dafdd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:15.673075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb350da-4207-44d4-9577-d99df37dafdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:15.759234 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-beb350da-4207-44d4-9577-d99df37dafdd None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:15.760413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-beb350da-4207-44d4-9577-d99df37dafdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:15.796570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:15.867877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 686/1387] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:15.915736 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4513e5-f00c-42ee-98eb-851d5c6a04e8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:15.917242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ef4513e5-f00c-42ee-98eb-851d5c6a04e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:15.995137 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:16.074553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4513e5-f00c-42ee-98eb-851d5c6a04e8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:16.191967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32edc5-3f51-484b-85dc-9f635fe68d61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:16.192760 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32edc5-3f51-484b-85dc-9f635fe68d61 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:16.193000 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32edc5-3f51-484b-85dc-9f635fe68d61 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:16.193269 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32edc5-3f51-484b-85dc-9f635fe68d61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:16.194903 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-be32edc5-3f51-484b-85dc-9f635fe68d61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:16.234048 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:16.291997 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32edc5-3f51-484b-85dc-9f635fe68d61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:16.293681 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32edc5-3f51-484b-85dc-9f635fe68d61 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:16.312900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 702/1388] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:18.408163 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559b40d-b4eb-4bf5-8df9-b53e15d5c579 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:18.408736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559b40d-b4eb-4bf5-8df9-b53e15d5c579 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:18.408736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559b40d-b4eb-4bf5-8df9-b53e15d5c579 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:18.410276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 687/1389] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:18.415855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab54b0-ec65-478a-9fcd-e21e382555e0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:18.416283 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab54b0-ec65-478a-9fcd-e21e382555e0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:18.416452 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab54b0-ec65-478a-9fcd-e21e382555e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:18.483804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-95ab54b0-ec65-478a-9fcd-e21e382555e0 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:18.484964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-95ab54b0-ec65-478a-9fcd-e21e382555e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:18.701553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 703/1390] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:18.748046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559b40d-b4eb-4bf5-8df9-b53e15d5c579 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:18.749673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2559b40d-b4eb-4bf5-8df9-b53e15d5c579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:18.896276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559b40d-b4eb-4bf5-8df9-b53e15d5c579 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:18.913273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:19.012853 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c8174-9aa6-420f-9ae9-385b2ba25d10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:19.013414 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c8174-9aa6-420f-9ae9-385b2ba25d10 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:19.013696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c8174-9aa6-420f-9ae9-385b2ba25d10 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:19.014072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c8174-9aa6-420f-9ae9-385b2ba25d10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:19.015967 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5b3c8174-9aa6-420f-9ae9-385b2ba25d10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:19.107162 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c8174-9aa6-420f-9ae9-385b2ba25d10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:19.108797 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c8174-9aa6-420f-9ae9-385b2ba25d10 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:19.131178 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 688/1391] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:19.634095 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ddef3-0773-49b0-af2c-7ae7489a577d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:19.634637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ddef3-0773-49b0-af2c-7ae7489a577d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:19.634746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ddef3-0773-49b0-af2c-7ae7489a577d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:19.636366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 704/1392] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:19.642254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf4330-3afd-42a8-8e2f-53d8da317eb3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:19.642774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf4330-3afd-42a8-8e2f-53d8da317eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:19.642891 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf4330-3afd-42a8-8e2f-53d8da317eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:19.672086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:19.717035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-19bf4330-3afd-42a8-8e2f-53d8da317eb3 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:19.718251 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-19bf4330-3afd-42a8-8e2f-53d8da317eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:19.834710 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 689/1393] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:19.893258 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f11493-91f6-41f3-bff3-ba3304477b02 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:19.893481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f11493-91f6-41f3-bff3-ba3304477b02 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:19.893759 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f11493-91f6-41f3-bff3-ba3304477b02 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:19.895120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 705/1394] 10.222.0.70 () {54 vars in 966 bytes} [Mon Jul 25 16:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:19.901065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d4aac-fa6d-43e7-9426-8521b6f3bdfb None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:19.901359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d4aac-fa6d-43e7-9426-8521b6f3bdfb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:19.901637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d4aac-fa6d-43e7-9426-8521b6f3bdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:19.978343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c40d4aac-fa6d-43e7-9426-8521b6f3bdfb None None] MFA Rules not processed for user `623c97746d304c6ba971e79e4dbeb730`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:19.979555 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c40d4aac-fa6d-43e7-9426-8521b6f3bdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:20.019951 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:20.056892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 690/1395] 10.222.0.70 () {58 vars in 1063 bytes} [Mon Jul 25 16:11:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:20.064393 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f11493-91f6-41f3-bff3-ba3304477b02 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:20.065915 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-08f11493-91f6-41f3-bff3-ba3304477b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:20.080071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:20.182458 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f11493-91f6-41f3-bff3-ba3304477b02 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:20.258028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82c3b3-c25d-4ab7-aa05-fb677a008fb2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '623c97746d304c6ba971e79e4dbeb730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:20.258685 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82c3b3-c25d-4ab7-aa05-fb677a008fb2 service glance] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:20.258964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82c3b3-c25d-4ab7-aa05-fb677a008fb2 service glance] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:20.259238 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82c3b3-c25d-4ab7-aa05-fb677a008fb2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:20.260880 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7c82c3b3-c25d-4ab7-aa05-fb677a008fb2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:20.331137 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:20.373178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82c3b3-c25d-4ab7-aa05-fb677a008fb2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:20.374666 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82c3b3-c25d-4ab7-aa05-fb677a008fb2 service glance] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:20.392899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 706/1396] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:21.137895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14024674-1b33-4f07-a505-0f90ca1cc255 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:21.138307 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14024674-1b33-4f07-a505-0f90ca1cc255 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:21.138454 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14024674-1b33-4f07-a505-0f90ca1cc255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:21.205642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b34350-5ab2-42cc-88e0-4d015beb79b8 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:21.206308 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b34350-5ab2-42cc-88e0-4d015beb79b8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:21.206308 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b34350-5ab2-42cc-88e0-4d015beb79b8 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:21.207571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 707/1397] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:11:21.212625 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563978f7-b4b5-4a15-a2f2-5134f73734ed None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:21.212912 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563978f7-b4b5-4a15-a2f2-5134f73734ed None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:21.213190 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563978f7-b4b5-4a15-a2f2-5134f73734ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:21.229026 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-14024674-1b33-4f07-a505-0f90ca1cc255 None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:21.230265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-14024674-1b33-4f07-a505-0f90ca1cc255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:21.283869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-563978f7-b4b5-4a15-a2f2-5134f73734ed None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:21.285126 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-563978f7-b4b5-4a15-a2f2-5134f73734ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:21.321687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 691/1398] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 25 16:11:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:21.371615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77ecde-ae46-4e29-80a7-638303cac81b None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:21.371933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77ecde-ae46-4e29-80a7-638303cac81b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:21.372212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77ecde-ae46-4e29-80a7-638303cac81b None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:21.373613 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 692/1399] 10.222.0.70 () {54 vars in 943 bytes} [Mon Jul 25 16:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:11:21.380015 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7fac2-86fa-4be3-b4fd-c32d62022152 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:21.380419 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7fac2-86fa-4be3-b4fd-c32d62022152 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:21.380700 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7fac2-86fa-4be3-b4fd-c32d62022152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:21.387532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 708/1400] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:11:21.432673 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563978f7-b4b5-4a15-a2f2-5134f73734ed None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:21.434057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-563978f7-b4b5-4a15-a2f2-5134f73734ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:21.453155 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:21.460656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:21.461520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-fda7fac2-86fa-4be3-b4fd-c32d62022152 None None] MFA Rules not processed for user `4dbc2609b13f45dc883ae18d3d056e76`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:21.463341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-fda7fac2-86fa-4be3-b4fd-c32d62022152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:21.569720 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563978f7-b4b5-4a15-a2f2-5134f73734ed None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:21.586780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 693/1401] 10.222.0.70 () {58 vars in 1040 bytes} [Mon Jul 25 16:11:21 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:11:21.596491 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7fac2-86fa-4be3-b4fd-c32d62022152 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:21.606765 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7fac2-86fa-4be3-b4fd-c32d62022152 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:21.686436 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fd28a-642a-4c34-a1e3-e363c945292c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:21.687091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fd28a-642a-4c34-a1e3-e363c945292c service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:21.687367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fd28a-642a-4c34-a1e3-e363c945292c service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:21.687657 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fd28a-642a-4c34-a1e3-e363c945292c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:21.689315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fc0fd28a-642a-4c34-a1e3-e363c945292c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:21.706735 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:21.715891 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff7826-ae8d-4782-b0c5-13ccb113a36b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:21.716574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff7826-ae8d-4782-b0c5-13ccb113a36b service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:21.716857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff7826-ae8d-4782-b0c5-13ccb113a36b service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:21.717127 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff7826-ae8d-4782-b0c5-13ccb113a36b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:21.718816 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-18ff7826-ae8d-4782-b0c5-13ccb113a36b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:21.721478 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:21.784754 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fd28a-642a-4c34-a1e3-e363c945292c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:21.786976 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fd28a-642a-4c34-a1e3-e363c945292c service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:21.810050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 709/1402] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:11:21.811692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff7826-ae8d-4782-b0c5-13ccb113a36b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:21.813333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff7826-ae8d-4782-b0c5-13ccb113a36b service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:21.821676 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 694/1403] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:11:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 16:11:23.875558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4b473-e43e-45c2-a555-895599ccdfc8 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:23.876095 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4b473-e43e-45c2-a555-895599ccdfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:23.876178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4b473-e43e-45c2-a555-895599ccdfc8 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:23.877553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 710/1404] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:23.883693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ca79-efde-4be3-8e21-3c5b7de83dd3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:23.884135 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ca79-efde-4be3-8e21-3c5b7de83dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:23.884283 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ca79-efde-4be3-8e21-3c5b7de83dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:24.010237 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e938ca79-efde-4be3-8e21-3c5b7de83dd3 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:24.011705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e938ca79-efde-4be3-8e21-3c5b7de83dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:24.113696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:24.124295 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 695/1405] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:24.167076 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4b473-e43e-45c2-a555-895599ccdfc8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:24.168631 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e4a4b473-e43e-45c2-a555-895599ccdfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:24.338684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:24.344655 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4b473-e43e-45c2-a555-895599ccdfc8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:24.489587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f16fc-17ef-46b5-8fe1-d4abbeaea356 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:24.490250 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f16fc-17ef-46b5-8fe1-d4abbeaea356 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:24.490538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f16fc-17ef-46b5-8fe1-d4abbeaea356 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:24.490810 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f16fc-17ef-46b5-8fe1-d4abbeaea356 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:24.492475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8b8f16fc-17ef-46b5-8fe1-d4abbeaea356 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:24.596631 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f16fc-17ef-46b5-8fe1-d4abbeaea356 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:24.598591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f16fc-17ef-46b5-8fe1-d4abbeaea356 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:24.618019 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 711/1406] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:26.723067 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205701da-6682-4eb8-97dd-64132fd29bb5 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:26.723682 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205701da-6682-4eb8-97dd-64132fd29bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:26.723780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205701da-6682-4eb8-97dd-64132fd29bb5 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:26.725116 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 696/1407] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:26.730547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b935e-7b93-46ae-94fc-871abdac3171 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:26.730977 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b935e-7b93-46ae-94fc-871abdac3171 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:26.731089 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b935e-7b93-46ae-94fc-871abdac3171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:26.735593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:26.812815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b69b935e-7b93-46ae-94fc-871abdac3171 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:26.813967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b69b935e-7b93-46ae-94fc-871abdac3171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:26.920586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 712/1408] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:26.967190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205701da-6682-4eb8-97dd-64132fd29bb5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:26.968733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-205701da-6682-4eb8-97dd-64132fd29bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:27.149276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205701da-6682-4eb8-97dd-64132fd29bb5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:27.221157 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:27.276600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afabeb0-258a-475b-a2c1-249741d5ae80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:27.277505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afabeb0-258a-475b-a2c1-249741d5ae80 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:27.277793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afabeb0-258a-475b-a2c1-249741d5ae80 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:27.278064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afabeb0-258a-475b-a2c1-249741d5ae80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:27.282898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8afabeb0-258a-475b-a2c1-249741d5ae80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:27.380127 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afabeb0-258a-475b-a2c1-249741d5ae80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:27.381775 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afabeb0-258a-475b-a2c1-249741d5ae80 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:27.402859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 697/1409] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:36.918776 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=64 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:37.398927 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=64 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:44.546186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78590cfa-6b8b-43e1-a788-a07f2a4087a5 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:44.546727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78590cfa-6b8b-43e1-a788-a07f2a4087a5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:44.546727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78590cfa-6b8b-43e1-a788-a07f2a4087a5 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:44.548098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 713/1410] 10.222.0.70 () {54 vars in 918 bytes} [Mon Jul 25 16:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:44.553263 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca19834-2985-45a9-af5b-1481707bea0b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:44.553676 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca19834-2985-45a9-af5b-1481707bea0b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:44.553819 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca19834-2985-45a9-af5b-1481707bea0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:44.630079 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-5ca19834-2985-45a9-af5b-1481707bea0b None None] MFA Rules not processed for user `ba3474e40117440498f0fe99f743df50`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:44.631297 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5ca19834-2985-45a9-af5b-1481707bea0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:44.735703 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 698/1411] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Jul 25 16:11:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:44.750293 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d250c-f8fb-4c05-879d-9870070e4df0 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:44.750578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d250c-f8fb-4c05-879d-9870070e4df0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:44.750860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d250c-f8fb-4c05-879d-9870070e4df0 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:44.752207 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 714/1412] 10.222.0.70 () {54 vars in 918 bytes} [Mon Jul 25 16:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:44.757333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f63e9-8245-45f4-908a-d5f072544253 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:44.757625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f63e9-8245-45f4-908a-d5f072544253 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:44.757906 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f63e9-8245-45f4-908a-d5f072544253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:44.829276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:44.832136 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-1c5f63e9-8245-45f4-908a-d5f072544253 None None] MFA Rules not processed for user `c455f8d340444b068249213ff504895e`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:44.834859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1c5f63e9-8245-45f4-908a-d5f072544253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:44.949760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 699/1413] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Jul 25 16:11:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:47.501437 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6f99d-6f0b-4e6c-942b-086f2d3a4ce1 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:47.502010 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6f99d-6f0b-4e6c-942b-086f2d3a4ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:47.502010 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6f99d-6f0b-4e6c-942b-086f2d3a4ce1 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:47.503384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 16:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:47.509809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dfe94-ef74-4b5b-ba05-458d57e99b71 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:47.510794 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dfe94-ef74-4b5b-ba05-458d57e99b71 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:47.510794 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dfe94-ef74-4b5b-ba05-458d57e99b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:47.578677 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-471dfe94-ef74-4b5b-ba05-458d57e99b71 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:47.579915 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-471dfe94-ef74-4b5b-ba05-458d57e99b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:47.635166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:47.677864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 16:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:11:47.722904 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6f99d-6f0b-4e6c-942b-086f2d3a4ce1 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:47.724692 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a8c6f99d-6f0b-4e6c-942b-086f2d3a4ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:47.883315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6f99d-6f0b-4e6c-942b-086f2d3a4ce1 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:47.958636 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:48.008647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2184630-5d2e-4443-804b-4f4a579cea8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:48.009303 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2184630-5d2e-4443-804b-4f4a579cea8a service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:48.009587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2184630-5d2e-4443-804b-4f4a579cea8a service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:48.009863 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2184630-5d2e-4443-804b-4f4a579cea8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:48.011486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d2184630-5d2e-4443-804b-4f4a579cea8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:48.112232 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2184630-5d2e-4443-804b-4f4a579cea8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:48.114430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2184630-5d2e-4443-804b-4f4a579cea8a service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:48.134750 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 716/1416] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:49.071338 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00990bc-4631-48cd-b1b1-e8c842f41c53 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:49.071938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00990bc-4631-48cd-b1b1-e8c842f41c53 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:49.071938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00990bc-4631-48cd-b1b1-e8c842f41c53 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:49.073325 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 16:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:49.078331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e6534-41de-4838-b755-f7e80bb1659b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:49.078787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e6534-41de-4838-b755-f7e80bb1659b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:49.078891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e6534-41de-4838-b755-f7e80bb1659b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:49.158623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-697e6534-41de-4838-b755-f7e80bb1659b None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:49.159879 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-697e6534-41de-4838-b755-f7e80bb1659b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:49.188244 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:49.260400 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 16:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:11:49.411634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00990bc-4631-48cd-b1b1-e8c842f41c53 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:49.413082 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d00990bc-4631-48cd-b1b1-e8c842f41c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:49.557880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00990bc-4631-48cd-b1b1-e8c842f41c53 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:49.597941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:49.672091 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefd96f-9fdd-4472-9b18-3d8d5dcd37da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:49.672691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefd96f-9fdd-4472-9b18-3d8d5dcd37da service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:49.672976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefd96f-9fdd-4472-9b18-3d8d5dcd37da service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:49.673253 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefd96f-9fdd-4472-9b18-3d8d5dcd37da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:49.674886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-daefd96f-9fdd-4472-9b18-3d8d5dcd37da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:49.762966 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefd96f-9fdd-4472-9b18-3d8d5dcd37da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:49.764596 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefd96f-9fdd-4472-9b18-3d8d5dcd37da service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:49.785228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 702/1419] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:50.673072 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a46c8e-4ed7-4755-93b4-f1a48d8e8db9 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:50.673892 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a46c8e-4ed7-4755-93b4-f1a48d8e8db9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:50.673892 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a46c8e-4ed7-4755-93b4-f1a48d8e8db9 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:50.675000 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 16:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:50.680583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4c443-acfc-40e4-a171-b7b658ce54f7 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:50.681058 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4c443-acfc-40e4-a171-b7b658ce54f7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:50.681198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4c443-acfc-40e4-a171-b7b658ce54f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:50.736086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:50.759399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7fb4c443-acfc-40e4-a171-b7b658ce54f7 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:50.760691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7fb4c443-acfc-40e4-a171-b7b658ce54f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:50.859379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 16:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:51.013452 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a46c8e-4ed7-4755-93b4-f1a48d8e8db9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:51.015040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a3a46c8e-4ed7-4755-93b4-f1a48d8e8db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:51.175339 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a46c8e-4ed7-4755-93b4-f1a48d8e8db9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:51.188309 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:51.294086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfd542-eb1f-413c-874d-5517099a9cd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:51.294744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfd542-eb1f-413c-874d-5517099a9cd4 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:51.295026 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfd542-eb1f-413c-874d-5517099a9cd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:51.295301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfd542-eb1f-413c-874d-5517099a9cd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:51.296976 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0ccfd542-eb1f-413c-874d-5517099a9cd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:51.390239 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfd542-eb1f-413c-874d-5517099a9cd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:51.391868 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfd542-eb1f-413c-874d-5517099a9cd4 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:51.412588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 719/1422] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:52.346094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f549b9e-5b86-4a77-abe8-b6bb6f20872b None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:52.346654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f549b9e-5b86-4a77-abe8-b6bb6f20872b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:52.346654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f549b9e-5b86-4a77-abe8-b6bb6f20872b None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:52.349136 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 16:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:52.354406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f996fa-c3e9-47db-9cc6-68aad4e38c6a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:52.354867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f996fa-c3e9-47db-9cc6-68aad4e38c6a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:52.354975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f996fa-c3e9-47db-9cc6-68aad4e38c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:52.375504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:52.439823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-97f996fa-c3e9-47db-9cc6-68aad4e38c6a None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:52.441069 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-97f996fa-c3e9-47db-9cc6-68aad4e38c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:52.538115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 16:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:52.690256 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f549b9e-5b86-4a77-abe8-b6bb6f20872b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:52.691875 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2f549b9e-5b86-4a77-abe8-b6bb6f20872b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:52.807139 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:52.846627 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f549b9e-5b86-4a77-abe8-b6bb6f20872b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:52.970471 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27b166-4a0d-4f31-8c58-ed591e9ce511 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:52.971108 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27b166-4a0d-4f31-8c58-ed591e9ce511 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:52.971388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27b166-4a0d-4f31-8c58-ed591e9ce511 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:52.971665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27b166-4a0d-4f31-8c58-ed591e9ce511 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:52.973892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7b27b166-4a0d-4f31-8c58-ed591e9ce511 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:53.061965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:53.077342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27b166-4a0d-4f31-8c58-ed591e9ce511 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:53.079095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27b166-4a0d-4f31-8c58-ed591e9ce511 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:53.100654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 705/1425] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:54.012590 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9898c21-8804-4668-9fd0-315f7e1b9dd3 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:54.013224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9898c21-8804-4668-9fd0-315f7e1b9dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:54.013224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9898c21-8804-4668-9fd0-315f7e1b9dd3 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:54.014497 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 16:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:54.019504 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe6fa2-ea9b-4882-bd65-cb3802a874f8 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:54.020086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe6fa2-ea9b-4882-bd65-cb3802a874f8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:54.020086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe6fa2-ea9b-4882-bd65-cb3802a874f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:54.098591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-cafe6fa2-ea9b-4882-bd65-cb3802a874f8 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:54.099836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-cafe6fa2-ea9b-4882-bd65-cb3802a874f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:54.205108 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 16:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:11:54.362040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9898c21-8804-4668-9fd0-315f7e1b9dd3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:54.363616 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c9898c21-8804-4668-9fd0-315f7e1b9dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:54.470517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:54.539831 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9898c21-8804-4668-9fd0-315f7e1b9dd3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:54.677049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf623a7-2ecc-4531-a255-bf87a5ac731f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:54.677614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf623a7-2ecc-4531-a255-bf87a5ac731f service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:54.677902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf623a7-2ecc-4531-a255-bf87a5ac731f service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:54.678178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf623a7-2ecc-4531-a255-bf87a5ac731f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:54.679890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ddf623a7-2ecc-4531-a255-bf87a5ac731f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:54.742436 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:54.787555 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf623a7-2ecc-4531-a255-bf87a5ac731f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:54.789193 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf623a7-2ecc-4531-a255-bf87a5ac731f service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:54.809269 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 722/1428] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:55.657960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d55ba-bdee-4750-80e8-46f7dabb7055 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:55.658568 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d55ba-bdee-4750-80e8-46f7dabb7055 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:55.658568 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d55ba-bdee-4750-80e8-46f7dabb7055 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:55.659877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 16:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:55.665310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d2fd3-0698-437f-aaca-b95bd08e91ad None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:55.665801 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d2fd3-0698-437f-aaca-b95bd08e91ad None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:55.665948 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d2fd3-0698-437f-aaca-b95bd08e91ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:55.741492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f47d2fd3-0698-437f-aaca-b95bd08e91ad None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:55.742807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f47d2fd3-0698-437f-aaca-b95bd08e91ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:55.838007 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 16:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:55.992323 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d55ba-bdee-4750-80e8-46f7dabb7055 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:55.993899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-168d55ba-bdee-4750-80e8-46f7dabb7055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:56.047193 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:56.149341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d55ba-bdee-4750-80e8-46f7dabb7055 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:56.264743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4610bd-0f5e-409f-931f-8419795f1a57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:56.265395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4610bd-0f5e-409f-931f-8419795f1a57 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:56.265674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4610bd-0f5e-409f-931f-8419795f1a57 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:56.265943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4610bd-0f5e-409f-931f-8419795f1a57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:56.267582 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0c4610bd-0f5e-409f-931f-8419795f1a57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:56.274706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:56.362560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4610bd-0f5e-409f-931f-8419795f1a57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:56.364715 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4610bd-0f5e-409f-931f-8419795f1a57 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:56.394551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 708/1431] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:11:57.225765 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f23c4-fd97-4947-b8a7-6b6eb3ed96ba None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:57.226295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f23c4-fd97-4947-b8a7-6b6eb3ed96ba None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:57.226295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f23c4-fd97-4947-b8a7-6b6eb3ed96ba None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:57.227727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 16:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:57.232751 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed95862-5bca-4a8f-8736-10f77372389f None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:57.233161 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed95862-5bca-4a8f-8736-10f77372389f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:57.233311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed95862-5bca-4a8f-8736-10f77372389f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:57.309573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-0ed95862-5bca-4a8f-8736-10f77372389f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:57.310864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0ed95862-5bca-4a8f-8736-10f77372389f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:57.381864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:57.411718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 16:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:57.562951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f23c4-fd97-4947-b8a7-6b6eb3ed96ba None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:57.564491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b39f23c4-fd97-4947-b8a7-6b6eb3ed96ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:57.583561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:57.718215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f23c4-fd97-4947-b8a7-6b6eb3ed96ba None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:57.808634 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:57.835768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d93da9-ddb0-40b0-a188-74484f46be75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:57.836383 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d93da9-ddb0-40b0-a188-74484f46be75 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:57.836744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d93da9-ddb0-40b0-a188-74484f46be75 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:57.837024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d93da9-ddb0-40b0-a188-74484f46be75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:57.838655 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b2d93da9-ddb0-40b0-a188-74484f46be75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:57.927569 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d93da9-ddb0-40b0-a188-74484f46be75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:57.929295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d93da9-ddb0-40b0-a188-74484f46be75 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:57.948271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 725/1434] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:11:58.757878 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9518d5a-d33e-4513-a6a7-60b378f13237 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:58.758464 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9518d5a-d33e-4513-a6a7-60b378f13237 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:58.758464 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9518d5a-d33e-4513-a6a7-60b378f13237 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:58.759861 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 16:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:11:58.767101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee809ee-d068-434a-adbf-802c59e2ddd4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:58.767673 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee809ee-d068-434a-adbf-802c59e2ddd4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:58.767673 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee809ee-d068-434a-adbf-802c59e2ddd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:58.853883 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4ee809ee-d068-434a-adbf-802c59e2ddd4 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:11:58.855134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4ee809ee-d068-434a-adbf-802c59e2ddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:58.913785 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:58.977858 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 16:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:11:59.143500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9518d5a-d33e-4513-a6a7-60b378f13237 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:11:59.145406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f9518d5a-d33e-4513-a6a7-60b378f13237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:59.325971 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9518d5a-d33e-4513-a6a7-60b378f13237 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:11:59.383113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:11:59.443316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe18c3e-ed8f-455f-909d-e0445a45daef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:11:59.443970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe18c3e-ed8f-455f-909d-e0445a45daef service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:11:59.444269 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe18c3e-ed8f-455f-909d-e0445a45daef service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:11:59.444566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe18c3e-ed8f-455f-909d-e0445a45daef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:11:59.446273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-dfe18c3e-ed8f-455f-909d-e0445a45daef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:11:59.540006 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe18c3e-ed8f-455f-909d-e0445a45daef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:11:59.541697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe18c3e-ed8f-455f-909d-e0445a45daef service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:11:59.562893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 711/1437] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:12:00.402312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a3b2c-3b30-45e2-9c26-12790861182e None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:00.403148 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a3b2c-3b30-45e2-9c26-12790861182e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:00.403148 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a3b2c-3b30-45e2-9c26-12790861182e None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:00.404539 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 16:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:12:00.409462 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848868b1-f5e6-405d-8256-acb405199223 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:00.409875 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848868b1-f5e6-405d-8256-acb405199223 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:00.410016 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848868b1-f5e6-405d-8256-acb405199223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:00.485936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-848868b1-f5e6-405d-8256-acb405199223 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:00.487098 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-848868b1-f5e6-405d-8256-acb405199223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:00.489202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:00.588333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 16:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:12:00.737023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a3b2c-3b30-45e2-9c26-12790861182e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:12:00.739006 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ae2a3b2c-3b30-45e2-9c26-12790861182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:00.881027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a3b2c-3b30-45e2-9c26-12790861182e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:12:00.908553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:01.003116 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c35ad-3ea3-4ec5-8e42-e22c169bb7b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:12:01.003687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c35ad-3ea3-4ec5-8e42-e22c169bb7b3 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:01.003972 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c35ad-3ea3-4ec5-8e42-e22c169bb7b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:01.004245 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c35ad-3ea3-4ec5-8e42-e22c169bb7b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:01.005926 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a97c35ad-3ea3-4ec5-8e42-e22c169bb7b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:01.100187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c35ad-3ea3-4ec5-8e42-e22c169bb7b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:12:01.101841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c35ad-3ea3-4ec5-8e42-e22c169bb7b3 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:12:01.123220 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 728/1440] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:12:03.115867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8efd4-e9ce-41e9-a8c9-178929c1b60d None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:03.116447 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8efd4-e9ce-41e9-a8c9-178929c1b60d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:03.116447 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8efd4-e9ce-41e9-a8c9-178929c1b60d None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:03.117885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 16:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:12:03.124408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4e62f-c55b-45da-bdc5-da8dd42b5135 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:03.125094 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4e62f-c55b-45da-bdc5-da8dd42b5135 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:03.125094 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4e62f-c55b-45da-bdc5-da8dd42b5135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:03.169547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:03.197406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-85f4e62f-c55b-45da-bdc5-da8dd42b5135 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:03.198646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-85f4e62f-c55b-45da-bdc5-da8dd42b5135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:03.311090 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 16:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:12:03.353251 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8efd4-e9ce-41e9-a8c9-178929c1b60d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:12:03.354798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-73e8efd4-e9ce-41e9-a8c9-178929c1b60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:03.470406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8efd4-e9ce-41e9-a8c9-178929c1b60d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:12:03.518214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:03.567906 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb1e14-2f09-4f3f-9b0c-50f90926b167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:12:03.568600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb1e14-2f09-4f3f-9b0c-50f90926b167 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:03.568888 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb1e14-2f09-4f3f-9b0c-50f90926b167 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:03.569163 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb1e14-2f09-4f3f-9b0c-50f90926b167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:03.570852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-06bb1e14-2f09-4f3f-9b0c-50f90926b167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:03.762799 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb1e14-2f09-4f3f-9b0c-50f90926b167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:12:03.765609 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb1e14-2f09-4f3f-9b0c-50f90926b167 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:12:03.801617 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 714/1443] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:12:06.031981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b569a-4739-491b-b16b-ca8e2c5d53d4 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:06.032665 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b569a-4739-491b-b16b-ca8e2c5d53d4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:06.032665 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b569a-4739-491b-b16b-ca8e2c5d53d4 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:06.033952 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 16:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:12:06.040720 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d461c-7aa1-4b7b-ba3e-3d1d3f4e55c8 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:06.041317 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d461c-7aa1-4b7b-ba3e-3d1d3f4e55c8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:06.041317 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d461c-7aa1-4b7b-ba3e-3d1d3f4e55c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:06.109377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b72d461c-7aa1-4b7b-ba3e-3d1d3f4e55c8 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:06.110481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b72d461c-7aa1-4b7b-ba3e-3d1d3f4e55c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:06.124902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:06.212173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 16:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:12:06.250626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b569a-4739-491b-b16b-ca8e2c5d53d4 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:12:06.252154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a53b569a-4739-491b-b16b-ca8e2c5d53d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:06.362980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b569a-4739-491b-b16b-ca8e2c5d53d4 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:12:06.376706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:06.448871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e69a56-c566-43e5-9bc2-6741fce545c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:12:06.449556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e69a56-c566-43e5-9bc2-6741fce545c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:06.449860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e69a56-c566-43e5-9bc2-6741fce545c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:06.450310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e69a56-c566-43e5-9bc2-6741fce545c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:06.452011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-11e69a56-c566-43e5-9bc2-6741fce545c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:06.576407 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e69a56-c566-43e5-9bc2-6741fce545c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:12:06.577859 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e69a56-c566-43e5-9bc2-6741fce545c0 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:12:06.597409 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 731/1446] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:12:08.970937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfa75b-214d-42a6-b0bb-36e5ac4cdf53 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:08.971494 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfa75b-214d-42a6-b0bb-36e5ac4cdf53 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:08.971494 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfa75b-214d-42a6-b0bb-36e5ac4cdf53 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:08.973048 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 16:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:12:08.979021 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9a04b-b79a-4d8c-b669-2c0e542dde44 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:08.979596 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9a04b-b79a-4d8c-b669-2c0e542dde44 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:08.979596 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9a04b-b79a-4d8c-b669-2c0e542dde44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:09.031551 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:09.052329 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-21f9a04b-b79a-4d8c-b669-2c0e542dde44 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:09.053555 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-21f9a04b-b79a-4d8c-b669-2c0e542dde44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:09.154753 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 16:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:12:09.194814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfa75b-214d-42a6-b0bb-36e5ac4cdf53 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:12:09.197164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3adfa75b-214d-42a6-b0bb-36e5ac4cdf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:09.302560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfa75b-214d-42a6-b0bb-36e5ac4cdf53 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:12:09.343308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:09.378040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851cc3b8-f3ee-4019-beea-dc049b528ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:12:09.378696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cc3b8-f3ee-4019-beea-dc049b528ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:09.378996 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cc3b8-f3ee-4019-beea-dc049b528ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:09.379273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851cc3b8-f3ee-4019-beea-dc049b528ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:09.380951 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-851cc3b8-f3ee-4019-beea-dc049b528ea0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:09.490213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851cc3b8-f3ee-4019-beea-dc049b528ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:12:09.491561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851cc3b8-f3ee-4019-beea-dc049b528ea0 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:12:09.510381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 717/1449] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:12:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:12:11.645419 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae712dc0-859f-4e57-82b8-5ca75616efed None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:11.645955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae712dc0-859f-4e57-82b8-5ca75616efed None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:11.645955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae712dc0-859f-4e57-82b8-5ca75616efed None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:11.647323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 16:12:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:12:11.652973 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb60e0-0117-4cc6-a1e5-13e6565751f5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:11.653658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb60e0-0117-4cc6-a1e5-13e6565751f5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:11.653796 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb60e0-0117-4cc6-a1e5-13e6565751f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:11.720602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-79fb60e0-0117-4cc6-a1e5-13e6565751f5 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:11.721839 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-79fb60e0-0117-4cc6-a1e5-13e6565751f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:11.743297 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:11.826560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 16:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:12:11.867457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae712dc0-859f-4e57-82b8-5ca75616efed None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:12:11.869398 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ae712dc0-859f-4e57-82b8-5ca75616efed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:11.978102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae712dc0-859f-4e57-82b8-5ca75616efed None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:12:12.002160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:12.060908 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cb9b3-91cf-41d7-a6a6-1a80f91bd6eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:12:12.061561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cb9b3-91cf-41d7-a6a6-1a80f91bd6eb service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:12.061847 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cb9b3-91cf-41d7-a6a6-1a80f91bd6eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:12.062125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cb9b3-91cf-41d7-a6a6-1a80f91bd6eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:12.063767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a87cb9b3-91cf-41d7-a6a6-1a80f91bd6eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:12.180397 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cb9b3-91cf-41d7-a6a6-1a80f91bd6eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:12:12.181858 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cb9b3-91cf-41d7-a6a6-1a80f91bd6eb service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:12:12.203355 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 734/1452] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:12:14.289672 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b56f3-06f0-4935-945b-59452c4cd0e5 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:14.290253 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b56f3-06f0-4935-945b-59452c4cd0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:14.290253 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b56f3-06f0-4935-945b-59452c4cd0e5 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:14.291592 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 16:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:12:14.297072 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b78d7a-6205-4b8d-b78b-36f23bd82b93 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:14.297505 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b78d7a-6205-4b8d-b78b-36f23bd82b93 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:14.297636 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b78d7a-6205-4b8d-b78b-36f23bd82b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:14.359562 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:14.362805 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-24b78d7a-6205-4b8d-b78b-36f23bd82b93 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:14.365089 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-24b78d7a-6205-4b8d-b78b-36f23bd82b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:14.461046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 16:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:12:14.498791 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b56f3-06f0-4935-945b-59452c4cd0e5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:12:14.500338 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-fa4b56f3-06f0-4935-945b-59452c4cd0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:14.603196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b56f3-06f0-4935-945b-59452c4cd0e5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:12:14.650662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:14.676482 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666aaf1-8073-4367-8939-6cd9545b1d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:12:14.677126 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666aaf1-8073-4367-8939-6cd9545b1d2e service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:14.677404 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666aaf1-8073-4367-8939-6cd9545b1d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:14.677673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666aaf1-8073-4367-8939-6cd9545b1d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:14.679311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9666aaf1-8073-4367-8939-6cd9545b1d2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:14.789815 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666aaf1-8073-4367-8939-6cd9545b1d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:12:14.791162 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666aaf1-8073-4367-8939-6cd9545b1d2e service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:12:14.809149 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 720/1455] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:12:16.850797 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb50c5-9730-41e8-9478-6543de85c9a5 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:16.851331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb50c5-9730-41e8-9478-6543de85c9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:16.851331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb50c5-9730-41e8-9478-6543de85c9a5 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:16.852664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 16:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:12:16.857934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264e1fb-61ba-4a4d-b0f3-25eaa20e71fb None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:16.858387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264e1fb-61ba-4a4d-b0f3-25eaa20e71fb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:16.858519 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264e1fb-61ba-4a4d-b0f3-25eaa20e71fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:16.924154 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e264e1fb-61ba-4a4d-b0f3-25eaa20e71fb None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:16.925402 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e264e1fb-61ba-4a4d-b0f3-25eaa20e71fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:16.955688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:17.024345 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 16:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:12:17.063655 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb50c5-9730-41e8-9478-6543de85c9a5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:12:17.065210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-88eb50c5-9730-41e8-9478-6543de85c9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:17.174147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb50c5-9730-41e8-9478-6543de85c9a5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:12:17.201600 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:17.248817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0ebd0-8778-4239-a3c5-5cca16bb0fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:12:17.249468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0ebd0-8778-4239-a3c5-5cca16bb0fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:17.249745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0ebd0-8778-4239-a3c5-5cca16bb0fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:17.250016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0ebd0-8778-4239-a3c5-5cca16bb0fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:17.251629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d9c0ebd0-8778-4239-a3c5-5cca16bb0fa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:17.359274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0ebd0-8778-4239-a3c5-5cca16bb0fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:12:17.360762 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0ebd0-8778-4239-a3c5-5cca16bb0fa6 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:12:17.381105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 737/1458] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:12:19.488072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b42b48-0ae6-42e0-a27c-06df2f08a05e None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:19.488634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b42b48-0ae6-42e0-a27c-06df2f08a05e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:19.488634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b42b48-0ae6-42e0-a27c-06df2f08a05e None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:19.490010 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 16:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:12:19.496104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054578c-1ff1-4f63-a2b0-4e2eeb34a84a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:19.496703 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054578c-1ff1-4f63-a2b0-4e2eeb34a84a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:19.496978 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054578c-1ff1-4f63-a2b0-4e2eeb34a84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:19.563608 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4054578c-1ff1-4f63-a2b0-4e2eeb34a84a None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:19.564846 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4054578c-1ff1-4f63-a2b0-4e2eeb34a84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:19.572986 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:19.662851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 16:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:12:19.700159 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b42b48-0ae6-42e0-a27c-06df2f08a05e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:12:19.701739 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-76b42b48-0ae6-42e0-a27c-06df2f08a05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:19.805851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b42b48-0ae6-42e0-a27c-06df2f08a05e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:12:19.860883 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:19.879873 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d70a9-8aa6-4697-97c7-5629e58495ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:12:19.880577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d70a9-8aa6-4697-97c7-5629e58495ec service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:19.880879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d70a9-8aa6-4697-97c7-5629e58495ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:19.881150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d70a9-8aa6-4697-97c7-5629e58495ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:19.882797 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b35d70a9-8aa6-4697-97c7-5629e58495ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:19.993473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d70a9-8aa6-4697-97c7-5629e58495ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:12:19.994923 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d70a9-8aa6-4697-97c7-5629e58495ec service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:12:20.014039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 723/1461] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:12:22.117439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97b1d5-bb71-4634-a605-fa7e5972a98d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:22.118019 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97b1d5-bb71-4634-a605-fa7e5972a98d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:22.118019 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97b1d5-bb71-4634-a605-fa7e5972a98d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:22.119380 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 16:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:12:22.125050 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf23e3d-d317-4e0e-87d0-6bcce584cf53 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:22.125457 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf23e3d-d317-4e0e-87d0-6bcce584cf53 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:22.125600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf23e3d-d317-4e0e-87d0-6bcce584cf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:22.193324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7cf23e3d-d317-4e0e-87d0-6bcce584cf53 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:22.194910 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7cf23e3d-d317-4e0e-87d0-6bcce584cf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:22.233918 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:22.291970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 16:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:12:22.329493 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97b1d5-bb71-4634-a605-fa7e5972a98d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:12:22.331064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ba97b1d5-bb71-4634-a605-fa7e5972a98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:22.434406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97b1d5-bb71-4634-a605-fa7e5972a98d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:12:22.472022 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:22.521518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928dd92-773e-4cc0-b261-da7f31f52660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:12:22.522173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928dd92-773e-4cc0-b261-da7f31f52660 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:22.522458 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928dd92-773e-4cc0-b261-da7f31f52660 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:22.522736 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928dd92-773e-4cc0-b261-da7f31f52660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:22.524387 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1928dd92-773e-4cc0-b261-da7f31f52660 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:22.633589 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928dd92-773e-4cc0-b261-da7f31f52660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:12:22.635041 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928dd92-773e-4cc0-b261-da7f31f52660 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:12:22.657643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 740/1464] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:12:24.683671 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ee6db-aa8a-468f-b828-9872095975a3 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:24.684219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ee6db-aa8a-468f-b828-9872095975a3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:24.684219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ee6db-aa8a-468f-b828-9872095975a3 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:24.685616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 16:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:12:24.691918 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9645b4-7e42-406b-a798-9273e13b3488 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:24.692603 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9645b4-7e42-406b-a798-9273e13b3488 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:24.692987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9645b4-7e42-406b-a798-9273e13b3488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:24.763423 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-eb9645b4-7e42-406b-a798-9273e13b3488 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:24.764703 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-eb9645b4-7e42-406b-a798-9273e13b3488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:24.782479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:24.862071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 16:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:12:24.898988 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ee6db-aa8a-468f-b828-9872095975a3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:12:24.900699 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-429ee6db-aa8a-468f-b828-9872095975a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:25.011976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ee6db-aa8a-468f-b828-9872095975a3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:12:25.082222 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:25.089408 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215925d-5fd9-433e-9654-e0506f123eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:12:25.090129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215925d-5fd9-433e-9654-e0506f123eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:25.090414 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215925d-5fd9-433e-9654-e0506f123eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:25.090692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215925d-5fd9-433e-9654-e0506f123eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:25.092377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6215925d-5fd9-433e-9654-e0506f123eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:25.201616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215925d-5fd9-433e-9654-e0506f123eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:12:25.203133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215925d-5fd9-433e-9654-e0506f123eb4 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:12:25.221886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 726/1467] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:12:27.240315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dc020-3493-4662-be32-432c33b09c13 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:27.240834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dc020-3493-4662-be32-432c33b09c13 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:27.240937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dc020-3493-4662-be32-432c33b09c13 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:27.242252 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 16:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:12:27.248971 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0ba4c-e482-429b-8034-de5616b85a07 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:27.249498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0ba4c-e482-429b-8034-de5616b85a07 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:27.250031 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0ba4c-e482-429b-8034-de5616b85a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:27.319479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-f5f0ba4c-e482-429b-8034-de5616b85a07 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:27.320750 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f5f0ba4c-e482-429b-8034-de5616b85a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:27.367733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:27.415838 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 16:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:12:27.452548 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dc020-3493-4662-be32-432c33b09c13 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:12:27.454007 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2e8dc020-3493-4662-be32-432c33b09c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:27.558160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dc020-3493-4662-be32-432c33b09c13 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:12:27.607305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:27.635464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e69a4-e60e-4dc2-bdf1-ef36808e8a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:12:27.636114 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e69a4-e60e-4dc2-bdf1-ef36808e8a91 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:27.636425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e69a4-e60e-4dc2-bdf1-ef36808e8a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:27.636704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e69a4-e60e-4dc2-bdf1-ef36808e8a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:27.638338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3d1e69a4-e60e-4dc2-bdf1-ef36808e8a91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:27.746656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e69a4-e60e-4dc2-bdf1-ef36808e8a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:12:27.747999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e69a4-e60e-4dc2-bdf1-ef36808e8a91 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:12:27.772470 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 743/1470] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:12:37.414003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=22 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:37.769381 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=66 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:47.460685 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817d2e1-fe49-463e-abc9-f9695c6f5040 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:47.461214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817d2e1-fe49-463e-abc9-f9695c6f5040 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:47.461214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817d2e1-fe49-463e-abc9-f9695c6f5040 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:47.462553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 728/1471] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:12:47.467751 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c4d22-23ff-45d6-b247-f68db31c16c7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:47.468198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c4d22-23ff-45d6-b247-f68db31c16c7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:47.468337 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c4d22-23ff-45d6-b247-f68db31c16c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:47.536684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-912c4d22-23ff-45d6-b247-f68db31c16c7 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:47.537886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-912c4d22-23ff-45d6-b247-f68db31c16c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:47.632698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 744/1472] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:12:47.717152 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7f07e-62c3-4022-a964-8a5be707377d None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:47.717441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7f07e-62c3-4022-a964-8a5be707377d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:47.717717 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7f07e-62c3-4022-a964-8a5be707377d None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:47.719095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 729/1473] 10.222.0.70 () {54 vars in 966 bytes} [Mon Jul 25 16:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:12:47.724131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ff34-aa5c-4639-a0b6-1064e6a7ab6a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:47.724443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ff34-aa5c-4639-a0b6-1064e6a7ab6a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:47.724721 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6ff34-aa5c-4639-a0b6-1064e6a7ab6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:47.799932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-29f6ff34-aa5c-4639-a0b6-1064e6a7ab6a None None] MFA Rules not processed for user `623c97746d304c6ba971e79e4dbeb730`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:47.801158 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-29f6ff34-aa5c-4639-a0b6-1064e6a7ab6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:47.821534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:47.876543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 745/1474] 10.222.0.70 () {58 vars in 1063 bytes} [Mon Jul 25 16:12:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:12:47.884740 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7f07e-62c3-4022-a964-8a5be707377d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:12:47.886234 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-90e7f07e-62c3-4022-a964-8a5be707377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:47.991881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7f07e-62c3-4022-a964-8a5be707377d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:12:48.065093 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c342cc6-665b-468c-a7c7-11a4106be3a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '623c97746d304c6ba971e79e4dbeb730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:12:48.066376 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c342cc6-665b-468c-a7c7-11a4106be3a7 service glance] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:48.066653 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c342cc6-665b-468c-a7c7-11a4106be3a7 service glance] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:48.066923 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c342cc6-665b-468c-a7c7-11a4106be3a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:48.068570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7c342cc6-665b-468c-a7c7-11a4106be3a7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:48.121767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:48.177137 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c342cc6-665b-468c-a7c7-11a4106be3a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:12:48.178601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c342cc6-665b-468c-a7c7-11a4106be3a7 service glance] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:12:48.196709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 730/1475] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:12:50.344621 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e0f75-bc3d-4625-91d7-8c64690d151a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:50.345191 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e0f75-bc3d-4625-91d7-8c64690d151a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:50.345191 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e0f75-bc3d-4625-91d7-8c64690d151a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:50.347306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 746/1476] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:12:50.353665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc4cb-0b96-4994-bb9c-a6345ef6d339 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:50.353665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc4cb-0b96-4994-bb9c-a6345ef6d339 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:50.353665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc4cb-0b96-4994-bb9c-a6345ef6d339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:50.421622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2ebdc4cb-0b96-4994-bb9c-a6345ef6d339 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:50.422851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2ebdc4cb-0b96-4994-bb9c-a6345ef6d339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:50.525672 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 731/1477] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:12:50.549509 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e0f75-bc3d-4625-91d7-8c64690d151a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:12:50.551655 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ff9e0f75-bc3d-4625-91d7-8c64690d151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:50.712965 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e0f75-bc3d-4625-91d7-8c64690d151a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:12:50.765526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:50.811680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcc2ac-a8f2-4502-9643-c96073722521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:12:50.812288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcc2ac-a8f2-4502-9643-c96073722521 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:50.812567 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcc2ac-a8f2-4502-9643-c96073722521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:50.812841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcc2ac-a8f2-4502-9643-c96073722521 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:50.813565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcc2ac-a8f2-4502-9643-c96073722521 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:12:50.815277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: WARNING py.warnings [None req-71fcc2ac-a8f2-4502-9643-c96073722521 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:12:50.815277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: warnings.warn(msg) Jul 25 16:12:50.815277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: Jul 25 16:12:50.816936 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcc2ac-a8f2-4502-9643-c96073722521 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:12:50.837192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 747/1478] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Jul 25 16:12:50 2022] GET /identity/v3/projects => generated 2553 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:12:52.874402 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bffc6-3611-40f0-9fef-0b592db967b6 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:52.874964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bffc6-3611-40f0-9fef-0b592db967b6 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:52.874964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bffc6-3611-40f0-9fef-0b592db967b6 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:52.876354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 732/1479] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:12:52.881995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa406d-243f-4a88-b253-ee0cbdcbc265 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:52.882451 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa406d-243f-4a88-b253-ee0cbdcbc265 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:52.882563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa406d-243f-4a88-b253-ee0cbdcbc265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:52.948843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3caa406d-243f-4a88-b253-ee0cbdcbc265 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:52.950061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3caa406d-243f-4a88-b253-ee0cbdcbc265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:53.046607 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 748/1480] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:12:53.090330 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bffc6-3611-40f0-9fef-0b592db967b6 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:12:53.091944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3b3bffc6-3611-40f0-9fef-0b592db967b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:53.101902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:53.242393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bffc6-3611-40f0-9fef-0b592db967b6 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:12:53.324225 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:53.356595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f9f03-e29f-4708-93ad-5ab07dfa2e8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:12:53.357243 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f9f03-e29f-4708-93ad-5ab07dfa2e8d service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:53.357525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f9f03-e29f-4708-93ad-5ab07dfa2e8d service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:53.357799 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f9f03-e29f-4708-93ad-5ab07dfa2e8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:53.359431 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6f8f9f03-e29f-4708-93ad-5ab07dfa2e8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:53.458473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f9f03-e29f-4708-93ad-5ab07dfa2e8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:12:53.460139 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f9f03-e29f-4708-93ad-5ab07dfa2e8d service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:12:53.478892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 733/1481] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:12:55.729500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e889df9-fdb5-4c10-b88b-0ce17b90ae58 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:55.730061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e889df9-fdb5-4c10-b88b-0ce17b90ae58 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:55.730208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e889df9-fdb5-4c10-b88b-0ce17b90ae58 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:55.731470 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 749/1482] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:12:55.736786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8849cc-e50d-4126-aa97-88be18bf2bcd None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:55.737231 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8849cc-e50d-4126-aa97-88be18bf2bcd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:55.737396 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8849cc-e50d-4126-aa97-88be18bf2bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:55.811621 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-db8849cc-e50d-4126-aa97-88be18bf2bcd None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:55.812889 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-db8849cc-e50d-4126-aa97-88be18bf2bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:55.865355 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:55.918918 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 734/1483] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:12:55.958328 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e889df9-fdb5-4c10-b88b-0ce17b90ae58 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:12:55.959874 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1e889df9-fdb5-4c10-b88b-0ce17b90ae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:55.986856 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:56.109474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e889df9-fdb5-4c10-b88b-0ce17b90ae58 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:12:56.209846 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd534e-d0de-4dee-981c-79b0618bece9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:12:56.210492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd534e-d0de-4dee-981c-79b0618bece9 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:56.210780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd534e-d0de-4dee-981c-79b0618bece9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:56.211061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd534e-d0de-4dee-981c-79b0618bece9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:56.212850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5cbd534e-d0de-4dee-981c-79b0618bece9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:56.288162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:56.325126 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd534e-d0de-4dee-981c-79b0618bece9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:12:56.326569 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd534e-d0de-4dee-981c-79b0618bece9 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:12:56.345386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 750/1484] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:12:58.441522 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbd135-f518-46e8-a628-36ff939f048c None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:58.442100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbd135-f518-46e8-a628-36ff939f048c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:58.442217 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbd135-f518-46e8-a628-36ff939f048c None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:58.443528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 735/1485] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:12:58.449287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa131102-de55-49db-b5a9-abc9b9057a1e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:58.449802 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa131102-de55-49db-b5a9-abc9b9057a1e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:58.449907 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa131102-de55-49db-b5a9-abc9b9057a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:58.531252 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-aa131102-de55-49db-b5a9-abc9b9057a1e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:12:58.533036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-aa131102-de55-49db-b5a9-abc9b9057a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:58.629057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 751/1486] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:12:58.668520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbd135-f518-46e8-a628-36ff939f048c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:12:58.670066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f3cbd135-f518-46e8-a628-36ff939f048c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:58.774918 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbd135-f518-46e8-a628-36ff939f048c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:12:58.858860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:12:58.863189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7407d-f21c-494b-b0ec-3495a1867cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:12:58.864203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7407d-f21c-494b-b0ec-3495a1867cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:12:58.864579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7407d-f21c-494b-b0ec-3495a1867cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:12:58.864997 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7407d-f21c-494b-b0ec-3495a1867cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:12:58.866904 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3fd7407d-f21c-494b-b0ec-3495a1867cc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:12:58.983089 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7407d-f21c-494b-b0ec-3495a1867cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:12:58.984576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7407d-f21c-494b-b0ec-3495a1867cc5 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:12:59.004543 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 736/1487] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:13:01.195744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474c2e5-09b5-4624-a86b-0e72ec65682c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:13:01.196385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474c2e5-09b5-4624-a86b-0e72ec65682c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:13:01.196385 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474c2e5-09b5-4624-a86b-0e72ec65682c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:13:01.197711 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 752/1488] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:13:01.202847 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521e2c3-b6da-4dda-bd02-ff32aa4fb5ec None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:13:01.203305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521e2c3-b6da-4dda-bd02-ff32aa4fb5ec None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:13:01.203406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521e2c3-b6da-4dda-bd02-ff32aa4fb5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:13:01.273358 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2521e2c3-b6da-4dda-bd02-ff32aa4fb5ec None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:13:01.274569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2521e2c3-b6da-4dda-bd02-ff32aa4fb5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:13:01.325284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:01.369863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 737/1489] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:13:01.410733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474c2e5-09b5-4624-a86b-0e72ec65682c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:13:01.412274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4474c2e5-09b5-4624-a86b-0e72ec65682c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:13:01.448227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:01.525903 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474c2e5-09b5-4624-a86b-0e72ec65682c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:13:01.600977 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13451bc-26e5-4fa3-9f40-cc02b0812032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:13:01.601611 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13451bc-26e5-4fa3-9f40-cc02b0812032 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:13:01.601896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13451bc-26e5-4fa3-9f40-cc02b0812032 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:13:01.602173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13451bc-26e5-4fa3-9f40-cc02b0812032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:13:01.603850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b13451bc-26e5-4fa3-9f40-cc02b0812032 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:13:01.683405 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:01.712700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13451bc-26e5-4fa3-9f40-cc02b0812032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:13:01.714146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13451bc-26e5-4fa3-9f40-cc02b0812032 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:13:01.733475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 753/1490] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:13:04.075999 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36421193-0634-47cf-910c-85a444ac5518 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:13:04.076604 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36421193-0634-47cf-910c-85a444ac5518 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:13:04.076604 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36421193-0634-47cf-910c-85a444ac5518 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:13:04.077959 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 738/1491] 10.222.0.70 () {54 vars in 926 bytes} [Mon Jul 25 16:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:13:04.083750 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044cedc-b4e6-40f5-873e-d992f2b13b5f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:13:04.084158 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044cedc-b4e6-40f5-873e-d992f2b13b5f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:13:04.084325 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044cedc-b4e6-40f5-873e-d992f2b13b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:13:04.151831 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8044cedc-b4e6-40f5-873e-d992f2b13b5f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:13:04.153098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8044cedc-b4e6-40f5-873e-d992f2b13b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:13:04.252375 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 754/1492] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Jul 25 16:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:13:04.292877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36421193-0634-47cf-910c-85a444ac5518 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:13:04.294401 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-36421193-0634-47cf-910c-85a444ac5518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:13:04.398719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36421193-0634-47cf-910c-85a444ac5518 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:13:04.474974 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d0c55-b32f-4f5c-bb82-d42c8d5f2f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:13:04.475632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d0c55-b32f-4f5c-bb82-d42c8d5f2f5a service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:13:04.475917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d0c55-b32f-4f5c-bb82-d42c8d5f2f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:13:04.476194 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d0c55-b32f-4f5c-bb82-d42c8d5f2f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:13:04.478002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-845d0c55-b32f-4f5c-bb82-d42c8d5f2f5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:13:04.488377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:04.596666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d0c55-b32f-4f5c-bb82-d42c8d5f2f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:13:04.597672 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d0c55-b32f-4f5c-bb82-d42c8d5f2f5a service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:13:04.621628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 739/1493] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:13:14.250298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=82 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:13:14.619337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=50 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:35.696029 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec81209-5b8d-49db-94e9-f7419cfcee68 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:35.696636 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec81209-5b8d-49db-94e9-f7419cfcee68 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:35.696636 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec81209-5b8d-49db-94e9-f7419cfcee68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:35.776894 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0ec81209-5b8d-49db-94e9-f7419cfcee68 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:14:35.778110 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0ec81209-5b8d-49db-94e9-f7419cfcee68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:14:35.877203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 755/1494] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:14:35.885574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191f018-feff-478e-9223-efebc8f34260 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:35.886097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191f018-feff-478e-9223-efebc8f34260 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:35.886203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191f018-feff-478e-9223-efebc8f34260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:35.964142 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-5191f018-feff-478e-9223-efebc8f34260 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:14:35.965293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5191f018-feff-478e-9223-efebc8f34260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:14:36.060176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 740/1495] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:14:36.064906 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec81209-5b8d-49db-94e9-f7419cfcee68 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:14:36.066106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0ec81209-5b8d-49db-94e9-f7419cfcee68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:14:36.077908 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec81209-5b8d-49db-94e9-f7419cfcee68 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:14:36.139904 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:36.174857 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5181899-bafa-4843-b5d2-0bd18adb5ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:14:36.175526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5181899-bafa-4843-b5d2-0bd18adb5ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:36.175809 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5181899-bafa-4843-b5d2-0bd18adb5ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:36.176087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5181899-bafa-4843-b5d2-0bd18adb5ec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:36.176842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5181899-bafa-4843-b5d2-0bd18adb5ec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:14:36.177149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5181899-bafa-4843-b5d2-0bd18adb5ec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:14:36.178163 dv-cinder-836973-15-smb devstack@keystone.service[80365]: WARNING py.warnings [None req-d5181899-bafa-4843-b5d2-0bd18adb5ec0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:14:36.178163 dv-cinder-836973-15-smb devstack@keystone.service[80365]: warnings.warn(msg) Jul 25 16:14:36.178163 dv-cinder-836973-15-smb devstack@keystone.service[80365]: Jul 25 16:14:36.179046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5181899-bafa-4843-b5d2-0bd18adb5ec0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:14:36.190528 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 756/1496] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:14:36.198888 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191f018-feff-478e-9223-efebc8f34260 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:14:36.208619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191f018-feff-478e-9223-efebc8f34260 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:14:36.270247 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:36.303480 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9b1eb-36e6-49a5-bd0f-96d29773ec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:14:36.304175 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9b1eb-36e6-49a5-bd0f-96d29773ec3a admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:36.304487 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9b1eb-36e6-49a5-bd0f-96d29773ec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:36.304765 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9b1eb-36e6-49a5-bd0f-96d29773ec3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:36.305453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9b1eb-36e6-49a5-bd0f-96d29773ec3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:14:36.307196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: WARNING py.warnings [None req-d9c9b1eb-36e6-49a5-bd0f-96d29773ec3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:14:36.307196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: warnings.warn(msg) Jul 25 16:14:36.307196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: Jul 25 16:14:36.308412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9b1eb-36e6-49a5-bd0f-96d29773ec3a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:14:36.365767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 741/1497] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:14:36 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:14:36.370114 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5181899-bafa-4843-b5d2-0bd18adb5ec0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:14:36.371619 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d5181899-bafa-4843-b5d2-0bd18adb5ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:14:36.405793 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5181899-bafa-4843-b5d2-0bd18adb5ec0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:14:36.499918 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbc73a-fe00-4258-b62e-6192705006cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:14:36.501055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbc73a-fe00-4258-b62e-6192705006cd admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:36.501335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbc73a-fe00-4258-b62e-6192705006cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:36.501604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbc73a-fe00-4258-b62e-6192705006cd admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:36.502281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbc73a-fe00-4258-b62e-6192705006cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:14:36.503306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: WARNING py.warnings [None req-3dbbc73a-fe00-4258-b62e-6192705006cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:14:36.503306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: warnings.warn(msg) Jul 25 16:14:36.503306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: Jul 25 16:14:36.504523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbc73a-fe00-4258-b62e-6192705006cd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:14:36.547087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 757/1498] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:14:36 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:14:36.551329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9b1eb-36e6-49a5-bd0f-96d29773ec3a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:14:36.552931 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d9c9b1eb-36e6-49a5-bd0f-96d29773ec3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:14:36.618915 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9b1eb-36e6-49a5-bd0f-96d29773ec3a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:14:36.709710 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:36.721167 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86c7df-4577-4dab-8fb9-7ec358cc4b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:14:36.721869 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86c7df-4577-4dab-8fb9-7ec358cc4b2a admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:36.722152 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86c7df-4577-4dab-8fb9-7ec358cc4b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:36.722432 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86c7df-4577-4dab-8fb9-7ec358cc4b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:36.723155 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86c7df-4577-4dab-8fb9-7ec358cc4b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:14:36.724188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: WARNING py.warnings [None req-ea86c7df-4577-4dab-8fb9-7ec358cc4b2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:14:36.724188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: warnings.warn(msg) Jul 25 16:14:36.724188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: Jul 25 16:14:36.725101 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86c7df-4577-4dab-8fb9-7ec358cc4b2a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:14:36.737948 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 742/1499] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:14:36.742004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbc73a-fe00-4258-b62e-6192705006cd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:14:36.743543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3dbbc73a-fe00-4258-b62e-6192705006cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:14:36.755825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbc73a-fe00-4258-b62e-6192705006cd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:14:36.784032 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:36.854883 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2305d-4e1b-4ecb-a9a8-b74351b53d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:14:36.855556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2305d-4e1b-4ecb-a9a8-b74351b53d0a admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:36.855835 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2305d-4e1b-4ecb-a9a8-b74351b53d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:36.856105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2305d-4e1b-4ecb-a9a8-b74351b53d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:36.856858 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2305d-4e1b-4ecb-a9a8-b74351b53d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:14:36.857862 dv-cinder-836973-15-smb devstack@keystone.service[80365]: WARNING py.warnings [None req-8ba2305d-4e1b-4ecb-a9a8-b74351b53d0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:14:36.857862 dv-cinder-836973-15-smb devstack@keystone.service[80365]: warnings.warn(msg) Jul 25 16:14:36.857862 dv-cinder-836973-15-smb devstack@keystone.service[80365]: Jul 25 16:14:36.858738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2305d-4e1b-4ecb-a9a8-b74351b53d0a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:14:36.871382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 758/1500] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:14:36.876489 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86c7df-4577-4dab-8fb9-7ec358cc4b2a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:14:36.878253 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ea86c7df-4577-4dab-8fb9-7ec358cc4b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:14:36.911100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86c7df-4577-4dab-8fb9-7ec358cc4b2a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:14:37.014972 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2bb1c-28e3-41a2-812b-c036baed1e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:14:37.016268 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2bb1c-28e3-41a2-812b-c036baed1e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:37.016268 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2bb1c-28e3-41a2-812b-c036baed1e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:37.016493 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2bb1c-28e3-41a2-812b-c036baed1e89 admin admin] PATH_INFO: `/v3/projects/eeb6d59f30704b8390a13946a725c6cf/users/8e9f1f9633e644788852d185457c35b8/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:37.039732 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2bb1c-28e3-41a2-812b-c036baed1e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb6d59f30704b8390a13946a725c6cf, user_id=8e9f1f9633e644788852d185457c35b8, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:14:37.040981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: WARNING py.warnings [None req-18f2bb1c-28e3-41a2-812b-c036baed1e89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:14:37.040981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: warnings.warn(msg) Jul 25 16:14:37.040981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: Jul 25 16:14:37.042767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2bb1c-28e3-41a2-812b-c036baed1e89 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:14:37.079425 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 743/1501] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:14:36 2022] PUT /identity/v3/projects/eeb6d59f30704b8390a13946a725c6cf/users/8e9f1f9633e644788852d185457c35b8/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:14:37.092156 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa839600-c5fc-4355-bed2-62f987cf1abe None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:37.092499 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa839600-c5fc-4355-bed2-62f987cf1abe None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:37.092782 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa839600-c5fc-4355-bed2-62f987cf1abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:37.151160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-aa839600-c5fc-4355-bed2-62f987cf1abe None None] MFA Rules not processed for user `8e9f1f9633e644788852d185457c35b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:14:37.152409 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-aa839600-c5fc-4355-bed2-62f987cf1abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:14:37.229186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 759/1502] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:14:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:14:37.243261 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edd0ca-16f3-435f-b3a5-62b0e7e9ca67 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:37.243549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edd0ca-16f3-435f-b3a5-62b0e7e9ca67 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:37.243825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edd0ca-16f3-435f-b3a5-62b0e7e9ca67 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:37.245231 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 744/1503] 10.222.0.70 () {54 vars in 964 bytes} [Mon Jul 25 16:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:14:37.250366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbe3e1-d00c-4517-a758-7b22dc6ce969 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:37.250654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbe3e1-d00c-4517-a758-7b22dc6ce969 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:37.250928 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbe3e1-d00c-4517-a758-7b22dc6ce969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:37.283260 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:37.328928 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ecbbe3e1-d00c-4517-a758-7b22dc6ce969 None None] MFA Rules not processed for user `b419d3dba854407f97f16fac79910d25`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:14:37.330155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ecbbe3e1-d00c-4517-a758-7b22dc6ce969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:14:37.411405 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 760/1504] 10.222.0.70 () {58 vars in 1061 bytes} [Mon Jul 25 16:14:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:14:37.427654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edd0ca-16f3-435f-b3a5-62b0e7e9ca67 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:14:37.429223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e3edd0ca-16f3-435f-b3a5-62b0e7e9ca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:14:37.479656 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:37.534460 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edd0ca-16f3-435f-b3a5-62b0e7e9ca67 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:14:37.608454 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d7687-3695-440d-994c-0aa223002e3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:14:37.609166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d7687-3695-440d-994c-0aa223002e3b service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:37.609489 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d7687-3695-440d-994c-0aa223002e3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:37.609809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d7687-3695-440d-994c-0aa223002e3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:37.611557 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d79d7687-3695-440d-994c-0aa223002e3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:14:37.711100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d7687-3695-440d-994c-0aa223002e3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:14:37.712557 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d7687-3695-440d-994c-0aa223002e3b service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:14:37.716056 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:37.731834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 745/1505] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:14:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:14:37.777738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561904d-b6ac-4956-a7ac-7f129fa531f5 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:37.778165 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561904d-b6ac-4956-a7ac-7f129fa531f5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:37.778309 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561904d-b6ac-4956-a7ac-7f129fa531f5 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:37.779624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 761/1506] 10.222.0.70 () {52 vars in 830 bytes} [Mon Jul 25 16:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:14:37.783437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d7687-3695-440d-994c-0aa223002e3b service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:14:37.784711 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d79d7687-3695-440d-994c-0aa223002e3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:14:37.891773 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d7687-3695-440d-994c-0aa223002e3b service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:14:37.985436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944c5e9-73ce-4e94-a626-15916bb9af36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:14:37.986300 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944c5e9-73ce-4e94-a626-15916bb9af36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:37.986573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944c5e9-73ce-4e94-a626-15916bb9af36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:37.986838 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944c5e9-73ce-4e94-a626-15916bb9af36 admin admin] PATH_INFO: `/v3/users/8e9f1f9633e644788852d185457c35b8` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:38.000746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944c5e9-73ce-4e94-a626-15916bb9af36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e9f1f9633e644788852d185457c35b8)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:14:38.001805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: WARNING py.warnings [None req-d944c5e9-73ce-4e94-a626-15916bb9af36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:14:38.001805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: warnings.warn(msg) Jul 25 16:14:38.001805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: Jul 25 16:14:38.003029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944c5e9-73ce-4e94-a626-15916bb9af36 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:14:38.013032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:38.067366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d944c5e9-73ce-4e94-a626-15916bb9af36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e9f1f9633e644788852d185457c35b8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:14:38.077173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d944c5e9-73ce-4e94-a626-15916bb9af36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e9f1f9633e644788852d185457c35b8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:14:38.077611 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d944c5e9-73ce-4e94-a626-15916bb9af36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e9f1f9633e644788852d185457c35b8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:14:38.078135 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d944c5e9-73ce-4e94-a626-15916bb9af36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e9f1f9633e644788852d185457c35b8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:14:38.096375 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d944c5e9-73ce-4e94-a626-15916bb9af36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e9f1f9633e644788852d185457c35b8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:14:38.115651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 746/1507] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:14:37 2022] DELETE /identity/v3/users/8e9f1f9633e644788852d185457c35b8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:14:38.120234 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2f17d-4e85-4b05-8575-8e9c441a413e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:38.120561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2f17d-4e85-4b05-8575-8e9c441a413e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:38.120838 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2f17d-4e85-4b05-8575-8e9c441a413e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:38.181494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-aed2f17d-4e85-4b05-8575-8e9c441a413e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:14:38.182715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-aed2f17d-4e85-4b05-8575-8e9c441a413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:14:38.261667 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:38.275587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 762/1508] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:14:38.285511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944c5e9-73ce-4e94-a626-15916bb9af36 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:14:38.286741 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d944c5e9-73ce-4e94-a626-15916bb9af36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:14:38.383511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944c5e9-73ce-4e94-a626-15916bb9af36 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:14:38.438497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:38.460797 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba8653-f673-41cb-8b6d-377a4c176469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:14:38.461543 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba8653-f673-41cb-8b6d-377a4c176469 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:38.461831 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba8653-f673-41cb-8b6d-377a4c176469 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:38.462148 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba8653-f673-41cb-8b6d-377a4c176469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:38.463820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-93ba8653-f673-41cb-8b6d-377a4c176469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:14:38.578800 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba8653-f673-41cb-8b6d-377a4c176469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:14:38.580373 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba8653-f673-41cb-8b6d-377a4c176469 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:14:38.601978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 747/1509] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:14:38.971153 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2f17d-4e85-4b05-8575-8e9c441a413e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:14:38.972416 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-aed2f17d-4e85-4b05-8575-8e9c441a413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:14:38.983876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2f17d-4e85-4b05-8575-8e9c441a413e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:14:39.084169 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb88fbb-2710-4115-a744-6ffc95ee0e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:14:39.085082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb88fbb-2710-4115-a744-6ffc95ee0e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:14:39.085367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb88fbb-2710-4115-a744-6ffc95ee0e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:14:39.085641 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb88fbb-2710-4115-a744-6ffc95ee0e5e admin admin] PATH_INFO: `/v3/projects/eeb6d59f30704b8390a13946a725c6cf` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:14:39.096363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb88fbb-2710-4115-a744-6ffc95ee0e5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb6d59f30704b8390a13946a725c6cf)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:14:39.097411 dv-cinder-836973-15-smb devstack@keystone.service[80365]: WARNING py.warnings [None req-7cb88fbb-2710-4115-a744-6ffc95ee0e5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:14:39.097411 dv-cinder-836973-15-smb devstack@keystone.service[80365]: warnings.warn(msg) Jul 25 16:14:39.097411 dv-cinder-836973-15-smb devstack@keystone.service[80365]: Jul 25 16:14:39.098615 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb88fbb-2710-4115-a744-6ffc95ee0e5e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:14:39.165513 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7cb88fbb-2710-4115-a744-6ffc95ee0e5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb6d59f30704b8390a13946a725c6cf', 'request_id': 'req-7cb88fbb-2710-4115-a744-6ffc95ee0e5e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:14:39.180957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7cb88fbb-2710-4115-a744-6ffc95ee0e5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb6d59f30704b8390a13946a725c6cf', 'request_id': 'req-7cb88fbb-2710-4115-a744-6ffc95ee0e5e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:14:39.189398 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7cb88fbb-2710-4115-a744-6ffc95ee0e5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb6d59f30704b8390a13946a725c6cf', 'request_id': 'req-7cb88fbb-2710-4115-a744-6ffc95ee0e5e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:14:39.215810 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7cb88fbb-2710-4115-a744-6ffc95ee0e5e admin admin] The token cache is being invalidate because project eeb6d59f30704b8390a13946a725c6cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:14:39.216104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7cb88fbb-2710-4115-a744-6ffc95ee0e5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:14:39.216652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7cb88fbb-2710-4115-a744-6ffc95ee0e5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:14:39.218021 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 763/1510] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:14:38 2022] DELETE /identity/v3/projects/eeb6d59f30704b8390a13946a725c6cf => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:14:48.599456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=62 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:14:49.213767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:38.574639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf41810-f80f-4219-9fb6-89f59d8b44bd None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:38.575233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf41810-f80f-4219-9fb6-89f59d8b44bd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:38.575233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf41810-f80f-4219-9fb6-89f59d8b44bd None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:38.576651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 16:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:16:38.582335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac8856-9953-4f37-8a4c-7a6a6d7689fa None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:38.582891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac8856-9953-4f37-8a4c-7a6a6d7689fa None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:38.582891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac8856-9953-4f37-8a4c-7a6a6d7689fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:38.676139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2dac8856-9953-4f37-8a4c-7a6a6d7689fa None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:16:38.677414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2dac8856-9953-4f37-8a4c-7a6a6d7689fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:16:38.800698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 16:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:16:38.959291 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf41810-f80f-4219-9fb6-89f59d8b44bd None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:16:38.961587 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5bf41810-f80f-4219-9fb6-89f59d8b44bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:16:39.105482 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf41810-f80f-4219-9fb6-89f59d8b44bd None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:16:39.111974 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111db464-7d9c-4568-8106-853f476cad5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:16:39.112674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111db464-7d9c-4568-8106-853f476cad5d service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:39.112951 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111db464-7d9c-4568-8106-853f476cad5d service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:39.113228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111db464-7d9c-4568-8106-853f476cad5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:39.122608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111db464-7d9c-4568-8106-853f476cad5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:16:39.124296 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111db464-7d9c-4568-8106-853f476cad5d service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:16:39.134695 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 749/1513] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:16:40.003901 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f33ddd-3a5e-492a-b224-5dac48fa86fa None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:40.004797 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f33ddd-3a5e-492a-b224-5dac48fa86fa None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:40.004962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f33ddd-3a5e-492a-b224-5dac48fa86fa None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:40.006599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 16:16:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:16:40.011886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae3816-7b4e-4d69-b993-6ed93eccb382 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:40.012422 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae3816-7b4e-4d69-b993-6ed93eccb382 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:40.012526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae3816-7b4e-4d69-b993-6ed93eccb382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:40.033808 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-0eae3816-7b4e-4d69-b993-6ed93eccb382 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:16:40.035092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0eae3816-7b4e-4d69-b993-6ed93eccb382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:16:40.043602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 16:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:16:40.212692 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f33ddd-3a5e-492a-b224-5dac48fa86fa None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:16:40.231216 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f33ddd-3a5e-492a-b224-5dac48fa86fa None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:16:40.239055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ba567-b7f6-47ff-aa36-b7f071016ed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:16:40.240010 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ba567-b7f6-47ff-aa36-b7f071016ed5 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:40.240365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ba567-b7f6-47ff-aa36-b7f071016ed5 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:40.240657 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ba567-b7f6-47ff-aa36-b7f071016ed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:40.251717 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ba567-b7f6-47ff-aa36-b7f071016ed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:16:40.253394 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ba567-b7f6-47ff-aa36-b7f071016ed5 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:16:40.264578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 766/1516] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:16:41.887342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15d18a-20c5-4aa4-967f-b3ddb08c7df2 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:41.887897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15d18a-20c5-4aa4-967f-b3ddb08c7df2 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:41.887897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15d18a-20c5-4aa4-967f-b3ddb08c7df2 None None] PATH_INFO: `/v3` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:41.889730 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 751/1517] 10.222.0.99 () {54 vars in 925 bytes} [Mon Jul 25 16:16:41 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:16:41.898212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e94fde-6437-48f0-b1c8-82470a494ca9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:41.898793 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e94fde-6437-48f0-b1c8-82470a494ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:41.898793 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e94fde-6437-48f0-b1c8-82470a494ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:41.966778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-29e94fde-6437-48f0-b1c8-82470a494ca9 None None] MFA Rules not processed for user `ba3474e40117440498f0fe99f743df50`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:16:41.968063 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-29e94fde-6437-48f0-b1c8-82470a494ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:16:41.986355 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:42.047261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 767/1518] 10.222.0.99 () {58 vars in 1015 bytes} [Mon Jul 25 16:16:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:16:50.027929 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=56 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:51.480173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3da9e-797f-4023-bffa-d41091bdab6b None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:51.480866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3da9e-797f-4023-bffa-d41091bdab6b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:51.480866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3da9e-797f-4023-bffa-d41091bdab6b None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:51.482251 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 752/1519] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 16:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:16:51.487535 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0080-6339-43df-b616-f569472b098d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:51.488044 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0080-6339-43df-b616-f569472b098d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:51.488150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0080-6339-43df-b616-f569472b098d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:51.507997 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b5bd0080-6339-43df-b616-f569472b098d None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:16:51.509349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b5bd0080-6339-43df-b616-f569472b098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:16:51.519103 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 768/1520] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 16:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:16:51.679170 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3da9e-797f-4023-bffa-d41091bdab6b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:16:51.700056 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3da9e-797f-4023-bffa-d41091bdab6b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:16:51.706438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5666c30-5040-423c-a937-65e3693d912a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:16:51.707570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5666c30-5040-423c-a937-65e3693d912a service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:51.707868 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5666c30-5040-423c-a937-65e3693d912a service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:51.708152 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5666c30-5040-423c-a937-65e3693d912a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:51.717372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5666c30-5040-423c-a937-65e3693d912a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:16:51.718969 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5666c30-5040-423c-a937-65e3693d912a service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:16:51.729517 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 753/1521] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:16:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:16:52.569047 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80287170-ca63-4463-b521-f24c7752c376 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:52.569579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80287170-ca63-4463-b521-f24c7752c376 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:52.569579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80287170-ca63-4463-b521-f24c7752c376 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:52.570948 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 16:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:16:52.576723 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766d27f-42bd-4ac3-87df-d88bf96896c1 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:52.577151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766d27f-42bd-4ac3-87df-d88bf96896c1 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:52.577289 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766d27f-42bd-4ac3-87df-d88bf96896c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:52.596907 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b766d27f-42bd-4ac3-87df-d88bf96896c1 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:16:52.598151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b766d27f-42bd-4ac3-87df-d88bf96896c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:16:52.606440 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 16:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:16:52.763620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80287170-ca63-4463-b521-f24c7752c376 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:16:52.778117 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80287170-ca63-4463-b521-f24c7752c376 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:16:52.783823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b2e90-2a4e-4824-999e-4b527ce8de9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:16:52.784514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b2e90-2a4e-4824-999e-4b527ce8de9a service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:52.784801 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b2e90-2a4e-4824-999e-4b527ce8de9a service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:52.785082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b2e90-2a4e-4824-999e-4b527ce8de9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:52.793815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b2e90-2a4e-4824-999e-4b527ce8de9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:16:52.796069 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b2e90-2a4e-4824-999e-4b527ce8de9a service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:16:52.806658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 770/1524] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:16:53.582358 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2638d2e-dd3d-433d-97e8-fb2328bac60d None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:53.583025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2638d2e-dd3d-433d-97e8-fb2328bac60d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:53.583025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2638d2e-dd3d-433d-97e8-fb2328bac60d None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:53.584214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 755/1525] 10.222.0.70 () {54 vars in 961 bytes} [Mon Jul 25 16:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:16:53.591915 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facce12-92b1-43e4-83b0-0e3f908a27ce None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:53.592460 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facce12-92b1-43e4-83b0-0e3f908a27ce None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:53.592572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facce12-92b1-43e4-83b0-0e3f908a27ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:53.611731 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7facce12-92b1-43e4-83b0-0e3f908a27ce None None] MFA Rules not processed for user `ba3474e40117440498f0fe99f743df50`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:16:53.612984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7facce12-92b1-43e4-83b0-0e3f908a27ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:16:53.621854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 771/1526] 10.222.0.70 () {58 vars in 1058 bytes} [Mon Jul 25 16:16:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:16:53.629440 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2638d2e-dd3d-433d-97e8-fb2328bac60d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:16:53.643846 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2638d2e-dd3d-433d-97e8-fb2328bac60d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:16:53.650061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf8d20-569e-4877-a0e1-32d58f1a1f91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3474e40117440498f0fe99f743df50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:16:53.650716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf8d20-569e-4877-a0e1-32d58f1a1f91 service placement] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:53.651003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf8d20-569e-4877-a0e1-32d58f1a1f91 service placement] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:53.651284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf8d20-569e-4877-a0e1-32d58f1a1f91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:53.661323 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf8d20-569e-4877-a0e1-32d58f1a1f91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:16:53.662928 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf8d20-569e-4877-a0e1-32d58f1a1f91 service placement] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:16:53.673679 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 756/1527] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:16:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:16:56.803224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2153-a7c3-4484-b22c-ab0bc7eeaefc None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:56.803909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2153-a7c3-4484-b22c-ab0bc7eeaefc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:56.803909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2153-a7c3-4484-b22c-ab0bc7eeaefc None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:56.805273 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 16:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:16:56.811616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d6185-b677-46e5-9bb5-ac22df8ae657 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:56.812162 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d6185-b677-46e5-9bb5-ac22df8ae657 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:56.812162 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d6185-b677-46e5-9bb5-ac22df8ae657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:56.832329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3a4d6185-b677-46e5-9bb5-ac22df8ae657 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:16:56.834004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3a4d6185-b677-46e5-9bb5-ac22df8ae657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:16:56.843137 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 16:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:16:56.920897 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b2153-a7c3-4484-b22c-ab0bc7eeaefc None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:16:56.922605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-143b2153-a7c3-4484-b22c-ab0bc7eeaefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:16:57.001576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b2153-a7c3-4484-b22c-ab0bc7eeaefc None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:16:57.005218 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7909b-aa9e-4cf4-81d0-4292f170fd88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:16:57.005865 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7909b-aa9e-4cf4-81d0-4292f170fd88 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:57.006152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7909b-aa9e-4cf4-81d0-4292f170fd88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:57.006424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7909b-aa9e-4cf4-81d0-4292f170fd88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:57.015667 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7909b-aa9e-4cf4-81d0-4292f170fd88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:16:57.017129 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7909b-aa9e-4cf4-81d0-4292f170fd88 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:16:57.026691 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 773/1530] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:16:59.086293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e829574-5f0c-4ad8-8b29-d66b905809c3 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:59.086885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e829574-5f0c-4ad8-8b29-d66b905809c3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:59.086885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e829574-5f0c-4ad8-8b29-d66b905809c3 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:59.088228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 16:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:16:59.093969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc96ad1-8e38-4646-9d36-5499226f2c6f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:59.094414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc96ad1-8e38-4646-9d36-5499226f2c6f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:59.094527 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc96ad1-8e38-4646-9d36-5499226f2c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:59.114268 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7cc96ad1-8e38-4646-9d36-5499226f2c6f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:16:59.115495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7cc96ad1-8e38-4646-9d36-5499226f2c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:16:59.124224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 16:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:16:59.160205 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e829574-5f0c-4ad8-8b29-d66b905809c3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:16:59.170771 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e829574-5f0c-4ad8-8b29-d66b905809c3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:16:59.174274 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e52a0e-7f21-40f6-b566-c43250fd00cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:16:59.174902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e52a0e-7f21-40f6-b566-c43250fd00cc service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:16:59.175180 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e52a0e-7f21-40f6-b566-c43250fd00cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:16:59.175448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e52a0e-7f21-40f6-b566-c43250fd00cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:16:59.184103 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e52a0e-7f21-40f6-b566-c43250fd00cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:16:59.186073 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e52a0e-7f21-40f6-b566-c43250fd00cc service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:16:59.195253 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 759/1533] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:17:02.848928 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee9ea2-134a-4677-bfff-0f78c2557daa None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:17:02.849532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee9ea2-134a-4677-bfff-0f78c2557daa None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:17:02.849532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee9ea2-134a-4677-bfff-0f78c2557daa None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:17:02.850855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 16:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:17:02.857874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644bbb7-dc67-4812-a858-af50774a1dcd None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:17:02.857874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644bbb7-dc67-4812-a858-af50774a1dcd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:17:02.857874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644bbb7-dc67-4812-a858-af50774a1dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:17:02.876736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e644bbb7-dc67-4812-a858-af50774a1dcd None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:17:02.877942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e644bbb7-dc67-4812-a858-af50774a1dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:17:02.885855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:17:03.195553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee9ea2-134a-4677-bfff-0f78c2557daa None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:17:03.197257 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9cee9ea2-134a-4677-bfff-0f78c2557daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:17:03.278129 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:03.294863 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee9ea2-134a-4677-bfff-0f78c2557daa None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:17:03.299256 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7dad8-7bc9-4a04-8ab2-7c5010dfb45a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:17:03.299910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7dad8-7bc9-4a04-8ab2-7c5010dfb45a service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:17:03.300190 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7dad8-7bc9-4a04-8ab2-7c5010dfb45a service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:17:03.300492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7dad8-7bc9-4a04-8ab2-7c5010dfb45a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:17:03.310071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7dad8-7bc9-4a04-8ab2-7c5010dfb45a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:17:03.311505 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7dad8-7bc9-4a04-8ab2-7c5010dfb45a service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:17:03.322298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 776/1536] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:17:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:17:05.403285 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202e6ff-386c-48cd-a2b5-0253d07e3dde None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:17:05.404128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202e6ff-386c-48cd-a2b5-0253d07e3dde None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:17:05.404128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202e6ff-386c-48cd-a2b5-0253d07e3dde None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:17:05.406093 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 16:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:17:05.411246 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df2c67-689c-4907-acd0-038d5cda138a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:17:05.411695 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df2c67-689c-4907-acd0-038d5cda138a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:17:05.411799 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df2c67-689c-4907-acd0-038d5cda138a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:17:05.431863 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-08df2c67-689c-4907-acd0-038d5cda138a None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:17:05.433253 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-08df2c67-689c-4907-acd0-038d5cda138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:17:05.441863 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 16:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:17:05.755013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202e6ff-386c-48cd-a2b5-0253d07e3dde None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:17:05.757461 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c202e6ff-386c-48cd-a2b5-0253d07e3dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:17:05.771081 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202e6ff-386c-48cd-a2b5-0253d07e3dde None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:17:05.774618 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfeec71-ac50-40c0-b086-0b22c1889dbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:17:05.775259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeec71-ac50-40c0-b086-0b22c1889dbe service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:17:05.775546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeec71-ac50-40c0-b086-0b22c1889dbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:17:05.775826 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeec71-ac50-40c0-b086-0b22c1889dbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:17:05.785507 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfeec71-ac50-40c0-b086-0b22c1889dbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:17:05.786959 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfeec71-ac50-40c0-b086-0b22c1889dbe service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:17:05.797249 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 762/1539] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:17:15.426131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=11 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:17:15.792397 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=33 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:54.715541 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eacae-46c5-45e7-9f4f-67b6444a6078 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:54.716240 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eacae-46c5-45e7-9f4f-67b6444a6078 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:54.716240 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eacae-46c5-45e7-9f4f-67b6444a6078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:54.746074 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-753eacae-46c5-45e7-9f4f-67b6444a6078 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:54.747319 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-753eacae-46c5-45e7-9f4f-67b6444a6078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:54.758150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 778/1540] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:54.767020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a7311-d70a-40ca-a1d7-b53ea5e2a499 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:54.767609 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a7311-d70a-40ca-a1d7-b53ea5e2a499 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:54.767609 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a7311-d70a-40ca-a1d7-b53ea5e2a499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:54.798020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-174a7311-d70a-40ca-a1d7-b53ea5e2a499 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:54.799412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-174a7311-d70a-40ca-a1d7-b53ea5e2a499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:54.821412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 763/1541] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:18:54.826254 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753eacae-46c5-45e7-9f4f-67b6444a6078 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:54.841189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753eacae-46c5-45e7-9f4f-67b6444a6078 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:54.846204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3365a-8e9a-4c76-9aec-6ca9da03a71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:54.846899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3365a-8e9a-4c76-9aec-6ca9da03a71f admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:54.847179 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3365a-8e9a-4c76-9aec-6ca9da03a71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:54.847495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3365a-8e9a-4c76-9aec-6ca9da03a71f admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:54.848208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3365a-8e9a-4c76-9aec-6ca9da03a71f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:18:54.848563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3365a-8e9a-4c76-9aec-6ca9da03a71f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:54.850282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3365a-8e9a-4c76-9aec-6ca9da03a71f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:54.869724 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 779/1542] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:18:54.879425 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a7311-d70a-40ca-a1d7-b53ea5e2a499 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:54.898716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a7311-d70a-40ca-a1d7-b53ea5e2a499 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:54.909135 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642df3a2-9fd0-4711-9ef7-ff866be0b39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:54.909835 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642df3a2-9fd0-4711-9ef7-ff866be0b39e admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:54.910122 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642df3a2-9fd0-4711-9ef7-ff866be0b39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:54.910422 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642df3a2-9fd0-4711-9ef7-ff866be0b39e admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:54.911113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642df3a2-9fd0-4711-9ef7-ff866be0b39e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:54.913114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642df3a2-9fd0-4711-9ef7-ff866be0b39e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:54.968495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 764/1543] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:18:54 2022] POST /identity/v3/projects => generated 389 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:18:54.972984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3365a-8e9a-4c76-9aec-6ca9da03a71f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:54.988710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3365a-8e9a-4c76-9aec-6ca9da03a71f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:55.073226 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8bc8f-1c98-4597-a6f3-f40cc25ab36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:55.073942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8bc8f-1c98-4597-a6f3-f40cc25ab36f admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.074222 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8bc8f-1c98-4597-a6f3-f40cc25ab36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.074494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8bc8f-1c98-4597-a6f3-f40cc25ab36f admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.075191 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8bc8f-1c98-4597-a6f3-f40cc25ab36f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:55.077203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8bc8f-1c98-4597-a6f3-f40cc25ab36f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:55.115575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 780/1544] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:18:54 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:18:55.120109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642df3a2-9fd0-4711-9ef7-ff866be0b39e admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:55.133929 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642df3a2-9fd0-4711-9ef7-ff866be0b39e admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:55.149244 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93d87f-8a20-41da-9d6c-ce2a204cee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:55.149969 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93d87f-8a20-41da-9d6c-ce2a204cee06 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.150259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93d87f-8a20-41da-9d6c-ce2a204cee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.150544 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93d87f-8a20-41da-9d6c-ce2a204cee06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.151339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93d87f-8a20-41da-9d6c-ce2a204cee06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:55.153664 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93d87f-8a20-41da-9d6c-ce2a204cee06 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:55.165703 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 765/1545] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:18:55.169554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8bc8f-1c98-4597-a6f3-f40cc25ab36f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:55.186521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8bc8f-1c98-4597-a6f3-f40cc25ab36f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:55.201022 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9d917-91ce-4b00-b694-ad24a1c399bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:55.201723 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9d917-91ce-4b00-b694-ad24a1c399bb admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.202008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9d917-91ce-4b00-b694-ad24a1c399bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.202282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9d917-91ce-4b00-b694-ad24a1c399bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.203018 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9d917-91ce-4b00-b694-ad24a1c399bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:55.204733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9d917-91ce-4b00-b694-ad24a1c399bb admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:55.216024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 781/1546] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:18:55.220340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93d87f-8a20-41da-9d6c-ce2a204cee06 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:55.248678 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93d87f-8a20-41da-9d6c-ce2a204cee06 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:55.256651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cee7bf-d5ec-464e-b9cd-9f123b4a480c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:55.257568 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cee7bf-d5ec-464e-b9cd-9f123b4a480c admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.257850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cee7bf-d5ec-464e-b9cd-9f123b4a480c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.258112 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cee7bf-d5ec-464e-b9cd-9f123b4a480c admin admin] PATH_INFO: `/v3/projects/2cca364a5fbf4c178d2d13c503544279/users/13ea16d9dcaa4c00b26e166b9a639077/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.284827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cee7bf-d5ec-464e-b9cd-9f123b4a480c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cca364a5fbf4c178d2d13c503544279, user_id=13ea16d9dcaa4c00b26e166b9a639077, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:55.287577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cee7bf-d5ec-464e-b9cd-9f123b4a480c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:55.306659 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 766/1547] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:18:55 2022] PUT /identity/v3/projects/2cca364a5fbf4c178d2d13c503544279/users/13ea16d9dcaa4c00b26e166b9a639077/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:18:55.312750 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24598f1-3bbf-4de8-be9e-f749d6496011 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.313050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24598f1-3bbf-4de8-be9e-f749d6496011 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.313332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24598f1-3bbf-4de8-be9e-f749d6496011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.345523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a24598f1-3bbf-4de8-be9e-f749d6496011 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:55.346791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a24598f1-3bbf-4de8-be9e-f749d6496011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:55.366450 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca11299-d1fa-47d8-a643-e3b3da301d69 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.366800 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca11299-d1fa-47d8-a643-e3b3da301d69 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.367020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca11299-d1fa-47d8-a643-e3b3da301d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.402787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-aca11299-d1fa-47d8-a643-e3b3da301d69 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:55.403948 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-aca11299-d1fa-47d8-a643-e3b3da301d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:55.467624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 782/1548] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:55.487461 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24598f1-3bbf-4de8-be9e-f749d6496011 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:55.490104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a24598f1-3bbf-4de8-be9e-f749d6496011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:55.543857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 767/1549] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:55.552965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc1d94-571f-4513-ab73-61955af0f3b2 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.553299 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc1d94-571f-4513-ab73-61955af0f3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.553529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc1d94-571f-4513-ab73-61955af0f3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.589364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-48dc1d94-571f-4513-ab73-61955af0f3b2 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:55.591183 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-48dc1d94-571f-4513-ab73-61955af0f3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:55.607026 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 768/1550] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:18:55.608376 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621b09e-66cf-4913-b563-1367afafb439 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.608662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621b09e-66cf-4913-b563-1367afafb439 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.608937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621b09e-66cf-4913-b563-1367afafb439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.627752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24598f1-3bbf-4de8-be9e-f749d6496011 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:55.631653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a8032-f7ee-4069-b242-e8115c9c5e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:55.632351 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a8032-f7ee-4069-b242-e8115c9c5e35 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.632640 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a8032-f7ee-4069-b242-e8115c9c5e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.632921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a8032-f7ee-4069-b242-e8115c9c5e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.645685 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-0621b09e-66cf-4913-b563-1367afafb439 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:55.647263 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0621b09e-66cf-4913-b563-1367afafb439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:55.658457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a8032-f7ee-4069-b242-e8115c9c5e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:55.659865 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a8032-f7ee-4069-b242-e8115c9c5e35 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:55.665377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 769/1551] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:55.667867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd36bb-3045-4508-bba9-9872b605fd5c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.668153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd36bb-3045-4508-bba9-9872b605fd5c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.668452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd36bb-3045-4508-bba9-9872b605fd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.694158 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 783/1552] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:18:55.698154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a8032-f7ee-4069-b242-e8115c9c5e35 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:55.707332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:55.712089 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-13cd36bb-3045-4508-bba9-9872b605fd5c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:55.713768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-13cd36bb-3045-4508-bba9-9872b605fd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:55.723792 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a8032-f7ee-4069-b242-e8115c9c5e35 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:55.741667 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177ef71-eebf-4b08-a7ad-f1f1517b03d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:55.742369 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ef71-eebf-4b08-a7ad-f1f1517b03d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.742658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ef71-eebf-4b08-a7ad-f1f1517b03d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.742939 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ef71-eebf-4b08-a7ad-f1f1517b03d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.743687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177ef71-eebf-4b08-a7ad-f1f1517b03d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:18:55.743998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177ef71-eebf-4b08-a7ad-f1f1517b03d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:55.748913 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177ef71-eebf-4b08-a7ad-f1f1517b03d9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:55.761976 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 784/1553] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:18:55.763297 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ad637-f817-45c9-9066-2fd457bb987c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.763589 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ad637-f817-45c9-9066-2fd457bb987c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.763869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ad637-f817-45c9-9066-2fd457bb987c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.764590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 770/1554] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:55.768098 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3619b1d-bd7f-439f-a959-ff8913873ef3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.770390 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3619b1d-bd7f-439f-a959-ff8913873ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.770958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3619b1d-bd7f-439f-a959-ff8913873ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.807741 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b3619b1d-bd7f-439f-a959-ff8913873ef3 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:55.809200 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b3619b1d-bd7f-439f-a959-ff8913873ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:55.813986 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c08ad637-f817-45c9-9066-2fd457bb987c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:55.815535 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c08ad637-f817-45c9-9066-2fd457bb987c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:55.818979 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 771/1555] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:55.821098 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e398d-90e6-495c-9a5e-641ce0e8f859 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.821433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e398d-90e6-495c-9a5e-641ce0e8f859 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.821661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e398d-90e6-495c-9a5e-641ce0e8f859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.826614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 785/1556] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:55.827951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ad637-f817-45c9-9066-2fd457bb987c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:55.839866 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ad637-f817-45c9-9066-2fd457bb987c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:55.845162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133e6db-7d0d-4ff4-9561-41b4213c8574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:55.845951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133e6db-7d0d-4ff4-9561-41b4213c8574 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.846305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133e6db-7d0d-4ff4-9561-41b4213c8574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.846693 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133e6db-7d0d-4ff4-9561-41b4213c8574 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.847307 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133e6db-7d0d-4ff4-9561-41b4213c8574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:55.848473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: WARNING py.warnings [None req-e133e6db-7d0d-4ff4-9561-41b4213c8574 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:18:55.848473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: warnings.warn(msg) Jul 25 16:18:55.848473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: Jul 25 16:18:55.849815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133e6db-7d0d-4ff4-9561-41b4213c8574 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:55.851061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-661e398d-90e6-495c-9a5e-641ce0e8f859 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:55.852357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-661e398d-90e6-495c-9a5e-641ce0e8f859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:55.872311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 772/1557] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:55.872311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9d88b-8eda-4e20-8f7f-8a8858ca13a5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.872311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9d88b-8eda-4e20-8f7f-8a8858ca13a5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.872311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9d88b-8eda-4e20-8f7f-8a8858ca13a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.886881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 786/1558] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:18:55 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:18:55.888334 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f71fa-a981-4f2f-9091-59fe8d1f9061 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:55.888631 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f71fa-a981-4f2f-9091-59fe8d1f9061 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:55.888911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f71fa-a981-4f2f-9091-59fe8d1f9061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:55.899005 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e3e9d88b-8eda-4e20-8f7f-8a8858ca13a5 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:55.900245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e3e9d88b-8eda-4e20-8f7f-8a8858ca13a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:55.913501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ac4f71fa-a981-4f2f-9091-59fe8d1f9061 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:55.914685 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ac4f71fa-a981-4f2f-9091-59fe8d1f9061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:55.978380 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:56.012072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 773/1559] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:56.014968 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a1809-b6ad-47d6-a39a-3620de4034ee None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.015532 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a1809-b6ad-47d6-a39a-3620de4034ee None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.016296 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a1809-b6ad-47d6-a39a-3620de4034ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.022314 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 787/1560] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:56.025363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f71fa-a981-4f2f-9091-59fe8d1f9061 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.045989 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-987a1809-b6ad-47d6-a39a-3620de4034ee None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:56.048193 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-987a1809-b6ad-47d6-a39a-3620de4034ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:56.049766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f71fa-a981-4f2f-9091-59fe8d1f9061 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.057984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacdd2c-f330-4405-9b46-e364ef7739fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.058366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 774/1561] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:56.058686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacdd2c-f330-4405-9b46-e364ef7739fb admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.058993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacdd2c-f330-4405-9b46-e364ef7739fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.059334 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacdd2c-f330-4405-9b46-e364ef7739fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.059821 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff0045-b52e-48fd-a2f7-6089390475dc None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.060095 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacdd2c-f330-4405-9b46-e364ef7739fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:18:56.060246 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff0045-b52e-48fd-a2f7-6089390475dc None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.060416 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff0045-b52e-48fd-a2f7-6089390475dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.060562 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacdd2c-f330-4405-9b46-e364ef7739fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.062131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacdd2c-f330-4405-9b46-e364ef7739fb admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.080351 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 788/1562] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:18:56.080351 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f9bb6-737e-4723-b693-418fa29a868d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.080351 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f9bb6-737e-4723-b693-418fa29a868d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.080351 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f9bb6-737e-4723-b693-418fa29a868d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.103161 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-fbff0045-b52e-48fd-a2f7-6089390475dc None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:56.104042 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-285f9bb6-737e-4723-b693-418fa29a868d None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:56.105733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-fbff0045-b52e-48fd-a2f7-6089390475dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:56.106136 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-285f9bb6-737e-4723-b693-418fa29a868d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:56.114669 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 789/1563] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:56.115766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f9bb6-737e-4723-b693-418fa29a868d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.116672 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 775/1564] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:56.117755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff0045-b52e-48fd-a2f7-6089390475dc None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.131669 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f9bb6-737e-4723-b693-418fa29a868d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.134661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff0045-b52e-48fd-a2f7-6089390475dc None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.137856 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6922eaa-ace3-4953-9216-fdf225f55498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.138548 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6922eaa-ace3-4953-9216-fdf225f55498 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.138854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6922eaa-ace3-4953-9216-fdf225f55498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.139138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6922eaa-ace3-4953-9216-fdf225f55498 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.140737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74189d96-4635-4a0d-bcbe-94a716668011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.141472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74189d96-4635-4a0d-bcbe-94a716668011 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.142023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74189d96-4635-4a0d-bcbe-94a716668011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.142407 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74189d96-4635-4a0d-bcbe-94a716668011 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.143159 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74189d96-4635-4a0d-bcbe-94a716668011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:18:56.143627 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74189d96-4635-4a0d-bcbe-94a716668011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.144702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: WARNING py.warnings [None req-74189d96-4635-4a0d-bcbe-94a716668011 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:18:56.144702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: warnings.warn(msg) Jul 25 16:18:56.144702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: Jul 25 16:18:56.145375 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6922eaa-ace3-4953-9216-fdf225f55498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.145707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74189d96-4635-4a0d-bcbe-94a716668011 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.149628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6922eaa-ace3-4953-9216-fdf225f55498 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.181682 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 776/1565] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:18:56.183731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f4376-2490-4b1b-8a14-18af5a7618cd None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.184082 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f4376-2490-4b1b-8a14-18af5a7618cd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.184577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f4376-2490-4b1b-8a14-18af5a7618cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.188786 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 790/1566] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:18:56 2022] POST /identity/v3/users => generated 292 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:18:56.190532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cffe1-f395-45d1-b782-87b119f17276 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.190965 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cffe1-f395-45d1-b782-87b119f17276 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.191521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cffe1-f395-45d1-b782-87b119f17276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.216188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-290f4376-2490-4b1b-8a14-18af5a7618cd None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:56.217849 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-290f4376-2490-4b1b-8a14-18af5a7618cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:56.223365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4b1cffe1-f395-45d1-b782-87b119f17276 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:56.229069 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4b1cffe1-f395-45d1-b782-87b119f17276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:56.238301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 791/1567] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:56.244106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 777/1568] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:56.245308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f4376-2490-4b1b-8a14-18af5a7618cd None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.245526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cffe1-f395-45d1-b782-87b119f17276 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.255856 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f4376-2490-4b1b-8a14-18af5a7618cd None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.256646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cffe1-f395-45d1-b782-87b119f17276 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.261419 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a3c3c-5d35-4d3b-9e4d-aaaa627a25df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.262452 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55c7ce-efdd-4163-9dc6-46000f13f6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.262597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a3c3c-5d35-4d3b-9e4d-aaaa627a25df admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.262799 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a3c3c-5d35-4d3b-9e4d-aaaa627a25df admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.263077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a3c3c-5d35-4d3b-9e4d-aaaa627a25df admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.263466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55c7ce-efdd-4163-9dc6-46000f13f6ef admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.263808 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a3c3c-5d35-4d3b-9e4d-aaaa627a25df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:18:56.263906 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55c7ce-efdd-4163-9dc6-46000f13f6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.264149 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a3c3c-5d35-4d3b-9e4d-aaaa627a25df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.264413 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55c7ce-efdd-4163-9dc6-46000f13f6ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.265176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55c7ce-efdd-4163-9dc6-46000f13f6ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.266030 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a3c3c-5d35-4d3b-9e4d-aaaa627a25df admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.269520 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55c7ce-efdd-4163-9dc6-46000f13f6ef admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.281398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 778/1569] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:18:56.290406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a3c3c-5d35-4d3b-9e4d-aaaa627a25df admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.304236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 792/1570] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:18:56 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:18:56.305147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55c7ce-efdd-4163-9dc6-46000f13f6ef admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.307851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a3c3c-5d35-4d3b-9e4d-aaaa627a25df admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.378240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff162c-8cc3-4450-8eec-fb6b25924e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.378924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff162c-8cc3-4450-8eec-fb6b25924e83 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.379802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff162c-8cc3-4450-8eec-fb6b25924e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.380140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff162c-8cc3-4450-8eec-fb6b25924e83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.381055 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff162c-8cc3-4450-8eec-fb6b25924e83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:18:56.381404 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff162c-8cc3-4450-8eec-fb6b25924e83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.382012 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:56.383205 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff162c-8cc3-4450-8eec-fb6b25924e83 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.388344 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55c7ce-efdd-4163-9dc6-46000f13f6ef admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.395988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce12dd-b67b-4404-b60c-fc3de3a4e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.396245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 779/1571] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:18:56.404841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce12dd-b67b-4404-b60c-fc3de3a4e3ce admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.404841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce12dd-b67b-4404-b60c-fc3de3a4e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.405117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff162c-8cc3-4450-8eec-fb6b25924e83 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.405251 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce12dd-b67b-4404-b60c-fc3de3a4e3ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.405251 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce12dd-b67b-4404-b60c-fc3de3a4e3ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.405251 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce12dd-b67b-4404-b60c-fc3de3a4e3ce admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.409464 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff162c-8cc3-4450-8eec-fb6b25924e83 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.414316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17314ead-61d5-4980-9a5d-63e2399ecb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.415120 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17314ead-61d5-4980-9a5d-63e2399ecb94 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.415429 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17314ead-61d5-4980-9a5d-63e2399ecb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.415791 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17314ead-61d5-4980-9a5d-63e2399ecb94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.416721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17314ead-61d5-4980-9a5d-63e2399ecb94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.418493 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17314ead-61d5-4980-9a5d-63e2399ecb94 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.433250 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 780/1572] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:18:56.434316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17314ead-61d5-4980-9a5d-63e2399ecb94 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.437707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 793/1573] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:18:56 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:18:56.438623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce12dd-b67b-4404-b60c-fc3de3a4e3ce admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.458742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17314ead-61d5-4980-9a5d-63e2399ecb94 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.519159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce12dd-b67b-4404-b60c-fc3de3a4e3ce admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.524831 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5796ba-c404-4e43-80d6-9b7a677d6d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.525836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5796ba-c404-4e43-80d6-9b7a677d6d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.526352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5796ba-c404-4e43-80d6-9b7a677d6d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.527430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5796ba-c404-4e43-80d6-9b7a677d6d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.528792 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5796ba-c404-4e43-80d6-9b7a677d6d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:18:56.529434 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5796ba-c404-4e43-80d6-9b7a677d6d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.529731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8136b-b7af-422d-bd8f-061fd0cd75fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.530514 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8136b-b7af-422d-bd8f-061fd0cd75fd admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.530822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8136b-b7af-422d-bd8f-061fd0cd75fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.531161 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8136b-b7af-422d-bd8f-061fd0cd75fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.531606 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5796ba-c404-4e43-80d6-9b7a677d6d00 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.532190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8136b-b7af-422d-bd8f-061fd0cd75fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:18:56.532647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8136b-b7af-422d-bd8f-061fd0cd75fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.535599 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8136b-b7af-422d-bd8f-061fd0cd75fd admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.552595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 781/1574] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:18:56.553333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8136b-b7af-422d-bd8f-061fd0cd75fd admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.566709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8136b-b7af-422d-bd8f-061fd0cd75fd admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.567857 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 794/1575] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:18:56.569585 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5796ba-c404-4e43-80d6-9b7a677d6d00 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.572589 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df851c9-4dec-4a27-870b-6e946dd98aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.573468 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df851c9-4dec-4a27-870b-6e946dd98aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.574385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df851c9-4dec-4a27-870b-6e946dd98aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.574746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df851c9-4dec-4a27-870b-6e946dd98aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.575612 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df851c9-4dec-4a27-870b-6e946dd98aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.577706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df851c9-4dec-4a27-870b-6e946dd98aa9 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.593760 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5796ba-c404-4e43-80d6-9b7a677d6d00 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.606300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbad8e5-72e1-4707-9aae-ef1b338dd9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.607179 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbad8e5-72e1-4707-9aae-ef1b338dd9bc admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.608016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbad8e5-72e1-4707-9aae-ef1b338dd9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.608330 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbad8e5-72e1-4707-9aae-ef1b338dd9bc admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.610726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbad8e5-72e1-4707-9aae-ef1b338dd9bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.613859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 782/1576] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:18:56 2022] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:18:56.617695 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbad8e5-72e1-4707-9aae-ef1b338dd9bc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.618530 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df851c9-4dec-4a27-870b-6e946dd98aa9 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.625897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:56.659867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 795/1577] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:18:56 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:18:56.661386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbad8e5-72e1-4707-9aae-ef1b338dd9bc admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.674640 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbad8e5-72e1-4707-9aae-ef1b338dd9bc admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.722429 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df851c9-4dec-4a27-870b-6e946dd98aa9 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.729715 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca17ae3-3158-4e72-ae9b-99f506e5aca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.730410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca17ae3-3158-4e72-ae9b-99f506e5aca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.730697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca17ae3-3158-4e72-ae9b-99f506e5aca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.730978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca17ae3-3158-4e72-ae9b-99f506e5aca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.744028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca17ae3-3158-4e72-ae9b-99f506e5aca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.744028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca17ae3-3158-4e72-ae9b-99f506e5aca8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.773979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87337dc-b866-4e07-b531-f0398f3e0763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.777643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87337dc-b866-4e07-b531-f0398f3e0763 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.777643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87337dc-b866-4e07-b531-f0398f3e0763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.777643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87337dc-b866-4e07-b531-f0398f3e0763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.778742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87337dc-b866-4e07-b531-f0398f3e0763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.782560 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87337dc-b866-4e07-b531-f0398f3e0763 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.785843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 783/1578] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:18:56 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:18:56.787160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca17ae3-3158-4e72-ae9b-99f506e5aca8 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.794182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 796/1579] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:18:56.795468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87337dc-b866-4e07-b531-f0398f3e0763 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.808989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87337dc-b866-4e07-b531-f0398f3e0763 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.864096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca17ae3-3158-4e72-ae9b-99f506e5aca8 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.871237 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228f241-e02e-4086-ba30-c6ca4e9a51c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.871929 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228f241-e02e-4086-ba30-c6ca4e9a51c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.872303 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228f241-e02e-4086-ba30-c6ca4e9a51c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.872613 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228f241-e02e-4086-ba30-c6ca4e9a51c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.873669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228f241-e02e-4086-ba30-c6ca4e9a51c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.875449 dv-cinder-836973-15-smb devstack@keystone.service[80366]: WARNING py.warnings [None req-4228f241-e02e-4086-ba30-c6ca4e9a51c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:18:56.875449 dv-cinder-836973-15-smb devstack@keystone.service[80366]: warnings.warn(msg) Jul 25 16:18:56.875449 dv-cinder-836973-15-smb devstack@keystone.service[80366]: Jul 25 16:18:56.876991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228f241-e02e-4086-ba30-c6ca4e9a51c5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.890032 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:56.910466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5ef9a-b432-44b2-86eb-a71965d4aa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.911151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 784/1580] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:18:56 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:18:56.911819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5ef9a-b432-44b2-86eb-a71965d4aa29 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.912100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228f241-e02e-4086-ba30-c6ca4e9a51c5 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.912803 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5ef9a-b432-44b2-86eb-a71965d4aa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.913320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5ef9a-b432-44b2-86eb-a71965d4aa29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.914316 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5ef9a-b432-44b2-86eb-a71965d4aa29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.916601 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5ef9a-b432-44b2-86eb-a71965d4aa29 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.925680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228f241-e02e-4086-ba30-c6ca4e9a51c5 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:56.932825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca7446-d30f-4ded-b4a3-73d13fc44c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:56.934178 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca7446-d30f-4ded-b4a3-73d13fc44c94 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:56.934551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca7446-d30f-4ded-b4a3-73d13fc44c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:56.934833 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca7446-d30f-4ded-b4a3-73d13fc44c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:56.935576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca7446-d30f-4ded-b4a3-73d13fc44c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:56.939298 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca7446-d30f-4ded-b4a3-73d13fc44c94 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:56.953791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 797/1581] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:18:56 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:18:56.955354 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5ef9a-b432-44b2-86eb-a71965d4aa29 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:56.995166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 785/1582] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:18:56 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:18:56.998534 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca7446-d30f-4ded-b4a3-73d13fc44c94 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.045263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5ef9a-b432-44b2-86eb-a71965d4aa29 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.098224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:57.108176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca7446-d30f-4ded-b4a3-73d13fc44c94 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.115994 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975528c9-c05c-4947-af77-a193658d38bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.117293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975528c9-c05c-4947-af77-a193658d38bf admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.117876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975528c9-c05c-4947-af77-a193658d38bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.118399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975528c9-c05c-4947-af77-a193658d38bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.119601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975528c9-c05c-4947-af77-a193658d38bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.123775 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975528c9-c05c-4947-af77-a193658d38bf admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.125086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0a1c5-c0a2-4165-8ecb-fba754df2916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.125707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0a1c5-c0a2-4165-8ecb-fba754df2916 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.125994 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0a1c5-c0a2-4165-8ecb-fba754df2916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.126320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0a1c5-c0a2-4165-8ecb-fba754df2916 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.127256 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0a1c5-c0a2-4165-8ecb-fba754df2916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.129420 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0a1c5-c0a2-4165-8ecb-fba754df2916 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.145049 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 786/1583] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:18:57.145995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975528c9-c05c-4947-af77-a193658d38bf admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.160153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975528c9-c05c-4947-af77-a193658d38bf admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.161123 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 798/1584] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:18:56 2022] POST /identity/v3/users => generated 296 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:18:57.162080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0a1c5-c0a2-4165-8ecb-fba754df2916 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.171034 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d8032-dd68-4b38-91dd-dd5ec0c99933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.173912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d8032-dd68-4b38-91dd-dd5ec0c99933 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.173912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d8032-dd68-4b38-91dd-dd5ec0c99933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.173912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d8032-dd68-4b38-91dd-dd5ec0c99933 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.174614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d8032-dd68-4b38-91dd-dd5ec0c99933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.174974 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0a1c5-c0a2-4165-8ecb-fba754df2916 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.180628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6decb3a-ea06-47ff-bffc-031a84f542ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.181651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6decb3a-ea06-47ff-bffc-031a84f542ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.181936 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6decb3a-ea06-47ff-bffc-031a84f542ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.182215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6decb3a-ea06-47ff-bffc-031a84f542ac admin admin] PATH_INFO: `/v3/projects/4b5c45e1d78648b08905776ef1da7751/users/8c3a3d4b47a74ae687076beaec38899e/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.183968 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d8032-dd68-4b38-91dd-dd5ec0c99933 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.200212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6decb3a-ea06-47ff-bffc-031a84f542ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5c45e1d78648b08905776ef1da7751, user_id=8c3a3d4b47a74ae687076beaec38899e, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.201309 dv-cinder-836973-15-smb devstack@keystone.service[80365]: WARNING py.warnings [None req-f6decb3a-ea06-47ff-bffc-031a84f542ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:18:57.201309 dv-cinder-836973-15-smb devstack@keystone.service[80365]: warnings.warn(msg) Jul 25 16:18:57.201309 dv-cinder-836973-15-smb devstack@keystone.service[80365]: Jul 25 16:18:57.204000 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6decb3a-ea06-47ff-bffc-031a84f542ac admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.219875 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 787/1585] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:18:57 2022] POST /identity/v3/users => generated 290 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:18:57.220521 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d8032-dd68-4b38-91dd-dd5ec0c99933 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.224296 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 799/1586] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:18:57 2022] PUT /identity/v3/projects/4b5c45e1d78648b08905776ef1da7751/users/8c3a3d4b47a74ae687076beaec38899e/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:18:57.225407 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6decb3a-ea06-47ff-bffc-031a84f542ac admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.234620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d8032-dd68-4b38-91dd-dd5ec0c99933 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.299063 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:57.315340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6decb3a-ea06-47ff-bffc-031a84f542ac admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.321876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aef58a-b272-426d-8f90-05bb53740df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.322718 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aef58a-b272-426d-8f90-05bb53740df6 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.323109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aef58a-b272-426d-8f90-05bb53740df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.323524 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aef58a-b272-426d-8f90-05bb53740df6 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.324329 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aef58a-b272-426d-8f90-05bb53740df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.326062 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5228e69-8d7b-4b23-bbd4-ac289a0a5e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.326462 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aef58a-b272-426d-8f90-05bb53740df6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.326818 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5228e69-8d7b-4b23-bbd4-ac289a0a5e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.327966 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5228e69-8d7b-4b23-bbd4-ac289a0a5e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.329057 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5228e69-8d7b-4b23-bbd4-ac289a0a5e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.329972 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5228e69-8d7b-4b23-bbd4-ac289a0a5e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.331946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5228e69-8d7b-4b23-bbd4-ac289a0a5e17 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.350724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 788/1587] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:18:57.351825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5228e69-8d7b-4b23-bbd4-ac289a0a5e17 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.358347 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 800/1588] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:18:57 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:18:57.359807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aef58a-b272-426d-8f90-05bb53740df6 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.367091 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5228e69-8d7b-4b23-bbd4-ac289a0a5e17 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.372787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aef58a-b272-426d-8f90-05bb53740df6 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.373357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf514a8-7af2-4748-95fa-c3f3d325f9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.374263 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf514a8-7af2-4748-95fa-c3f3d325f9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.374648 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf514a8-7af2-4748-95fa-c3f3d325f9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.375037 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf514a8-7af2-4748-95fa-c3f3d325f9f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.376651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf514a8-7af2-4748-95fa-c3f3d325f9f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.379012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf514a8-7af2-4748-95fa-c3f3d325f9f4 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.381681 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec941c0-e4a5-483f-903b-690df279c7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.383732 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec941c0-e4a5-483f-903b-690df279c7bd admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.384549 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec941c0-e4a5-483f-903b-690df279c7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.385833 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec941c0-e4a5-483f-903b-690df279c7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.387972 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec941c0-e4a5-483f-903b-690df279c7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.392113 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec941c0-e4a5-483f-903b-690df279c7bd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.415107 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 789/1589] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:18:57 2022] POST /identity/v3/users => generated 286 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:18:57.415107 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf514a8-7af2-4748-95fa-c3f3d325f9f4 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.432406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf514a8-7af2-4748-95fa-c3f3d325f9f4 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.438194 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 801/1590] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:18:57.439357 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec941c0-e4a5-483f-903b-690df279c7bd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.439484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e41221-45ce-41ae-a3ff-d5843e2eb30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.440762 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e41221-45ce-41ae-a3ff-d5843e2eb30d admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.441360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e41221-45ce-41ae-a3ff-d5843e2eb30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.441647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e41221-45ce-41ae-a3ff-d5843e2eb30d admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.442449 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e41221-45ce-41ae-a3ff-d5843e2eb30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.444962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e41221-45ce-41ae-a3ff-d5843e2eb30d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.453942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec941c0-e4a5-483f-903b-690df279c7bd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.457921 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 790/1591] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:18:57.459347 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c515-d4e1-4de7-997f-bee20789c9eb None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.459646 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c515-d4e1-4de7-997f-bee20789c9eb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.459926 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9c515-d4e1-4de7-997f-bee20789c9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.471751 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79546168-422d-4fe1-b14b-bc4e57d199c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.472642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79546168-422d-4fe1-b14b-bc4e57d199c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.472924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79546168-422d-4fe1-b14b-bc4e57d199c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.473237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79546168-422d-4fe1-b14b-bc4e57d199c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.473978 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79546168-422d-4fe1-b14b-bc4e57d199c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.475636 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79546168-422d-4fe1-b14b-bc4e57d199c4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.489380 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 802/1592] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:18:57.490429 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79546168-422d-4fe1-b14b-bc4e57d199c4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.502472 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79546168-422d-4fe1-b14b-bc4e57d199c4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.508471 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5b8a6-d36a-436d-8da1-37c935e5e33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.509159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5b8a6-d36a-436d-8da1-37c935e5e33d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.509465 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5b8a6-d36a-436d-8da1-37c935e5e33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.509746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5b8a6-d36a-436d-8da1-37c935e5e33d admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.510513 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5b8a6-d36a-436d-8da1-37c935e5e33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.512235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5b8a6-d36a-436d-8da1-37c935e5e33d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.514701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-42b9c515-d4e1-4de7-997f-bee20789c9eb None None] MFA Rules not processed for user `8c3a3d4b47a74ae687076beaec38899e`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:57.515920 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-42b9c515-d4e1-4de7-997f-bee20789c9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:57.524287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 803/1593] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:18:57.525119 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5b8a6-d36a-436d-8da1-37c935e5e33d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.545133 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5b8a6-d36a-436d-8da1-37c935e5e33d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.552518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505cdf9-9f0a-4318-b79c-3a9fc3b2c467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.553253 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505cdf9-9f0a-4318-b79c-3a9fc3b2c467 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.553542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505cdf9-9f0a-4318-b79c-3a9fc3b2c467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.553816 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505cdf9-9f0a-4318-b79c-3a9fc3b2c467 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.554539 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505cdf9-9f0a-4318-b79c-3a9fc3b2c467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.556161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505cdf9-9f0a-4318-b79c-3a9fc3b2c467 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.570486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 804/1594] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:18:57.571376 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505cdf9-9f0a-4318-b79c-3a9fc3b2c467 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.585188 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505cdf9-9f0a-4318-b79c-3a9fc3b2c467 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.592174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec522cce-2e30-4bdf-829c-72321e54b176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.593333 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec522cce-2e30-4bdf-829c-72321e54b176 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.593761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec522cce-2e30-4bdf-829c-72321e54b176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.594046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec522cce-2e30-4bdf-829c-72321e54b176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.595776 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec522cce-2e30-4bdf-829c-72321e54b176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.596740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec522cce-2e30-4bdf-829c-72321e54b176 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.620483 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 791/1595] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:57.620483 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9c515-d4e1-4de7-997f-bee20789c9eb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.620818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 805/1596] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:18:57.620818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec522cce-2e30-4bdf-829c-72321e54b176 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.639202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec522cce-2e30-4bdf-829c-72321e54b176 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.640502 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9c515-d4e1-4de7-997f-bee20789c9eb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.646099 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70d7fa-4a67-4401-8444-0cbadeb1b4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.647019 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70d7fa-4a67-4401-8444-0cbadeb1b4b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.647301 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70d7fa-4a67-4401-8444-0cbadeb1b4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.647584 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70d7fa-4a67-4401-8444-0cbadeb1b4b8 admin admin] PATH_INFO: `/v3/projects/8792efde9b484a8d9716cd45afed3f2c/users/6fa2cda90dc54933a3fe22880bebb478/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.653652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fe78d-218b-4936-bfbb-a57e045ad841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.654542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fe78d-218b-4936-bfbb-a57e045ad841 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.654922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fe78d-218b-4936-bfbb-a57e045ad841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.655312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fe78d-218b-4936-bfbb-a57e045ad841 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.656573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fe78d-218b-4936-bfbb-a57e045ad841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.658728 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fe78d-218b-4936-bfbb-a57e045ad841 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.670598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70d7fa-4a67-4401-8444-0cbadeb1b4b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8792efde9b484a8d9716cd45afed3f2c, user_id=6fa2cda90dc54933a3fe22880bebb478, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.675284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70d7fa-4a67-4401-8444-0cbadeb1b4b8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.680134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 806/1597] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:18:57.681109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fe78d-218b-4936-bfbb-a57e045ad841 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.696941 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fe78d-218b-4936-bfbb-a57e045ad841 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.703088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 792/1598] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:18:57 2022] PUT /identity/v3/projects/8792efde9b484a8d9716cd45afed3f2c/users/6fa2cda90dc54933a3fe22880bebb478/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:18:57.703896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70d7fa-4a67-4401-8444-0cbadeb1b4b8 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.715779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:57.829133 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cad953-d788-4349-b1ab-3af2d3854ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.829902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cad953-d788-4349-b1ab-3af2d3854ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.830317 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cad953-d788-4349-b1ab-3af2d3854ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.830607 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cad953-d788-4349-b1ab-3af2d3854ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.832193 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cad953-d788-4349-b1ab-3af2d3854ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.837717 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cad953-d788-4349-b1ab-3af2d3854ca0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.844267 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70d7fa-4a67-4401-8444-0cbadeb1b4b8 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.853680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90971f1f-30ab-4d70-8f57-e5cf72965fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.854666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90971f1f-30ab-4d70-8f57-e5cf72965fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.854981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90971f1f-30ab-4d70-8f57-e5cf72965fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.855422 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90971f1f-30ab-4d70-8f57-e5cf72965fc8 admin admin] PATH_INFO: `/v3/projects/f6194bc7246045febee397bea9c740e1/users/60ce8a3ca41441848a78a867575ac7de/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.859850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 807/1599] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:18:57.861462 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cad953-d788-4349-b1ab-3af2d3854ca0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.873178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cad953-d788-4349-b1ab-3af2d3854ca0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:57.878308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90971f1f-30ab-4d70-8f57-e5cf72965fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6194bc7246045febee397bea9c740e1, user_id=60ce8a3ca41441848a78a867575ac7de, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.881188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90971f1f-30ab-4d70-8f57-e5cf72965fc8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.882276 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d95f8-b6a4-4500-9306-cd89fa4d1a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:57.883203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d95f8-b6a4-4500-9306-cd89fa4d1a16 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.883587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d95f8-b6a4-4500-9306-cd89fa4d1a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.884062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d95f8-b6a4-4500-9306-cd89fa4d1a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.885072 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d95f8-b6a4-4500-9306-cd89fa4d1a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:57.888187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d95f8-b6a4-4500-9306-cd89fa4d1a16 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:57.905265 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 808/1600] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:18:57.905265 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d95f8-b6a4-4500-9306-cd89fa4d1a16 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.905575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 793/1601] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:18:57 2022] PUT /identity/v3/projects/f6194bc7246045febee397bea9c740e1/users/60ce8a3ca41441848a78a867575ac7de/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:18:57.905776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b35410-5047-41de-9c95-0a67cbb3bf3b None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:57.906092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b35410-5047-41de-9c95-0a67cbb3bf3b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:57.906434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b35410-5047-41de-9c95-0a67cbb3bf3b None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:57.908934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 794/1602] 10.222.0.70 () {54 vars in 962 bytes} [Mon Jul 25 16:18:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:18:57.909773 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b35410-5047-41de-9c95-0a67cbb3bf3b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:57.935349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d95f8-b6a4-4500-9306-cd89fa4d1a16 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:58.003540 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c1728-e8f2-4fb7-b220-b64d87b1de49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:58.004143 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c1728-e8f2-4fb7-b220-b64d87b1de49 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:58.004487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c1728-e8f2-4fb7-b220-b64d87b1de49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:58.004777 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c1728-e8f2-4fb7-b220-b64d87b1de49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:58.005510 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c1728-e8f2-4fb7-b220-b64d87b1de49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:58.007254 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c1728-e8f2-4fb7-b220-b64d87b1de49 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:58.009643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:58.012574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b35410-5047-41de-9c95-0a67cbb3bf3b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:58.018809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41159e7-2c79-490b-b338-27f23cf6718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:58.020403 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41159e7-2c79-490b-b338-27f23cf6718f admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:58.020903 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41159e7-2c79-490b-b338-27f23cf6718f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:58.021359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41159e7-2c79-490b-b338-27f23cf6718f admin admin] PATH_INFO: `/v3/projects/31cff479d29e46d5afd36dfb98a65aa2/users/471739ee64504a6fa88d5d52eb0c1df4/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:58.023300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 809/1603] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:18:58.024825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89561e-e403-495d-a72b-3a335576ca2e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:58.025125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89561e-e403-495d-a72b-3a335576ca2e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:58.025412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89561e-e403-495d-a72b-3a335576ca2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:58.047874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41159e7-2c79-490b-b338-27f23cf6718f admin admin] RBAC: Authorizing `identity:create_grant(project_id=31cff479d29e46d5afd36dfb98a65aa2, user_id=471739ee64504a6fa88d5d52eb0c1df4, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:58.048102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9e89561e-e403-495d-a72b-3a335576ca2e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:58.049550 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9e89561e-e403-495d-a72b-3a335576ca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:58.050692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41159e7-2c79-490b-b338-27f23cf6718f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:58.061001 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 810/1604] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:58.061797 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89561e-e403-495d-a72b-3a335576ca2e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:58.072882 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 795/1605] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:18:57 2022] PUT /identity/v3/projects/31cff479d29e46d5afd36dfb98a65aa2/users/471739ee64504a6fa88d5d52eb0c1df4/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:18:58.074151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41159e7-2c79-490b-b338-27f23cf6718f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:58.077958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89561e-e403-495d-a72b-3a335576ca2e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:58.151024 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41159e7-2c79-490b-b338-27f23cf6718f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:58.156030 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34c899-bf25-47c7-a4e2-6047242eedeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:58.157273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34c899-bf25-47c7-a4e2-6047242eedeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:58.157552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34c899-bf25-47c7-a4e2-6047242eedeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:58.157830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34c899-bf25-47c7-a4e2-6047242eedeb admin admin] PATH_INFO: `/v3/projects/25962efe2d564149aed6d42794470a53/users/c83577cd4ffe47bd9494f933df505058/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:58.161981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608838ba-c606-45d3-bf60-789355075e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:58.163111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608838ba-c606-45d3-bf60-789355075e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:58.163403 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608838ba-c606-45d3-bf60-789355075e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:58.163686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608838ba-c606-45d3-bf60-789355075e08 admin admin] PATH_INFO: `/v3/projects/c349fe56f64e4377ae674b60d36afc91/users/139716cccc014f2398791641de0d414c/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:58.177521 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34c899-bf25-47c7-a4e2-6047242eedeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=25962efe2d564149aed6d42794470a53, user_id=c83577cd4ffe47bd9494f933df505058, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:58.180388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34c899-bf25-47c7-a4e2-6047242eedeb admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:58.180828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608838ba-c606-45d3-bf60-789355075e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c349fe56f64e4377ae674b60d36afc91, user_id=139716cccc014f2398791641de0d414c, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:58.184736 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608838ba-c606-45d3-bf60-789355075e08 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:58.191703 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:58.201324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 796/1606] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:18:58 2022] PUT /identity/v3/projects/25962efe2d564149aed6d42794470a53/users/c83577cd4ffe47bd9494f933df505058/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:18:58.202170 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 811/1607] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:18:58 2022] PUT /identity/v3/projects/c349fe56f64e4377ae674b60d36afc91/users/139716cccc014f2398791641de0d414c/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:18:58.203015 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de2571-be3b-45e4-9c41-307b33eab3b5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:58.203370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de2571-be3b-45e4-9c41-307b33eab3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:58.203710 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de2571-be3b-45e4-9c41-307b33eab3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:58.204185 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d84e5-ef07-4549-9017-505034aa3976 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:58.204649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d84e5-ef07-4549-9017-505034aa3976 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:58.205106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d84e5-ef07-4549-9017-505034aa3976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:58.239136 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-63de2571-be3b-45e4-9c41-307b33eab3b5 None None] MFA Rules not processed for user `60ce8a3ca41441848a78a867575ac7de`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:58.240532 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-63de2571-be3b-45e4-9c41-307b33eab3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:58.256603 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-110d84e5-ef07-4549-9017-505034aa3976 None None] MFA Rules not processed for user `c455f8d340444b068249213ff504895e`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:58.257911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-110d84e5-ef07-4549-9017-505034aa3976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:58.317482 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 797/1608] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:58.318506 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de2571-be3b-45e4-9c41-307b33eab3b5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:58.357370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 812/1609] 10.222.0.70 () {58 vars in 1059 bytes} [Mon Jul 25 16:18:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:58.358050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d84e5-ef07-4549-9017-505034aa3976 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:58.419388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de2571-be3b-45e4-9c41-307b33eab3b5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:58.426204 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da343d7-d364-4cc1-a569-c8a561541116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:58.427549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da343d7-d364-4cc1-a569-c8a561541116 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:58.427981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da343d7-d364-4cc1-a569-c8a561541116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:58.428448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da343d7-d364-4cc1-a569-c8a561541116 admin admin] PATH_INFO: `/v3/projects/b401dd8f867d4ffb9d7bf477746ec1db/users/6d0e8d40579b4087a88f40a23eb6d15b/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:58.448624 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da343d7-d364-4cc1-a569-c8a561541116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b401dd8f867d4ffb9d7bf477746ec1db, user_id=6d0e8d40579b4087a88f40a23eb6d15b, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:58.449082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d84e5-ef07-4549-9017-505034aa3976 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:58.452185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da343d7-d364-4cc1-a569-c8a561541116 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:58.453008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a45fd-9463-438b-af69-f32b13acab5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:58.453684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a45fd-9463-438b-af69-f32b13acab5b service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:58.454117 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a45fd-9463-438b-af69-f32b13acab5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:58.454394 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a45fd-9463-438b-af69-f32b13acab5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:58.463281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:58.468947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a45fd-9463-438b-af69-f32b13acab5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:58.472898 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a45fd-9463-438b-af69-f32b13acab5b service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:58.475117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 798/1610] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:18:58 2022] PUT /identity/v3/projects/b401dd8f867d4ffb9d7bf477746ec1db/users/6d0e8d40579b4087a88f40a23eb6d15b/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:18:58.482019 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e73dd-56c7-4107-8e48-e07cd1d89c8e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:58.482384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e73dd-56c7-4107-8e48-e07cd1d89c8e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:58.482672 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e73dd-56c7-4107-8e48-e07cd1d89c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:58.501408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 813/1611] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:18:58.503772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3955fc-b02e-4079-8532-cf4609336b73 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:58.504862 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3955fc-b02e-4079-8532-cf4609336b73 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:58.505492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3955fc-b02e-4079-8532-cf4609336b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:58.513910 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-bd4e73dd-56c7-4107-8e48-e07cd1d89c8e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:58.515138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bd4e73dd-56c7-4107-8e48-e07cd1d89c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:58.564625 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bd3955fc-b02e-4079-8532-cf4609336b73 None None] MFA Rules not processed for user `c83577cd4ffe47bd9494f933df505058`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:58.566152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bd3955fc-b02e-4079-8532-cf4609336b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:58.659924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 799/1612] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:58.663464 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd840566-429a-4e50-b7cc-cce8c46caee6 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:58.663946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd840566-429a-4e50-b7cc-cce8c46caee6 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:58.664584 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd840566-429a-4e50-b7cc-cce8c46caee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:58.701579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-dd840566-429a-4e50-b7cc-cce8c46caee6 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:58.702738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-dd840566-429a-4e50-b7cc-cce8c46caee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:58.707570 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 814/1613] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:58.708835 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3955fc-b02e-4079-8532-cf4609336b73 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:58.712990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 800/1614] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:58.713768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd840566-429a-4e50-b7cc-cce8c46caee6 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:58.720284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:58.852535 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3955fc-b02e-4079-8532-cf4609336b73 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:58.857989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd4224-a669-46a0-bb50-724cff229b95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:58.858687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd4224-a669-46a0-bb50-724cff229b95 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:58.858974 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd4224-a669-46a0-bb50-724cff229b95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:58.859263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd4224-a669-46a0-bb50-724cff229b95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:58.873859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd840566-429a-4e50-b7cc-cce8c46caee6 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:58.880877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9c03e-4d04-425f-9128-614054638ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:58.881689 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9c03e-4d04-425f-9128-614054638ddb service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:58.882073 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9c03e-4d04-425f-9128-614054638ddb service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:58.882451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9c03e-4d04-425f-9128-614054638ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:58.967680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9c03e-4d04-425f-9128-614054638ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:58.969720 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9c03e-4d04-425f-9128-614054638ddb service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:58.983566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 801/1615] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:18:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:18:58.985988 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926e639-8b7d-4690-820f-9170d796ada8 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:58.986337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926e639-8b7d-4690-820f-9170d796ada8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:58.986891 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926e639-8b7d-4690-820f-9170d796ada8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:59.031280 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd4224-a669-46a0-bb50-724cff229b95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:59.033029 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd4224-a669-46a0-bb50-724cff229b95 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:59.057115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 815/1616] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:18:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:18:59.058048 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd4224-a669-46a0-bb50-724cff229b95 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:59.063439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-5926e639-8b7d-4690-820f-9170d796ada8 None None] MFA Rules not processed for user `6d0e8d40579b4087a88f40a23eb6d15b`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:59.065208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5926e639-8b7d-4690-820f-9170d796ada8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:59.172166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:59.204766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd4224-a669-46a0-bb50-724cff229b95 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:59.218428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1ca5e-e0b5-436b-9058-ae9668a4ed62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:59.219025 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1ca5e-e0b5-436b-9058-ae9668a4ed62 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:59.219335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1ca5e-e0b5-436b-9058-ae9668a4ed62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:59.219698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1ca5e-e0b5-436b-9058-ae9668a4ed62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:59.242125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1ca5e-e0b5-436b-9058-ae9668a4ed62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:59.243573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1ca5e-e0b5-436b-9058-ae9668a4ed62 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:59.284620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 802/1617] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:18:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:59.286793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926e639-8b7d-4690-820f-9170d796ada8 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:59.289186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 816/1618] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:18:59.307189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1ca5e-e0b5-436b-9058-ae9668a4ed62 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:59.321613 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926e639-8b7d-4690-820f-9170d796ada8 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:59.343176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1ca5e-e0b5-436b-9058-ae9668a4ed62 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:59.345510 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cf847-8e9f-4e71-a760-22c4b8b6bc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:59.348590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cf847-8e9f-4e71-a760-22c4b8b6bc61 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:59.349827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cf847-8e9f-4e71-a760-22c4b8b6bc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:59.351556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cf847-8e9f-4e71-a760-22c4b8b6bc61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:59.357943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cf847-8e9f-4e71-a760-22c4b8b6bc61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:59.361192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7566a71-b082-49d4-a932-d8841237901b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:59.361873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7566a71-b082-49d4-a932-d8841237901b service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:59.362161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7566a71-b082-49d4-a932-d8841237901b service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:59.362438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7566a71-b082-49d4-a932-d8841237901b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:59.367469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cf847-8e9f-4e71-a760-22c4b8b6bc61 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:59.393254 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7566a71-b082-49d4-a932-d8841237901b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:59.395262 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7566a71-b082-49d4-a932-d8841237901b service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:59.420700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 817/1619] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:18:59.422861 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd80891-83b4-4ba2-af74-81024f3acb29 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:59.423182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd80891-83b4-4ba2-af74-81024f3acb29 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:59.426564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd80891-83b4-4ba2-af74-81024f3acb29 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:59.440519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 818/1620] 10.222.0.70 () {54 vars in 962 bytes} [Mon Jul 25 16:18:59 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:18:59.453735 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a3752-2a15-4ff1-9aaf-e7454b680ace None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:59.453735 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a3752-2a15-4ff1-9aaf-e7454b680ace None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:59.453735 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a3752-2a15-4ff1-9aaf-e7454b680ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:59.483150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-800a3752-2a15-4ff1-9aaf-e7454b680ace None None] MFA Rules not processed for user `c455f8d340444b068249213ff504895e`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:59.484753 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-800a3752-2a15-4ff1-9aaf-e7454b680ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:59.505409 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 819/1621] 10.222.0.70 () {58 vars in 1059 bytes} [Mon Jul 25 16:18:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:59.507594 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3d86c-d8a2-412a-9c21-a6373dafe351 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:59.507990 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3d86c-d8a2-412a-9c21-a6373dafe351 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:59.508399 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3d86c-d8a2-412a-9c21-a6373dafe351 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:59.510081 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 820/1622] 10.222.0.70 () {54 vars in 912 bytes} [Mon Jul 25 16:18:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:18:59.515591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3d86c-d8a2-412a-9c21-a6373dafe351 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:59.540161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3d86c-d8a2-412a-9c21-a6373dafe351 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:59.547499 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35555dd-7ce0-4345-9add-3b522db1bef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:59.548656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35555dd-7ce0-4345-9add-3b522db1bef5 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:59.549158 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35555dd-7ce0-4345-9add-3b522db1bef5 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:59.549432 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35555dd-7ce0-4345-9add-3b522db1bef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:59.559165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 803/1623] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:18:59 2022] POST /identity/v3/projects => generated 379 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:18:59.563781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2c2b2-d999-47cc-84a4-bd578bd4e34c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:59.564155 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2c2b2-d999-47cc-84a4-bd578bd4e34c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:59.564776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2c2b2-d999-47cc-84a4-bd578bd4e34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:59.575622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35555dd-7ce0-4345-9add-3b522db1bef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:59.580123 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35555dd-7ce0-4345-9add-3b522db1bef5 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:18:59.603719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 821/1624] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:18:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:18:59.606545 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35555dd-7ce0-4345-9add-3b522db1bef5 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:59.611735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-98d2c2b2-d999-47cc-84a4-bd578bd4e34c None None] MFA Rules not processed for user `c455f8d340444b068249213ff504895e`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:18:59.616989 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-98d2c2b2-d999-47cc-84a4-bd578bd4e34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:18:59.623863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:59.626808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35555dd-7ce0-4345-9add-3b522db1bef5 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:18:59.798233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 804/1625] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 25 16:18:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:18:59.833997 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2c2b2-d999-47cc-84a4-bd578bd4e34c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:18:59.918358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6863bb-cc54-4739-ad43-39ec0f8b29fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:18:59.921109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6863bb-cc54-4739-ad43-39ec0f8b29fe admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:18:59.925221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6863bb-cc54-4739-ad43-39ec0f8b29fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:18:59.926062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6863bb-cc54-4739-ad43-39ec0f8b29fe admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:18:59.928031 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6863bb-cc54-4739-ad43-39ec0f8b29fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:18:59.938169 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6863bb-cc54-4739-ad43-39ec0f8b29fe admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:00.028504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 822/1626] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:18:59 2022] POST /identity/v3/users => generated 296 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:00.028633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2c2b2-d999-47cc-84a4-bd578bd4e34c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:00.033707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6863bb-cc54-4739-ad43-39ec0f8b29fe admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:00.044302 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90172514-36af-4e71-82dc-0585c85570bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:00.045007 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90172514-36af-4e71-82dc-0585c85570bf service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:00.050345 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90172514-36af-4e71-82dc-0585c85570bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:00.050767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90172514-36af-4e71-82dc-0585c85570bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:00.092808 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90172514-36af-4e71-82dc-0585c85570bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:00.095480 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90172514-36af-4e71-82dc-0585c85570bf service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:00.096065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6863bb-cc54-4739-ad43-39ec0f8b29fe admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:00.129861 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95cc56-3b62-418f-858b-651e15fbb60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:00.131036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95cc56-3b62-418f-858b-651e15fbb60b admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:00.131522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95cc56-3b62-418f-858b-651e15fbb60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:00.131994 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95cc56-3b62-418f-858b-651e15fbb60b admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:00.148225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95cc56-3b62-418f-858b-651e15fbb60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:00.151456 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95cc56-3b62-418f-858b-651e15fbb60b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:00.157356 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 805/1627] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:18:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:19:00.159148 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62ee71-dcc4-416c-b882-3d7151bdd3c2 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:00.159443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62ee71-dcc4-416c-b882-3d7151bdd3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:00.159724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62ee71-dcc4-416c-b882-3d7151bdd3c2 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:00.163285 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 806/1628] 10.222.0.70 () {54 vars in 912 bytes} [Mon Jul 25 16:19:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:19:00.168943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929b91d-1f3b-46ee-91a2-6186c444d164 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:00.169213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929b91d-1f3b-46ee-91a2-6186c444d164 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:00.169806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929b91d-1f3b-46ee-91a2-6186c444d164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:00.211271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 823/1629] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:00.222466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95cc56-3b62-418f-858b-651e15fbb60b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:00.222934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3929b91d-1f3b-46ee-91a2-6186c444d164 None None] MFA Rules not processed for user `c455f8d340444b068249213ff504895e`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:00.224209 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3929b91d-1f3b-46ee-91a2-6186c444d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:00.257688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 807/1630] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 25 16:19:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:00.285379 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95cc56-3b62-418f-858b-651e15fbb60b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:00.310847 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991b1fc-3c62-4183-b520-0746010ec5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:00.312419 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991b1fc-3c62-4183-b520-0746010ec5d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:00.312910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991b1fc-3c62-4183-b520-0746010ec5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:00.313384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991b1fc-3c62-4183-b520-0746010ec5d7 admin admin] PATH_INFO: `/v3/projects/bec5b844ca664f2cb082cdfd9af65c9c/users/8ee98b4039e341a78569bd7924c17ebc/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:00.367563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991b1fc-3c62-4183-b520-0746010ec5d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec5b844ca664f2cb082cdfd9af65c9c, user_id=8ee98b4039e341a78569bd7924c17ebc, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:00.373995 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991b1fc-3c62-4183-b520-0746010ec5d7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:00.430682 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 824/1631] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:00 2022] PUT /identity/v3/projects/bec5b844ca664f2cb082cdfd9af65c9c/users/8ee98b4039e341a78569bd7924c17ebc/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:00.432494 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929b91d-1f3b-46ee-91a2-6186c444d164 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:00.452372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929b91d-1f3b-46ee-91a2-6186c444d164 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:00.594448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8516255-4906-407b-98d3-fd1c7ad6de54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:00.595549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8516255-4906-407b-98d3-fd1c7ad6de54 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:00.595815 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8516255-4906-407b-98d3-fd1c7ad6de54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:00.596080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8516255-4906-407b-98d3-fd1c7ad6de54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:00.597032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8516255-4906-407b-98d3-fd1c7ad6de54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:00.599116 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8516255-4906-407b-98d3-fd1c7ad6de54 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:00.630005 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 808/1632] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:00.634036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991b1fc-3c62-4183-b520-0746010ec5d7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:00.686815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991b1fc-3c62-4183-b520-0746010ec5d7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:00.715872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55157f78-e29e-4cac-9df1-7e31042c22c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:00.726350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157f78-e29e-4cac-9df1-7e31042c22c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:00.735187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157f78-e29e-4cac-9df1-7e31042c22c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:00.735824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157f78-e29e-4cac-9df1-7e31042c22c0 admin admin] PATH_INFO: `/v3/projects/bec5b844ca664f2cb082cdfd9af65c9c/users/8ee98b4039e341a78569bd7924c17ebc/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:00.747517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55157f78-e29e-4cac-9df1-7e31042c22c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec5b844ca664f2cb082cdfd9af65c9c, user_id=8ee98b4039e341a78569bd7924c17ebc, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:00.753325 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8516255-4906-407b-98d3-fd1c7ad6de54 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:00.780127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55157f78-e29e-4cac-9df1-7e31042c22c0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:00.823435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 825/1633] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:00 2022] PUT /identity/v3/projects/bec5b844ca664f2cb082cdfd9af65c9c/users/8ee98b4039e341a78569bd7924c17ebc/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:00.836934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526de5-cddf-4830-a86c-ca38ae753c57 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:00.839542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526de5-cddf-4830-a86c-ca38ae753c57 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:00.840210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526de5-cddf-4830-a86c-ca38ae753c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:00.849652 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:00.915859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8516255-4906-407b-98d3-fd1c7ad6de54 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:00.992300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-75526de5-cddf-4830-a86c-ca38ae753c57 None None] MFA Rules not processed for user `8ee98b4039e341a78569bd7924c17ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:00.999373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-75526de5-cddf-4830-a86c-ca38ae753c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:01.072287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce0e06-25d3-45c1-b71e-00dbf15a653f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:01.075416 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce0e06-25d3-45c1-b71e-00dbf15a653f service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:01.075662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce0e06-25d3-45c1-b71e-00dbf15a653f service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:01.075944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce0e06-25d3-45c1-b71e-00dbf15a653f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:01.131079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:01.233389 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 826/1634] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:01.249606 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce0e06-25d3-45c1-b71e-00dbf15a653f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:01.253752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce0e06-25d3-45c1-b71e-00dbf15a653f service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:01.298498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 809/1635] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:01.729976 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75526de5-cddf-4830-a86c-ca38ae753c57 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:01.748568 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75526de5-cddf-4830-a86c-ca38ae753c57 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:01.765578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267779fc-f4c1-4aa3-9125-66b1ac8bb452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:01.765578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267779fc-f4c1-4aa3-9125-66b1ac8bb452 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:01.765917 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267779fc-f4c1-4aa3-9125-66b1ac8bb452 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:01.766113 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267779fc-f4c1-4aa3-9125-66b1ac8bb452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:01.803891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267779fc-f4c1-4aa3-9125-66b1ac8bb452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:01.814254 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267779fc-f4c1-4aa3-9125-66b1ac8bb452 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:01.862979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 827/1636] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:02.180046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce0e06-25d3-45c1-b71e-00dbf15a653f service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:02.191007 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce0e06-25d3-45c1-b71e-00dbf15a653f service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:02.210733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd0923-deb3-48c1-af03-23b4ddac886e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:02.213662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd0923-deb3-48c1-af03-23b4ddac886e service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:02.216976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd0923-deb3-48c1-af03-23b4ddac886e service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:02.217549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd0923-deb3-48c1-af03-23b4ddac886e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:02.383518 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd0923-deb3-48c1-af03-23b4ddac886e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:02.387455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd0923-deb3-48c1-af03-23b4ddac886e service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:02.409688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 810/1637] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:05.431566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267779fc-f4c1-4aa3-9125-66b1ac8bb452 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:05.613104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267779fc-f4c1-4aa3-9125-66b1ac8bb452 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:05.633524 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85db0c-4da6-4774-83d5-0200367e8408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:05.638746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85db0c-4da6-4774-83d5-0200367e8408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:05.640987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85db0c-4da6-4774-83d5-0200367e8408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:05.642769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85db0c-4da6-4774-83d5-0200367e8408 admin admin] PATH_INFO: `/v3/users/6d0e8d40579b4087a88f40a23eb6d15b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:05.646961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85db0c-4da6-4774-83d5-0200367e8408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d0e8d40579b4087a88f40a23eb6d15b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:05.652696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: WARNING py.warnings [None req-2c85db0c-4da6-4774-83d5-0200367e8408 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:19:05.652696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: warnings.warn(msg) Jul 25 16:19:05.652696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: Jul 25 16:19:05.657953 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85db0c-4da6-4774-83d5-0200367e8408 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:05.836286 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2c85db0c-4da6-4774-83d5-0200367e8408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d0e8d40579b4087a88f40a23eb6d15b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:05.836286 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2c85db0c-4da6-4774-83d5-0200367e8408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d0e8d40579b4087a88f40a23eb6d15b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:05.836980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2c85db0c-4da6-4774-83d5-0200367e8408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d0e8d40579b4087a88f40a23eb6d15b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:05.883268 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2c85db0c-4da6-4774-83d5-0200367e8408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d0e8d40579b4087a88f40a23eb6d15b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:05.912826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2c85db0c-4da6-4774-83d5-0200367e8408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d0e8d40579b4087a88f40a23eb6d15b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:06.037526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 828/1638] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:05 2022] DELETE /identity/v3/users/6d0e8d40579b4087a88f40a23eb6d15b => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:06.041718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d286f0e-561f-4fb0-96d0-5069694cb8d7 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:06.046757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d286f0e-561f-4fb0-96d0-5069694cb8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:06.047400 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d286f0e-561f-4fb0-96d0-5069694cb8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:06.101346 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-9d286f0e-561f-4fb0-96d0-5069694cb8d7 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:06.123251 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9d286f0e-561f-4fb0-96d0-5069694cb8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:06.218886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:06.310105 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 811/1639] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:06.403241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85db0c-4da6-4774-83d5-0200367e8408 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:06.404738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2c85db0c-4da6-4774-83d5-0200367e8408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:06.517169 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:06.557910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85db0c-4da6-4774-83d5-0200367e8408 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:06.569748 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e2f9e-dafb-480c-a0df-ee02dda6b23c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:06.572631 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e2f9e-dafb-480c-a0df-ee02dda6b23c service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:06.574163 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e2f9e-dafb-480c-a0df-ee02dda6b23c service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:06.574608 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e2f9e-dafb-480c-a0df-ee02dda6b23c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:06.602072 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e2f9e-dafb-480c-a0df-ee02dda6b23c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:06.605804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e2f9e-dafb-480c-a0df-ee02dda6b23c service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:06.638631 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 829/1640] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:06.728310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423abeaa-f347-44cb-85e8-63a294be794f None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:06.728310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423abeaa-f347-44cb-85e8-63a294be794f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:06.728452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423abeaa-f347-44cb-85e8-63a294be794f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:06.808020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-423abeaa-f347-44cb-85e8-63a294be794f None None] MFA Rules not processed for user `13ea16d9dcaa4c00b26e166b9a639077`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:06.809347 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-423abeaa-f347-44cb-85e8-63a294be794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:06.962243 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 812/1641] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:06.978716 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e2f9e-dafb-480c-a0df-ee02dda6b23c service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:06.981980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-574e2f9e-dafb-480c-a0df-ee02dda6b23c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:07.223139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e2f9e-dafb-480c-a0df-ee02dda6b23c service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:07.244482 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449de3-60c3-47e9-9d43-53c349906c0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:07.249654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449de3-60c3-47e9-9d43-53c349906c0a service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:07.250693 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449de3-60c3-47e9-9d43-53c349906c0a service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:07.251001 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449de3-60c3-47e9-9d43-53c349906c0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:07.281878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f449de3-60c3-47e9-9d43-53c349906c0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:07.285492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f449de3-60c3-47e9-9d43-53c349906c0a service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:07.330421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 830/1642] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:08.780835 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423abeaa-f347-44cb-85e8-63a294be794f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:08.784997 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-423abeaa-f347-44cb-85e8-63a294be794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:08.863306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423abeaa-f347-44cb-85e8-63a294be794f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:08.912661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d715aa-1aeb-4530-9af3-9119b9759f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:08.913885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d715aa-1aeb-4530-9af3-9119b9759f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:08.914319 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d715aa-1aeb-4530-9af3-9119b9759f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:08.914984 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d715aa-1aeb-4530-9af3-9119b9759f34 admin admin] PATH_INFO: `/v3/users/8c3a3d4b47a74ae687076beaec38899e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:08.920814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d715aa-1aeb-4530-9af3-9119b9759f34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3a3d4b47a74ae687076beaec38899e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:08.927835 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d715aa-1aeb-4530-9af3-9119b9759f34 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:09.064725 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b2d715aa-1aeb-4530-9af3-9119b9759f34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3a3d4b47a74ae687076beaec38899e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:09.087999 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b2d715aa-1aeb-4530-9af3-9119b9759f34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3a3d4b47a74ae687076beaec38899e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:09.089104 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b2d715aa-1aeb-4530-9af3-9119b9759f34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3a3d4b47a74ae687076beaec38899e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:09.089855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b2d715aa-1aeb-4530-9af3-9119b9759f34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3a3d4b47a74ae687076beaec38899e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:09.129893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b2d715aa-1aeb-4530-9af3-9119b9759f34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3a3d4b47a74ae687076beaec38899e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:09.137610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449de3-60c3-47e9-9d43-53c349906c0a service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:09.140003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7f449de3-60c3-47e9-9d43-53c349906c0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:09.189690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449de3-60c3-47e9-9d43-53c349906c0a service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:09.208818 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 813/1643] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:08 2022] DELETE /identity/v3/users/8c3a3d4b47a74ae687076beaec38899e => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:09.210549 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac3d83-a2ff-48e5-b54a-3939639cf0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:09.211432 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac3d83-a2ff-48e5-b54a-3939639cf0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:09.211873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac3d83-a2ff-48e5-b54a-3939639cf0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:09.212330 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac3d83-a2ff-48e5-b54a-3939639cf0dd admin admin] PATH_INFO: `/v3/projects/b401dd8f867d4ffb9d7bf477746ec1db` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:09.213495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab508775-f485-4041-a5aa-8f12192cb29b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:09.213828 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab508775-f485-4041-a5aa-8f12192cb29b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:09.214219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab508775-f485-4041-a5aa-8f12192cb29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:09.216378 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac3d83-a2ff-48e5-b54a-3939639cf0dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b401dd8f867d4ffb9d7bf477746ec1db)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:09.230798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac3d83-a2ff-48e5-b54a-3939639cf0dd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:09.275503 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ab508775-f485-4041-a5aa-8f12192cb29b None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:09.278463 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ab508775-f485-4041-a5aa-8f12192cb29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:09.323799 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:09.412720 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 814/1644] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:09.439831 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0ac3d83-a2ff-48e5-b54a-3939639cf0dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b401dd8f867d4ffb9d7bf477746ec1db', 'request_id': 'req-d0ac3d83-a2ff-48e5-b54a-3939639cf0dd'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:09.466387 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0ac3d83-a2ff-48e5-b54a-3939639cf0dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b401dd8f867d4ffb9d7bf477746ec1db', 'request_id': 'req-d0ac3d83-a2ff-48e5-b54a-3939639cf0dd'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:09.468440 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab508775-f485-4041-a5aa-8f12192cb29b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:09.470209 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ab508775-f485-4041-a5aa-8f12192cb29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:09.499826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0ac3d83-a2ff-48e5-b54a-3939639cf0dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b401dd8f867d4ffb9d7bf477746ec1db', 'request_id': 'req-d0ac3d83-a2ff-48e5-b54a-3939639cf0dd'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:09.527320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0ac3d83-a2ff-48e5-b54a-3939639cf0dd admin admin] The token cache is being invalidate because project b401dd8f867d4ffb9d7bf477746ec1db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:09.527623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0ac3d83-a2ff-48e5-b54a-3939639cf0dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:09.530946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0ac3d83-a2ff-48e5-b54a-3939639cf0dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:09.540870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 831/1645] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:09 2022] DELETE /identity/v3/projects/b401dd8f867d4ffb9d7bf477746ec1db => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:09.554902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf1c59-2762-43f5-95ac-6f42d34d13b4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:09.555507 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf1c59-2762-43f5-95ac-6f42d34d13b4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:09.556023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf1c59-2762-43f5-95ac-6f42d34d13b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:09.622310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1cbf1c59-2762-43f5-95ac-6f42d34d13b4 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:09.624652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1cbf1c59-2762-43f5-95ac-6f42d34d13b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:09.716885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab508775-f485-4041-a5aa-8f12192cb29b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:09.798714 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:09.863317 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 832/1646] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:19:09.869330 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7dc95-21c6-4cff-bbd6-8d51344cacb0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:09.870181 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7dc95-21c6-4cff-bbd6-8d51344cacb0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:09.870504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7dc95-21c6-4cff-bbd6-8d51344cacb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:09.897799 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe7867-09f2-4f1d-a3cb-78f10a6ae0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:09.899737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe7867-09f2-4f1d-a3cb-78f10a6ae0fe service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:09.904509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe7867-09f2-4f1d-a3cb-78f10a6ae0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:09.907381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe7867-09f2-4f1d-a3cb-78f10a6ae0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:09.913863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-cafe7867-09f2-4f1d-a3cb-78f10a6ae0fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:09.939693 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f8a7dc95-21c6-4cff-bbd6-8d51344cacb0 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:09.943564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f8a7dc95-21c6-4cff-bbd6-8d51344cacb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:09.949957 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe7867-09f2-4f1d-a3cb-78f10a6ae0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:09.953551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe7867-09f2-4f1d-a3cb-78f10a6ae0fe service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:09.967824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 833/1647] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:09.968881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7dc95-21c6-4cff-bbd6-8d51344cacb0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:09.981290 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 815/1648] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:09.987362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7dc95-21c6-4cff-bbd6-8d51344cacb0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:09.992416 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a174dc8-95f2-4c64-bbaa-75439dd9b11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:09.993107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a174dc8-95f2-4c64-bbaa-75439dd9b11c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:09.993514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a174dc8-95f2-4c64-bbaa-75439dd9b11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:09.993798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a174dc8-95f2-4c64-bbaa-75439dd9b11c admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:09.994651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a174dc8-95f2-4c64-bbaa-75439dd9b11c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:19:09.995011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a174dc8-95f2-4c64-bbaa-75439dd9b11c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:09.996913 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a174dc8-95f2-4c64-bbaa-75439dd9b11c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:10.029891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 834/1649] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:19:10.035677 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe7867-09f2-4f1d-a3cb-78f10a6ae0fe service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:10.051368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe7867-09f2-4f1d-a3cb-78f10a6ae0fe service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:10.059111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae85d6-9d3e-4a08-8ed0-e0cc501fdb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:10.059802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae85d6-9d3e-4a08-8ed0-e0cc501fdb46 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:10.060087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae85d6-9d3e-4a08-8ed0-e0cc501fdb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:10.062762 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae85d6-9d3e-4a08-8ed0-e0cc501fdb46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:10.063810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae85d6-9d3e-4a08-8ed0-e0cc501fdb46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:10.066322 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae85d6-9d3e-4a08-8ed0-e0cc501fdb46 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:10.139393 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a174dc8-95f2-4c64-bbaa-75439dd9b11c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:10.140121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 816/1650] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:10 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:10.150389 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a174dc8-95f2-4c64-bbaa-75439dd9b11c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:10.295193 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43d8eb-e7d4-4927-bfda-3a11deb11b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:10.322991 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43d8eb-e7d4-4927-bfda-3a11deb11b05 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:10.324272 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43d8eb-e7d4-4927-bfda-3a11deb11b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:10.325193 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43d8eb-e7d4-4927-bfda-3a11deb11b05 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:10.327204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43d8eb-e7d4-4927-bfda-3a11deb11b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:10.334789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43d8eb-e7d4-4927-bfda-3a11deb11b05 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:10.401057 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae85d6-9d3e-4a08-8ed0-e0cc501fdb46 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:10.401523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 835/1651] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:10 2022] POST /identity/v3/users => generated 286 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:19:10.414322 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae85d6-9d3e-4a08-8ed0-e0cc501fdb46 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:10.422614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad0d14-c7e5-4ccc-9a20-bade34d1d5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:10.424472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad0d14-c7e5-4ccc-9a20-bade34d1d5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:10.431614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad0d14-c7e5-4ccc-9a20-bade34d1d5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:10.433321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad0d14-c7e5-4ccc-9a20-bade34d1d5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:10.434387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad0d14-c7e5-4ccc-9a20-bade34d1d5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:10.437296 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad0d14-c7e5-4ccc-9a20-bade34d1d5c5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:10.460400 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43d8eb-e7d4-4927-bfda-3a11deb11b05 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:10.476581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 817/1652] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:10.479651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43d8eb-e7d4-4927-bfda-3a11deb11b05 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:10.491120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bfd13-51ea-413c-a73b-937cd38c94ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:10.492354 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bfd13-51ea-413c-a73b-937cd38c94ba admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:10.497152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bfd13-51ea-413c-a73b-937cd38c94ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:10.497499 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bfd13-51ea-413c-a73b-937cd38c94ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:10.498932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bfd13-51ea-413c-a73b-937cd38c94ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:10.501817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bfd13-51ea-413c-a73b-937cd38c94ba admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:10.545308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad0d14-c7e5-4ccc-9a20-bade34d1d5c5 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:10.547024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 836/1653] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:10.564155 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad0d14-c7e5-4ccc-9a20-bade34d1d5c5 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:10.572337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf358774-8430-4039-83ea-a3af0dc24a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:10.573613 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf358774-8430-4039-83ea-a3af0dc24a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:10.573853 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf358774-8430-4039-83ea-a3af0dc24a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:10.574227 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf358774-8430-4039-83ea-a3af0dc24a92 admin admin] PATH_INFO: `/v3/projects/846f8f4bbab045fe8e5e9fda732893b4/users/5383e9aaa76942f6ab61cf11dec383d9/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:10.611095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf358774-8430-4039-83ea-a3af0dc24a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=846f8f4bbab045fe8e5e9fda732893b4, user_id=5383e9aaa76942f6ab61cf11dec383d9, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:10.614240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf358774-8430-4039-83ea-a3af0dc24a92 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:10.662391 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 818/1654] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:10 2022] PUT /identity/v3/projects/846f8f4bbab045fe8e5e9fda732893b4/users/5383e9aaa76942f6ab61cf11dec383d9/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:10.687848 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18506bc-00c5-46f2-9cb3-0c8a0eed13ec None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:10.688387 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18506bc-00c5-46f2-9cb3-0c8a0eed13ec None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:10.688864 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18506bc-00c5-46f2-9cb3-0c8a0eed13ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:10.800288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c18506bc-00c5-46f2-9cb3-0c8a0eed13ec None None] MFA Rules not processed for user `5383e9aaa76942f6ab61cf11dec383d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:10.802751 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c18506bc-00c5-46f2-9cb3-0c8a0eed13ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:11.043453 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 837/1655] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:11.045395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf358774-8430-4039-83ea-a3af0dc24a92 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:11.153014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:11.233062 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf358774-8430-4039-83ea-a3af0dc24a92 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:11.240705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c33146-0145-4584-86af-7628c8df3704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:11.241591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c33146-0145-4584-86af-7628c8df3704 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:11.241980 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c33146-0145-4584-86af-7628c8df3704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:11.242458 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c33146-0145-4584-86af-7628c8df3704 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:11.243389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c33146-0145-4584-86af-7628c8df3704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:11.246418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c33146-0145-4584-86af-7628c8df3704 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:11.323963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 819/1656] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:11 2022] POST /identity/v3/projects => generated 373 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:11.329316 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18506bc-00c5-46f2-9cb3-0c8a0eed13ec None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:11.347215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18506bc-00c5-46f2-9cb3-0c8a0eed13ec None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:11.437901 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:11.490125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91523904-66ee-45a3-9904-a6ed96f1f865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:11.491730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91523904-66ee-45a3-9904-a6ed96f1f865 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:11.492162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91523904-66ee-45a3-9904-a6ed96f1f865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:11.493166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91523904-66ee-45a3-9904-a6ed96f1f865 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:11.493356 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91523904-66ee-45a3-9904-a6ed96f1f865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:11.496243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91523904-66ee-45a3-9904-a6ed96f1f865 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:11.540374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 838/1657] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:11 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:11.540686 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c33146-0145-4584-86af-7628c8df3704 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:11.559246 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c33146-0145-4584-86af-7628c8df3704 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:11.578105 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dea34b-390e-4ed4-8456-779b94d6ce23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:11.580051 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dea34b-390e-4ed4-8456-779b94d6ce23 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:11.580380 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dea34b-390e-4ed4-8456-779b94d6ce23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:11.581201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dea34b-390e-4ed4-8456-779b94d6ce23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:11.581465 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dea34b-390e-4ed4-8456-779b94d6ce23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:11.583216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dea34b-390e-4ed4-8456-779b94d6ce23 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:11.615884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 820/1658] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:19:11.621269 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91523904-66ee-45a3-9904-a6ed96f1f865 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:11.636798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91523904-66ee-45a3-9904-a6ed96f1f865 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:11.651096 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaebe85-8e29-4c42-af2e-b65f7b31188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:11.652664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaebe85-8e29-4c42-af2e-b65f7b31188d admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:11.653516 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaebe85-8e29-4c42-af2e-b65f7b31188d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:11.654362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaebe85-8e29-4c42-af2e-b65f7b31188d admin admin] PATH_INFO: `/v3/projects/111d2d9b4d2044bd8b4e51e47ae24b61/users/13654835e6224206a32dde199792f23a/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:11.688706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaebe85-8e29-4c42-af2e-b65f7b31188d admin admin] RBAC: Authorizing `identity:create_grant(project_id=111d2d9b4d2044bd8b4e51e47ae24b61, user_id=13654835e6224206a32dde199792f23a, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:11.692728 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaebe85-8e29-4c42-af2e-b65f7b31188d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:11.713410 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 839/1659] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:11 2022] PUT /identity/v3/projects/111d2d9b4d2044bd8b4e51e47ae24b61/users/13654835e6224206a32dde199792f23a/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:11.717273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dea34b-390e-4ed4-8456-779b94d6ce23 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:11.734075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dea34b-390e-4ed4-8456-779b94d6ce23 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:11.876017 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe384a-ce62-47d4-b145-ea45bf1d26c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:11.877306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe384a-ce62-47d4-b145-ea45bf1d26c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:11.879093 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe384a-ce62-47d4-b145-ea45bf1d26c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:11.879093 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe384a-ce62-47d4-b145-ea45bf1d26c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:11.879529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe384a-ce62-47d4-b145-ea45bf1d26c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:11.883270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe384a-ce62-47d4-b145-ea45bf1d26c0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:11.960462 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 821/1660] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:19:11.965284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaebe85-8e29-4c42-af2e-b65f7b31188d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:12.031124 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaebe85-8e29-4c42-af2e-b65f7b31188d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:12.040489 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787b351-6040-47a4-b8ae-89f3c7c2ecdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:12.041528 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787b351-6040-47a4-b8ae-89f3c7c2ecdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:12.042405 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787b351-6040-47a4-b8ae-89f3c7c2ecdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:12.042910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787b351-6040-47a4-b8ae-89f3c7c2ecdc admin admin] PATH_INFO: `/v3/projects/111d2d9b4d2044bd8b4e51e47ae24b61/users/13654835e6224206a32dde199792f23a/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:12.045558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787b351-6040-47a4-b8ae-89f3c7c2ecdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=111d2d9b4d2044bd8b4e51e47ae24b61, user_id=13654835e6224206a32dde199792f23a, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:12.048678 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787b351-6040-47a4-b8ae-89f3c7c2ecdc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:12.072302 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 840/1661] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:11 2022] PUT /identity/v3/projects/111d2d9b4d2044bd8b4e51e47ae24b61/users/13654835e6224206a32dde199792f23a/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:12.080936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db36f4-ae7c-4e9f-9139-101494bab123 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:12.081436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db36f4-ae7c-4e9f-9139-101494bab123 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:12.081526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db36f4-ae7c-4e9f-9139-101494bab123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:12.142170 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a6db36f4-ae7c-4e9f-9139-101494bab123 None None] MFA Rules not processed for user `13654835e6224206a32dde199792f23a`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:12.146012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a6db36f4-ae7c-4e9f-9139-101494bab123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:12.392011 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 822/1662] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:12.410642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787b351-6040-47a4-b8ae-89f3c7c2ecdc admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:12.411251 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db36f4-ae7c-4e9f-9139-101494bab123 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:12.413258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a6db36f4-ae7c-4e9f-9139-101494bab123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:12.413916 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0787b351-6040-47a4-b8ae-89f3c7c2ecdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:12.522520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:12.611426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787b351-6040-47a4-b8ae-89f3c7c2ecdc admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:12.623542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f45926-a139-463d-b126-91e004a63280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:12.624218 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f45926-a139-463d-b126-91e004a63280 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:12.626801 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f45926-a139-463d-b126-91e004a63280 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:12.627933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f45926-a139-463d-b126-91e004a63280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:12.640722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db36f4-ae7c-4e9f-9139-101494bab123 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:12.658023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d28270-6347-484c-b87d-b6e8e826f6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:12.659648 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d28270-6347-484c-b87d-b6e8e826f6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:12.659648 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d28270-6347-484c-b87d-b6e8e826f6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:12.659902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d28270-6347-484c-b87d-b6e8e826f6fe admin admin] PATH_INFO: `/v3/projects/4b5c45e1d78648b08905776ef1da7751` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:12.662044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d28270-6347-484c-b87d-b6e8e826f6fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5c45e1d78648b08905776ef1da7751)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:12.663487 dv-cinder-836973-15-smb devstack@keystone.service[80366]: WARNING py.warnings [None req-00d28270-6347-484c-b87d-b6e8e826f6fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:19:12.663487 dv-cinder-836973-15-smb devstack@keystone.service[80366]: warnings.warn(msg) Jul 25 16:19:12.663487 dv-cinder-836973-15-smb devstack@keystone.service[80366]: Jul 25 16:19:12.665880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d28270-6347-484c-b87d-b6e8e826f6fe admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:12.669659 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f45926-a139-463d-b126-91e004a63280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:12.675687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f45926-a139-463d-b126-91e004a63280 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:12.708394 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 841/1663] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:12.802462 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-00d28270-6347-484c-b87d-b6e8e826f6fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5c45e1d78648b08905776ef1da7751', 'request_id': 'req-00d28270-6347-484c-b87d-b6e8e826f6fe'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:12.814439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-00d28270-6347-484c-b87d-b6e8e826f6fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5c45e1d78648b08905776ef1da7751', 'request_id': 'req-00d28270-6347-484c-b87d-b6e8e826f6fe'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:12.845225 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-00d28270-6347-484c-b87d-b6e8e826f6fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5c45e1d78648b08905776ef1da7751', 'request_id': 'req-00d28270-6347-484c-b87d-b6e8e826f6fe'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:12.895071 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-00d28270-6347-484c-b87d-b6e8e826f6fe admin admin] The token cache is being invalidate because project 4b5c45e1d78648b08905776ef1da7751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:12.895474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-00d28270-6347-484c-b87d-b6e8e826f6fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:12.896633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-00d28270-6347-484c-b87d-b6e8e826f6fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:12.899419 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f45926-a139-463d-b126-91e004a63280 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:12.909705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f45926-a139-463d-b126-91e004a63280 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:12.919190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 823/1664] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:12 2022] DELETE /identity/v3/projects/4b5c45e1d78648b08905776ef1da7751 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:12.921305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a2d63-73c0-4b14-9fbe-566fc96b8483 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:12.922113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a2d63-73c0-4b14-9fbe-566fc96b8483 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:12.922867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a2d63-73c0-4b14-9fbe-566fc96b8483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:12.999454 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-822a2d63-73c0-4b14-9fbe-566fc96b8483 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:13.006627 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-822a2d63-73c0-4b14-9fbe-566fc96b8483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:13.089346 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d330c5f-a4de-41d3-826b-b03b85eea71c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:13.090175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d330c5f-a4de-41d3-826b-b03b85eea71c service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:13.090570 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d330c5f-a4de-41d3-826b-b03b85eea71c service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:13.091226 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d330c5f-a4de-41d3-826b-b03b85eea71c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:13.098901 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1d330c5f-a4de-41d3-826b-b03b85eea71c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:13.213619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 824/1665] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:13.213619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a2d63-73c0-4b14-9fbe-566fc96b8483 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:13.217105 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-822a2d63-73c0-4b14-9fbe-566fc96b8483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:13.254467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a2d63-73c0-4b14-9fbe-566fc96b8483 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:13.256392 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:13.271592 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab7433-e887-4907-9b3e-35da1a845116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:13.274070 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab7433-e887-4907-9b3e-35da1a845116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:13.276160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab7433-e887-4907-9b3e-35da1a845116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:13.276689 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab7433-e887-4907-9b3e-35da1a845116 admin admin] PATH_INFO: `/v3/users/c83577cd4ffe47bd9494f933df505058` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:13.279114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab7433-e887-4907-9b3e-35da1a845116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83577cd4ffe47bd9494f933df505058)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:13.286312 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab7433-e887-4907-9b3e-35da1a845116 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:13.290604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d330c5f-a4de-41d3-826b-b03b85eea71c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:13.295573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d330c5f-a4de-41d3-826b-b03b85eea71c service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:13.319755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 842/1666] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:19:13.326160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931064da-e146-41e9-86fd-da761d6bc5f3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:13.327187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931064da-e146-41e9-86fd-da761d6bc5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:13.328120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931064da-e146-41e9-86fd-da761d6bc5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:13.400002 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-931064da-e146-41e9-86fd-da761d6bc5f3 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:13.403730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-931064da-e146-41e9-86fd-da761d6bc5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:13.426650 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-87ab7433-e887-4907-9b3e-35da1a845116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83577cd4ffe47bd9494f933df505058'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:13.435367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 843/1667] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:13.438307 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931064da-e146-41e9-86fd-da761d6bc5f3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:13.452353 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-87ab7433-e887-4907-9b3e-35da1a845116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83577cd4ffe47bd9494f933df505058'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:13.453099 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-87ab7433-e887-4907-9b3e-35da1a845116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83577cd4ffe47bd9494f933df505058'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:13.453784 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-87ab7433-e887-4907-9b3e-35da1a845116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83577cd4ffe47bd9494f933df505058'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:13.455802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:13.473416 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931064da-e146-41e9-86fd-da761d6bc5f3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:13.486363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a68fdd-9edc-4f07-a352-1adc2a313d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:13.487896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a68fdd-9edc-4f07-a352-1adc2a313d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:13.488504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a68fdd-9edc-4f07-a352-1adc2a313d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:13.489118 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a68fdd-9edc-4f07-a352-1adc2a313d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:13.491449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a68fdd-9edc-4f07-a352-1adc2a313d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:19:13.492965 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a68fdd-9edc-4f07-a352-1adc2a313d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:13.498215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a68fdd-9edc-4f07-a352-1adc2a313d2c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:13.502311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-87ab7433-e887-4907-9b3e-35da1a845116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83577cd4ffe47bd9494f933df505058'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:13.534065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 844/1668] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:19:13.538275 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a68fdd-9edc-4f07-a352-1adc2a313d2c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:13.542209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c1a68fdd-9edc-4f07-a352-1adc2a313d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:13.546994 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 825/1669] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:13 2022] DELETE /identity/v3/users/c83577cd4ffe47bd9494f933df505058 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:13.548884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8a3ff-e3c2-4080-80f5-dd5e58f0e387 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:13.549335 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8a3ff-e3c2-4080-80f5-dd5e58f0e387 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:13.549962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8a3ff-e3c2-4080-80f5-dd5e58f0e387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:13.576186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a68fdd-9edc-4f07-a352-1adc2a313d2c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:13.602552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ebb8a3ff-e3c2-4080-80f5-dd5e58f0e387 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:13.604858 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ebb8a3ff-e3c2-4080-80f5-dd5e58f0e387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:13.730859 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c52e-f16b-4d12-9c5c-a63832782a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:13.732132 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c52e-f16b-4d12-9c5c-a63832782a60 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:13.733117 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c52e-f16b-4d12-9c5c-a63832782a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:13.734544 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c52e-f16b-4d12-9c5c-a63832782a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:13.735580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5c52e-f16b-4d12-9c5c-a63832782a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:13.739669 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5c52e-f16b-4d12-9c5c-a63832782a60 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:13.765128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 826/1670] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:13.768171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8a3ff-e3c2-4080-80f5-dd5e58f0e387 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:13.772685 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ebb8a3ff-e3c2-4080-80f5-dd5e58f0e387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:13.795612 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8a3ff-e3c2-4080-80f5-dd5e58f0e387 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:13.802162 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89812d72-0c73-467b-9e8c-053e9a44ecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:13.804401 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89812d72-0c73-467b-9e8c-053e9a44ecf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:13.804881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89812d72-0c73-467b-9e8c-053e9a44ecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:13.805350 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89812d72-0c73-467b-9e8c-053e9a44ecf9 admin admin] PATH_INFO: `/v3/users/60ce8a3ca41441848a78a867575ac7de` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:13.806904 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89812d72-0c73-467b-9e8c-053e9a44ecf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60ce8a3ca41441848a78a867575ac7de)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:13.809263 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89812d72-0c73-467b-9e8c-053e9a44ecf9 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:13.817258 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 845/1671] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:13 2022] POST /identity/v3/projects => generated 363 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:13.818172 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c52e-f16b-4d12-9c5c-a63832782a60 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:13.882555 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-89812d72-0c73-467b-9e8c-053e9a44ecf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60ce8a3ca41441848a78a867575ac7de'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:13.899707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-89812d72-0c73-467b-9e8c-053e9a44ecf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60ce8a3ca41441848a78a867575ac7de'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:13.900780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-89812d72-0c73-467b-9e8c-053e9a44ecf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60ce8a3ca41441848a78a867575ac7de'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:13.902340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-89812d72-0c73-467b-9e8c-053e9a44ecf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60ce8a3ca41441848a78a867575ac7de'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:13.930507 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-89812d72-0c73-467b-9e8c-053e9a44ecf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60ce8a3ca41441848a78a867575ac7de'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:13.948896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 827/1672] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:13 2022] DELETE /identity/v3/users/60ce8a3ca41441848a78a867575ac7de => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:13.950019 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89812d72-0c73-467b-9e8c-053e9a44ecf9 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:13.952968 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-89812d72-0c73-467b-9e8c-053e9a44ecf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:13.963951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c52e-f16b-4d12-9c5c-a63832782a60 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:14.019163 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:14.040597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89812d72-0c73-467b-9e8c-053e9a44ecf9 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:14.053876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c239e0-8282-4cb4-9eda-c067bfff666d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:14.054576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c239e0-8282-4cb4-9eda-c067bfff666d service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:14.054867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c239e0-8282-4cb4-9eda-c067bfff666d service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:14.055157 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c239e0-8282-4cb4-9eda-c067bfff666d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:14.057245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-05c239e0-8282-4cb4-9eda-c067bfff666d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:14.097128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06770d46-a11b-40c0-87c2-b6c55e98dd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:14.097998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06770d46-a11b-40c0-87c2-b6c55e98dd8b admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:14.098384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06770d46-a11b-40c0-87c2-b6c55e98dd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:14.098789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06770d46-a11b-40c0-87c2-b6c55e98dd8b admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:14.099606 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06770d46-a11b-40c0-87c2-b6c55e98dd8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:14.101714 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06770d46-a11b-40c0-87c2-b6c55e98dd8b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:14.127460 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:14.145204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 846/1673] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:13 2022] POST /identity/v3/users => generated 282 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:14.146989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f49818-9d72-4446-8b15-d61027c1ce0f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:14.148209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f49818-9d72-4446-8b15-d61027c1ce0f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:14.149030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f49818-9d72-4446-8b15-d61027c1ce0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:14.154704 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c239e0-8282-4cb4-9eda-c067bfff666d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:14.158576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c239e0-8282-4cb4-9eda-c067bfff666d service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:14.172031 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 828/1674] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:14.172924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c239e0-8282-4cb4-9eda-c067bfff666d service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:14.174965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-05c239e0-8282-4cb4-9eda-c067bfff666d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:14.190713 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e0f49818-9d72-4446-8b15-d61027c1ce0f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:14.193592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e0f49818-9d72-4446-8b15-d61027c1ce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:14.203454 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c239e0-8282-4cb4-9eda-c067bfff666d service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:14.211409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846539e-d446-40f3-aeed-5c27466bbf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:14.212684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846539e-d446-40f3-aeed-5c27466bbf75 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:14.212684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846539e-d446-40f3-aeed-5c27466bbf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:14.212952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846539e-d446-40f3-aeed-5c27466bbf75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:14.214339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846539e-d446-40f3-aeed-5c27466bbf75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:14.215371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 847/1675] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:14.216578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846539e-d446-40f3-aeed-5c27466bbf75 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:14.232591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 829/1676] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:14.236131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f49818-9d72-4446-8b15-d61027c1ce0f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:14.247209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f49818-9d72-4446-8b15-d61027c1ce0f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:14.266239 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e69be-8176-4cdd-a584-c452e49ee4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:14.266239 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e69be-8176-4cdd-a584-c452e49ee4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:14.266787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e69be-8176-4cdd-a584-c452e49ee4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:14.267175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e69be-8176-4cdd-a584-c452e49ee4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:14.268029 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e69be-8176-4cdd-a584-c452e49ee4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:14.269821 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e69be-8176-4cdd-a584-c452e49ee4f6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:14.292742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846539e-d446-40f3-aeed-5c27466bbf75 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:14.294947 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b846539e-d446-40f3-aeed-5c27466bbf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:14.295656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 848/1677] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:19:14.300337 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e69be-8176-4cdd-a584-c452e49ee4f6 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:14.317918 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e69be-8176-4cdd-a584-c452e49ee4f6 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:14.318862 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846539e-d446-40f3-aeed-5c27466bbf75 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:14.331761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346b343-bff7-4f1e-881b-39e03b70d7c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:14.333590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346b343-bff7-4f1e-881b-39e03b70d7c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:14.335311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346b343-bff7-4f1e-881b-39e03b70d7c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:14.335630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346b343-bff7-4f1e-881b-39e03b70d7c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:14.336723 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a188296-59fd-4b38-aa4e-c05a4c202431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:14.337757 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a188296-59fd-4b38-aa4e-c05a4c202431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:14.339135 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a188296-59fd-4b38-aa4e-c05a4c202431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:14.339135 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a188296-59fd-4b38-aa4e-c05a4c202431 admin admin] PATH_INFO: `/v3/projects/4785cc8d70cb41cd8039a2843a286e82/users/13c5e9dc5cff47ef9fb2c6a5e5110260/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:14.355701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346b343-bff7-4f1e-881b-39e03b70d7c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:14.357764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346b343-bff7-4f1e-881b-39e03b70d7c0 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:14.369370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a188296-59fd-4b38-aa4e-c05a4c202431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4785cc8d70cb41cd8039a2843a286e82, user_id=13c5e9dc5cff47ef9fb2c6a5e5110260, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:14.372221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a188296-59fd-4b38-aa4e-c05a4c202431 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:14.376650 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 830/1678] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:19:14.397679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 849/1679] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:14 2022] PUT /identity/v3/projects/4785cc8d70cb41cd8039a2843a286e82/users/13c5e9dc5cff47ef9fb2c6a5e5110260/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:14.410708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef8afe-7ee1-4c5d-bb01-b7872eb0bf2f None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:14.410938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef8afe-7ee1-4c5d-bb01-b7872eb0bf2f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:14.411301 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef8afe-7ee1-4c5d-bb01-b7872eb0bf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:14.465078 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a6ef8afe-7ee1-4c5d-bb01-b7872eb0bf2f None None] MFA Rules not processed for user `13c5e9dc5cff47ef9fb2c6a5e5110260`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:14.466752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a6ef8afe-7ee1-4c5d-bb01-b7872eb0bf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:14.478734 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfca7b-1803-4f8c-9081-b142cc453587 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:14.479406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfca7b-1803-4f8c-9081-b142cc453587 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:14.479406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfca7b-1803-4f8c-9081-b142cc453587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:14.517966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-52dfca7b-1803-4f8c-9081-b142cc453587 None None] MFA Rules not processed for user `6fa2cda90dc54933a3fe22880bebb478`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:14.520425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-52dfca7b-1803-4f8c-9081-b142cc453587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:14.604450 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 831/1680] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:14 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:14.608223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef8afe-7ee1-4c5d-bb01-b7872eb0bf2f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:14.695337 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 850/1681] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:14.703957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfca7b-1803-4f8c-9081-b142cc453587 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:14.707529 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-52dfca7b-1803-4f8c-9081-b142cc453587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:14.827728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef8afe-7ee1-4c5d-bb01-b7872eb0bf2f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:14.865406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2974b-c820-43d5-bcc0-479c30a1039a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:14.866092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2974b-c820-43d5-bcc0-479c30a1039a admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:14.866379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2974b-c820-43d5-bcc0-479c30a1039a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:14.866653 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2974b-c820-43d5-bcc0-479c30a1039a admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:14.867348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2974b-c820-43d5-bcc0-479c30a1039a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:14.869442 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2974b-c820-43d5-bcc0-479c30a1039a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:14.875755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:14.904081 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfca7b-1803-4f8c-9081-b142cc453587 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:14.916036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d23d8-ef9d-4a75-b010-71f3667bdf82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:14.918868 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d23d8-ef9d-4a75-b010-71f3667bdf82 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:14.920494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d23d8-ef9d-4a75-b010-71f3667bdf82 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:14.921004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d23d8-ef9d-4a75-b010-71f3667bdf82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:14.935085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d23d8-ef9d-4a75-b010-71f3667bdf82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:14.937653 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 832/1682] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:14 2022] POST /identity/v3/projects => generated 365 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:14.938269 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d23d8-ef9d-4a75-b010-71f3667bdf82 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:14.939684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2974b-c820-43d5-bcc0-479c30a1039a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:14.975211 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 851/1683] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:15.011058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76818c7-d455-419e-884b-cab4d788e120 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:15.011816 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76818c7-d455-419e-884b-cab4d788e120 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:15.012338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76818c7-d455-419e-884b-cab4d788e120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:15.120302 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2974b-c820-43d5-bcc0-479c30a1039a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:15.127256 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d76818c7-d455-419e-884b-cab4d788e120 None None] MFA Rules not processed for user `471739ee64504a6fa88d5d52eb0c1df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:15.135987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d76818c7-d455-419e-884b-cab4d788e120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:15.140990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3147ba2-3e1a-4b10-beba-dd2e2ba2d558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:15.145916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3147ba2-3e1a-4b10-beba-dd2e2ba2d558 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:15.146239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3147ba2-3e1a-4b10-beba-dd2e2ba2d558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:15.150502 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3147ba2-3e1a-4b10-beba-dd2e2ba2d558 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:15.153968 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3147ba2-3e1a-4b10-beba-dd2e2ba2d558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:15.165089 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3147ba2-3e1a-4b10-beba-dd2e2ba2d558 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:15.206786 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:15.247218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 833/1684] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:14 2022] POST /identity/v3/users => generated 289 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:15.254102 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3147ba2-3e1a-4b10-beba-dd2e2ba2d558 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:15.304331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3147ba2-3e1a-4b10-beba-dd2e2ba2d558 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:15.317732 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073c622-d8fc-41ff-9bd3-d6313974f04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:15.318674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073c622-d8fc-41ff-9bd3-d6313974f04b admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:15.318902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073c622-d8fc-41ff-9bd3-d6313974f04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:15.319150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073c622-d8fc-41ff-9bd3-d6313974f04b admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:15.320048 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073c622-d8fc-41ff-9bd3-d6313974f04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:15.321752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073c622-d8fc-41ff-9bd3-d6313974f04b admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:15.346447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 852/1685] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:19:15.357704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b4d34-581f-47a5-8136-647374826b6b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:15.357987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b4d34-581f-47a5-8136-647374826b6b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:15.358340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b4d34-581f-47a5-8136-647374826b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:15.370883 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 834/1686] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:15.371858 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073c622-d8fc-41ff-9bd3-d6313974f04b admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:15.401436 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-514b4d34-581f-47a5-8136-647374826b6b None None] MFA Rules not processed for user `471739ee64504a6fa88d5d52eb0c1df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:15.402913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073c622-d8fc-41ff-9bd3-d6313974f04b admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:15.404567 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-514b4d34-581f-47a5-8136-647374826b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:15.425909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 853/1687] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:15.437597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecf589-0eb5-4435-9756-ce5c849e0a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:15.438639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecf589-0eb5-4435-9756-ce5c849e0a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:15.438925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecf589-0eb5-4435-9756-ce5c849e0a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:15.439202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecf589-0eb5-4435-9756-ce5c849e0a21 admin admin] PATH_INFO: `/v3/projects/3fabf7170ba247d29dc40fe99b4aed71/users/8e3d233af2c94546b1005aa679a1bfd3/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:15.451712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b4d34-581f-47a5-8136-647374826b6b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:15.459900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-514b4d34-581f-47a5-8136-647374826b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:15.503228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecf589-0eb5-4435-9756-ce5c849e0a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fabf7170ba247d29dc40fe99b4aed71, user_id=8e3d233af2c94546b1005aa679a1bfd3, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:15.505970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecf589-0eb5-4435-9756-ce5c849e0a21 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:15.551567 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 835/1688] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:15 2022] PUT /identity/v3/projects/3fabf7170ba247d29dc40fe99b4aed71/users/8e3d233af2c94546b1005aa679a1bfd3/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:15.557562 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecf589-0eb5-4435-9756-ce5c849e0a21 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:15.658508 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b4d34-581f-47a5-8136-647374826b6b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:15.753808 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecf589-0eb5-4435-9756-ce5c849e0a21 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:15.784372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0459c-08c8-4d97-a3c4-b83e429f588d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:15.785080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0459c-08c8-4d97-a3c4-b83e429f588d admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:15.786040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0459c-08c8-4d97-a3c4-b83e429f588d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:15.786290 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0459c-08c8-4d97-a3c4-b83e429f588d admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:15.787199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0459c-08c8-4d97-a3c4-b83e429f588d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:15.793805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0459c-08c8-4d97-a3c4-b83e429f588d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:15.817742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 836/1689] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:15.822168 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0459c-08c8-4d97-a3c4-b83e429f588d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:15.823865 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0dc32-f9a3-4aea-8d51-b58396410332 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:15.824740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0dc32-f9a3-4aea-8d51-b58396410332 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:15.825128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0dc32-f9a3-4aea-8d51-b58396410332 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:15.825504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0dc32-f9a3-4aea-8d51-b58396410332 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:15.836426 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0459c-08c8-4d97-a3c4-b83e429f588d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:15.844547 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262224d-cf7b-4437-b64e-06bdbe67c1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:15.864611 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262224d-cf7b-4437-b64e-06bdbe67c1b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:15.864975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262224d-cf7b-4437-b64e-06bdbe67c1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:15.865263 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262224d-cf7b-4437-b64e-06bdbe67c1b0 admin admin] PATH_INFO: `/v3/projects/3fabf7170ba247d29dc40fe99b4aed71/users/8e3d233af2c94546b1005aa679a1bfd3/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:15.868346 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262224d-cf7b-4437-b64e-06bdbe67c1b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fabf7170ba247d29dc40fe99b4aed71, user_id=8e3d233af2c94546b1005aa679a1bfd3, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:15.871809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262224d-cf7b-4437-b64e-06bdbe67c1b0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:15.894861 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 837/1690] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:15 2022] PUT /identity/v3/projects/3fabf7170ba247d29dc40fe99b4aed71/users/8e3d233af2c94546b1005aa679a1bfd3/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:15.897439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a867b49-43c6-41c3-8a09-baef4cf634eb None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:15.897607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a867b49-43c6-41c3-8a09-baef4cf634eb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:15.897886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a867b49-43c6-41c3-8a09-baef4cf634eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:15.920481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-9a867b49-43c6-41c3-8a09-baef4cf634eb None None] MFA Rules not processed for user `13ea16d9dcaa4c00b26e166b9a639077`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:15.921730 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9a867b49-43c6-41c3-8a09-baef4cf634eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:15.937974 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:15.943273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:15.974888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0dc32-f9a3-4aea-8d51-b58396410332 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:15.976590 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0dc32-f9a3-4aea-8d51-b58396410332 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:16.004137 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 854/1691] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:16.011175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be1d28-8d83-438c-b25c-10eed603b623 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:16.011519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be1d28-8d83-438c-b25c-10eed603b623 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:16.013668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be1d28-8d83-438c-b25c-10eed603b623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:16.083322 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 838/1692] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:16.084899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a867b49-43c6-41c3-8a09-baef4cf634eb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:16.091948 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9a867b49-43c6-41c3-8a09-baef4cf634eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:16.159931 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-98be1d28-8d83-438c-b25c-10eed603b623 None None] MFA Rules not processed for user `8e3d233af2c94546b1005aa679a1bfd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:16.164514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-98be1d28-8d83-438c-b25c-10eed603b623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:16.335009 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a867b49-43c6-41c3-8a09-baef4cf634eb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:16.361083 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232797e-2891-4e05-b3b6-8a0d7f6d4006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:16.362157 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232797e-2891-4e05-b3b6-8a0d7f6d4006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:16.362448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232797e-2891-4e05-b3b6-8a0d7f6d4006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:16.364469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232797e-2891-4e05-b3b6-8a0d7f6d4006 admin admin] PATH_INFO: `/v3/projects/25962efe2d564149aed6d42794470a53` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:16.366298 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232797e-2891-4e05-b3b6-8a0d7f6d4006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25962efe2d564149aed6d42794470a53)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:16.373079 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232797e-2891-4e05-b3b6-8a0d7f6d4006 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:16.415763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 855/1693] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:16 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:16.430900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be1d28-8d83-438c-b25c-10eed603b623 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:16.432968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-98be1d28-8d83-438c-b25c-10eed603b623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:16.457182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8232797e-2891-4e05-b3b6-8a0d7f6d4006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25962efe2d564149aed6d42794470a53', 'request_id': 'req-8232797e-2891-4e05-b3b6-8a0d7f6d4006'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:16.469946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8232797e-2891-4e05-b3b6-8a0d7f6d4006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25962efe2d564149aed6d42794470a53', 'request_id': 'req-8232797e-2891-4e05-b3b6-8a0d7f6d4006'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:16.487225 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8232797e-2891-4e05-b3b6-8a0d7f6d4006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25962efe2d564149aed6d42794470a53', 'request_id': 'req-8232797e-2891-4e05-b3b6-8a0d7f6d4006'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:16.501535 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8232797e-2891-4e05-b3b6-8a0d7f6d4006 admin admin] The token cache is being invalidate because project 25962efe2d564149aed6d42794470a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:16.503327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8232797e-2891-4e05-b3b6-8a0d7f6d4006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:16.504150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8232797e-2891-4e05-b3b6-8a0d7f6d4006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:16.509551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 839/1694] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:16 2022] DELETE /identity/v3/projects/25962efe2d564149aed6d42794470a53 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:16.509551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232797e-2891-4e05-b3b6-8a0d7f6d4006 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:16.510964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8232797e-2891-4e05-b3b6-8a0d7f6d4006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:16.581005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be1d28-8d83-438c-b25c-10eed603b623 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:16.621113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:16.630817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232797e-2891-4e05-b3b6-8a0d7f6d4006 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:16.661056 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b89933-424a-4757-8df2-66fc0519c3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:16.662288 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b89933-424a-4757-8df2-66fc0519c3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:16.662647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b89933-424a-4757-8df2-66fc0519c3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:16.662994 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b89933-424a-4757-8df2-66fc0519c3f2 admin admin] PATH_INFO: `/v3/projects/f6194bc7246045febee397bea9c740e1` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:16.664768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b89933-424a-4757-8df2-66fc0519c3f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6194bc7246045febee397bea9c740e1)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:16.667578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b89933-424a-4757-8df2-66fc0519c3f2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:16.728411 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d3b89933-424a-4757-8df2-66fc0519c3f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6194bc7246045febee397bea9c740e1', 'request_id': 'req-d3b89933-424a-4757-8df2-66fc0519c3f2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:16.738684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d3b89933-424a-4757-8df2-66fc0519c3f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6194bc7246045febee397bea9c740e1', 'request_id': 'req-d3b89933-424a-4757-8df2-66fc0519c3f2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:16.745488 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9e904-e748-4370-bd8a-2f25adecad3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:16.746174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9e904-e748-4370-bd8a-2f25adecad3b service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:16.746459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9e904-e748-4370-bd8a-2f25adecad3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:16.746733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9e904-e748-4370-bd8a-2f25adecad3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:16.750091 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d3b89933-424a-4757-8df2-66fc0519c3f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6194bc7246045febee397bea9c740e1', 'request_id': 'req-d3b89933-424a-4757-8df2-66fc0519c3f2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:16.761193 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-16b9e904-e748-4370-bd8a-2f25adecad3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:16.765199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d3b89933-424a-4757-8df2-66fc0519c3f2 admin admin] The token cache is being invalidate because project f6194bc7246045febee397bea9c740e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:16.765674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d3b89933-424a-4757-8df2-66fc0519c3f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:16.766722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d3b89933-424a-4757-8df2-66fc0519c3f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:16.768709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 840/1695] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:16 2022] DELETE /identity/v3/projects/f6194bc7246045febee397bea9c740e1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:16.769915 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b89933-424a-4757-8df2-66fc0519c3f2 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:16.771836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d3b89933-424a-4757-8df2-66fc0519c3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:16.890950 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b89933-424a-4757-8df2-66fc0519c3f2 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:16.899724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bbaae-e5da-42d9-86c0-4a3ff854c0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:16.901513 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bbaae-e5da-42d9-86c0-4a3ff854c0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:16.903580 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bbaae-e5da-42d9-86c0-4a3ff854c0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:16.903580 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bbaae-e5da-42d9-86c0-4a3ff854c0e0 admin admin] PATH_INFO: `/v3/users/8ee98b4039e341a78569bd7924c17ebc` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:16.904657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bbaae-e5da-42d9-86c0-4a3ff854c0e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee98b4039e341a78569bd7924c17ebc)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:16.911176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bbaae-e5da-42d9-86c0-4a3ff854c0e0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:16.925080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:17.001140 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9e904-e748-4370-bd8a-2f25adecad3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:17.012157 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9e904-e748-4370-bd8a-2f25adecad3b service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:17.035475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-552bbaae-e5da-42d9-86c0-4a3ff854c0e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee98b4039e341a78569bd7924c17ebc'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:17.052964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 856/1696] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:16 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:19:17.054470 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4447af-60fd-4aff-9bf8-8dae06a0b2f7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:17.058749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4447af-60fd-4aff-9bf8-8dae06a0b2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:17.059924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4447af-60fd-4aff-9bf8-8dae06a0b2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:17.065511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-552bbaae-e5da-42d9-86c0-4a3ff854c0e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee98b4039e341a78569bd7924c17ebc'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:17.068632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-552bbaae-e5da-42d9-86c0-4a3ff854c0e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee98b4039e341a78569bd7924c17ebc'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:17.069613 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-552bbaae-e5da-42d9-86c0-4a3ff854c0e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee98b4039e341a78569bd7924c17ebc'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:17.137355 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-552bbaae-e5da-42d9-86c0-4a3ff854c0e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee98b4039e341a78569bd7924c17ebc'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:17.147874 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-cf4447af-60fd-4aff-9bf8-8dae06a0b2f7 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:17.149984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cf4447af-60fd-4aff-9bf8-8dae06a0b2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:17.163855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 857/1697] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:17.176689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f39aa3-f4cf-46d7-9e30-fff3a84f3174 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:17.176952 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f39aa3-f4cf-46d7-9e30-fff3a84f3174 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:17.177227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f39aa3-f4cf-46d7-9e30-fff3a84f3174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:17.193484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 841/1698] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:16 2022] DELETE /identity/v3/users/8ee98b4039e341a78569bd7924c17ebc => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:17.253820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bbaae-e5da-42d9-86c0-4a3ff854c0e0 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:17.256279 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-552bbaae-e5da-42d9-86c0-4a3ff854c0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:17.266426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b7f39aa3-f4cf-46d7-9e30-fff3a84f3174 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:17.267942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b7f39aa3-f4cf-46d7-9e30-fff3a84f3174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:17.270604 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:17.403178 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bbaae-e5da-42d9-86c0-4a3ff854c0e0 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:17.414796 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f74fb4-1e25-4fff-ac71-4c960b71048b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:17.415553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f74fb4-1e25-4fff-ac71-4c960b71048b service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:17.415846 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f74fb4-1e25-4fff-ac71-4c960b71048b service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:17.416125 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f74fb4-1e25-4fff-ac71-4c960b71048b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:17.419407 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b4f74fb4-1e25-4fff-ac71-4c960b71048b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:17.432445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 858/1699] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:17.432445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4887a4-7999-4375-8774-5d74e82fd1d1 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:17.432445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4887a4-7999-4375-8774-5d74e82fd1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:17.432445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4887a4-7999-4375-8774-5d74e82fd1d1 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:17.434191 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 859/1700] 10.222.0.70 () {54 vars in 912 bytes} [Mon Jul 25 16:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:19:17.434536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4887a4-7999-4375-8774-5d74e82fd1d1 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:17.460821 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4887a4-7999-4375-8774-5d74e82fd1d1 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:17.467799 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4487487-05dd-43d4-ad67-5111f1fe112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:17.468588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4487487-05dd-43d4-ad67-5111f1fe112b admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:17.469011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4487487-05dd-43d4-ad67-5111f1fe112b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:17.469334 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4487487-05dd-43d4-ad67-5111f1fe112b admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:17.470298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4487487-05dd-43d4-ad67-5111f1fe112b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:19:17.470699 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4487487-05dd-43d4-ad67-5111f1fe112b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:17.472428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4487487-05dd-43d4-ad67-5111f1fe112b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:17.488584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 860/1701] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:19:17.489996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d0c8a-9042-4274-9091-ff3ad2608d58 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:17.490293 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d0c8a-9042-4274-9091-ff3ad2608d58 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:17.490574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d0c8a-9042-4274-9091-ff3ad2608d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:17.576989 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f74fb4-1e25-4fff-ac71-4c960b71048b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:17.577992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2a5d0c8a-9042-4274-9091-ff3ad2608d58 None None] MFA Rules not processed for user `ad22a7d1e01c4c40b7cbefe971755148`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:17.578880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f74fb4-1e25-4fff-ac71-4c960b71048b service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:17.579247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2a5d0c8a-9042-4274-9091-ff3ad2608d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:17.591014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 842/1702] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:17 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:19:17.591860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f74fb4-1e25-4fff-ac71-4c960b71048b service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:17.611288 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f74fb4-1e25-4fff-ac71-4c960b71048b service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:17.620902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219466e-ebdc-424c-a48d-2204a8eec987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:17.621707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219466e-ebdc-424c-a48d-2204a8eec987 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:17.622116 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219466e-ebdc-424c-a48d-2204a8eec987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:17.622496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219466e-ebdc-424c-a48d-2204a8eec987 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:17.623294 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219466e-ebdc-424c-a48d-2204a8eec987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:17.625415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219466e-ebdc-424c-a48d-2204a8eec987 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:17.679831 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 843/1703] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:17 2022] POST /identity/v3/projects => generated 405 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:17.685430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219466e-ebdc-424c-a48d-2204a8eec987 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:17.792985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 861/1704] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 25 16:19:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:17.795851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d0c8a-9042-4274-9091-ff3ad2608d58 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:17.799889 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2a5d0c8a-9042-4274-9091-ff3ad2608d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:17.829758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d0c8a-9042-4274-9091-ff3ad2608d58 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:17.912592 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219466e-ebdc-424c-a48d-2204a8eec987 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:17.935146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07feb29-2967-4eab-9198-fbfc94e409d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:17.935931 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07feb29-2967-4eab-9198-fbfc94e409d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:17.936215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07feb29-2967-4eab-9198-fbfc94e409d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:17.936549 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07feb29-2967-4eab-9198-fbfc94e409d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:17.941839 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86333aa1-53e4-46f1-8edc-3a58469ff247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:17.944480 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86333aa1-53e4-46f1-8edc-3a58469ff247 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:17.945309 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86333aa1-53e4-46f1-8edc-3a58469ff247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:17.945710 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86333aa1-53e4-46f1-8edc-3a58469ff247 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:17.948404 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86333aa1-53e4-46f1-8edc-3a58469ff247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:17.954274 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86333aa1-53e4-46f1-8edc-3a58469ff247 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:17.956950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:17.962511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07feb29-2967-4eab-9198-fbfc94e409d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:17.964374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07feb29-2967-4eab-9198-fbfc94e409d6 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:18.009125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 862/1705] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:18.012833 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3be17-a3c5-4f84-bfb5-fe1ed8455787 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:18.014562 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3be17-a3c5-4f84-bfb5-fe1ed8455787 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:18.014967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3be17-a3c5-4f84-bfb5-fe1ed8455787 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:18.019364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 863/1706] 10.222.0.70 () {54 vars in 912 bytes} [Mon Jul 25 16:19:18 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:19:18.026288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dd7fa-a31e-47a1-abaa-c33337941538 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:18.036595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 844/1707] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:17 2022] POST /identity/v3/users => generated 303 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:18.039503 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dd7fa-a31e-47a1-abaa-c33337941538 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:18.040889 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86333aa1-53e4-46f1-8edc-3a58469ff247 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:18.049382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dd7fa-a31e-47a1-abaa-c33337941538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:18.066378 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86333aa1-53e4-46f1-8edc-3a58469ff247 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:18.087765 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e9e3b-b1ee-407c-8bd8-a98a9ba2f90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:18.090260 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e9e3b-b1ee-407c-8bd8-a98a9ba2f90d admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:18.091123 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e9e3b-b1ee-407c-8bd8-a98a9ba2f90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:18.092928 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e9e3b-b1ee-407c-8bd8-a98a9ba2f90d admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:18.097216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e9e3b-b1ee-407c-8bd8-a98a9ba2f90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:18.101518 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e9e3b-b1ee-407c-8bd8-a98a9ba2f90d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:18.121596 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0d6dd7fa-a31e-47a1-abaa-c33337941538 None None] MFA Rules not processed for user `ad22a7d1e01c4c40b7cbefe971755148`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:18.125286 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0d6dd7fa-a31e-47a1-abaa-c33337941538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:18.147871 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 845/1708] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:18.151078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 864/1709] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 25 16:19:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:18.151409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e9e3b-b1ee-407c-8bd8-a98a9ba2f90d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:18.177030 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e9e3b-b1ee-407c-8bd8-a98a9ba2f90d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:18.186393 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dd7fa-a31e-47a1-abaa-c33337941538 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:18.188936 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0d6dd7fa-a31e-47a1-abaa-c33337941538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:18.194353 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2e47e-02a7-4458-93ee-ed85d26f9a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:18.197157 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2e47e-02a7-4458-93ee-ed85d26f9a01 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:18.199436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2e47e-02a7-4458-93ee-ed85d26f9a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:18.200094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2e47e-02a7-4458-93ee-ed85d26f9a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:18.203249 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2e47e-02a7-4458-93ee-ed85d26f9a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:18.205208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dd7fa-a31e-47a1-abaa-c33337941538 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:18.208130 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2e47e-02a7-4458-93ee-ed85d26f9a01 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:18.216768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a7636-bf14-428b-bd54-f66d6e9b435a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:18.218669 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a7636-bf14-428b-bd54-f66d6e9b435a service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:18.218958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a7636-bf14-428b-bd54-f66d6e9b435a service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:18.220419 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a7636-bf14-428b-bd54-f66d6e9b435a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:18.232483 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 846/1710] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:18.247544 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2e47e-02a7-4458-93ee-ed85d26f9a01 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:18.253500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a7636-bf14-428b-bd54-f66d6e9b435a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:18.258150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a7636-bf14-428b-bd54-f66d6e9b435a service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:18.278385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2e47e-02a7-4458-93ee-ed85d26f9a01 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:18.281066 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 865/1711] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:18.296392 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec7b84-fb4e-40ee-80b1-21127da2f22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:18.297526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec7b84-fb4e-40ee-80b1-21127da2f22d admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:18.297949 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec7b84-fb4e-40ee-80b1-21127da2f22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:18.298522 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec7b84-fb4e-40ee-80b1-21127da2f22d admin admin] PATH_INFO: `/v3/projects/a4bd440dced94e5dabeb91cf7802c387/users/7c38facd8a074f9fb3b5a7d9552a5168/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:18.318666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:18.346611 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec7b84-fb4e-40ee-80b1-21127da2f22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4bd440dced94e5dabeb91cf7802c387, user_id=7c38facd8a074f9fb3b5a7d9552a5168, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:18.349350 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec7b84-fb4e-40ee-80b1-21127da2f22d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:18.378490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 847/1712] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:18 2022] PUT /identity/v3/projects/a4bd440dced94e5dabeb91cf7802c387/users/7c38facd8a074f9fb3b5a7d9552a5168/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:18.390371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5cc62-2303-4de2-9e09-e7c5dac82330 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:18.390666 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5cc62-2303-4de2-9e09-e7c5dac82330 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:18.390954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5cc62-2303-4de2-9e09-e7c5dac82330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:18.491147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4db5cc62-2303-4de2-9e09-e7c5dac82330 None None] MFA Rules not processed for user `7c38facd8a074f9fb3b5a7d9552a5168`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:18.492472 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4db5cc62-2303-4de2-9e09-e7c5dac82330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:18.674790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 866/1713] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:19:18.679067 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec7b84-fb4e-40ee-80b1-21127da2f22d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:18.891592 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec7b84-fb4e-40ee-80b1-21127da2f22d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:18.905679 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85236ba2-98e4-435a-958c-10ada2fb8b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:18.907278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85236ba2-98e4-435a-958c-10ada2fb8b2d admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:18.910151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85236ba2-98e4-435a-958c-10ada2fb8b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:18.910616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85236ba2-98e4-435a-958c-10ada2fb8b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:18.912809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85236ba2-98e4-435a-958c-10ada2fb8b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:18.918604 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85236ba2-98e4-435a-958c-10ada2fb8b2d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:19.006344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 848/1714] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:18 2022] POST /identity/v3/projects => generated 401 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:19.011549 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5cc62-2303-4de2-9e09-e7c5dac82330 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:19.027568 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5cc62-2303-4de2-9e09-e7c5dac82330 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:19.054669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032922d7-81e5-47af-a754-a74fb7a96257 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:19.055013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032922d7-81e5-47af-a754-a74fb7a96257 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:19.055237 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032922d7-81e5-47af-a754-a74fb7a96257 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:19.056883 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 849/1715] 10.222.0.70 () {54 vars in 961 bytes} [Mon Jul 25 16:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:19:19.072201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a2e34-67b7-4019-b77a-c38c4970116d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:19.072531 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a2e34-67b7-4019-b77a-c38c4970116d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:19.073477 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a2e34-67b7-4019-b77a-c38c4970116d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:19.116912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-214a2e34-67b7-4019-b77a-c38c4970116d None None] MFA Rules not processed for user `ba3474e40117440498f0fe99f743df50`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:19.121172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-214a2e34-67b7-4019-b77a-c38c4970116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:19.215805 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda921d-991e-49ce-8f39-b69c81449f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:19.216539 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda921d-991e-49ce-8f39-b69c81449f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:19.216821 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda921d-991e-49ce-8f39-b69c81449f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:19.217097 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda921d-991e-49ce-8f39-b69c81449f67 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:19.217802 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda921d-991e-49ce-8f39-b69c81449f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:19.221483 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda921d-991e-49ce-8f39-b69c81449f67 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:19.308188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 850/1716] 10.222.0.70 () {58 vars in 1058 bytes} [Mon Jul 25 16:19:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:19.321154 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a2e34-67b7-4019-b77a-c38c4970116d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:19.337244 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 867/1717] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:19 2022] POST /identity/v3/users => generated 307 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:19.338721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a2e34-67b7-4019-b77a-c38c4970116d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:19.341090 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda921d-991e-49ce-8f39-b69c81449f67 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:19.350711 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dfff4-79b0-40f4-b307-709c5d854a9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3474e40117440498f0fe99f743df50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:19.355324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dfff4-79b0-40f4-b307-709c5d854a9c service placement] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:19.356276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dfff4-79b0-40f4-b307-709c5d854a9c service placement] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:19.357121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dfff4-79b0-40f4-b307-709c5d854a9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:19.362813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-190dfff4-79b0-40f4-b307-709c5d854a9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:19.378215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda921d-991e-49ce-8f39-b69c81449f67 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:19.395369 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f72d27-bedc-4471-a346-94cce1ca2016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:19.395677 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f72d27-bedc-4471-a346-94cce1ca2016 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:19.395965 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f72d27-bedc-4471-a346-94cce1ca2016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:19.396414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f72d27-bedc-4471-a346-94cce1ca2016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:19.397154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f72d27-bedc-4471-a346-94cce1ca2016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:19.402449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f72d27-bedc-4471-a346-94cce1ca2016 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:19.402617 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dfff4-79b0-40f4-b307-709c5d854a9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:19.411131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dfff4-79b0-40f4-b307-709c5d854a9c service placement] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:19.423554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 868/1718] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:19.431824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f72d27-bedc-4471-a346-94cce1ca2016 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:19.438667 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-52f72d27-bedc-4471-a346-94cce1ca2016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:19.466860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f72d27-bedc-4471-a346-94cce1ca2016 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:19.468230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 851/1719] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:19.471731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dfff4-79b0-40f4-b307-709c5d854a9c service placement] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:19.496336 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52291527-a7d6-46f9-84c6-f769c72946cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:19.497263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52291527-a7d6-46f9-84c6-f769c72946cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:19.497547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52291527-a7d6-46f9-84c6-f769c72946cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:19.497833 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52291527-a7d6-46f9-84c6-f769c72946cd admin admin] PATH_INFO: `/v3/projects/bec5b844ca664f2cb082cdfd9af65c9c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:19.504327 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52291527-a7d6-46f9-84c6-f769c72946cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec5b844ca664f2cb082cdfd9af65c9c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:19.509511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dfff4-79b0-40f4-b307-709c5d854a9c service placement] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:19.512657 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52291527-a7d6-46f9-84c6-f769c72946cd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:19.521788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94fc3f-1a33-4619-8b29-12f7c252cd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:19.523439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94fc3f-1a33-4619-8b29-12f7c252cd5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:19.524482 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94fc3f-1a33-4619-8b29-12f7c252cd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:19.525331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94fc3f-1a33-4619-8b29-12f7c252cd5c admin admin] PATH_INFO: `/v3/projects/8e60b10edfba4abb8f8b6aeaff05d1ba/users/f88ef74448f748f3af4cf46e2ae2c603/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:19.552347 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94fc3f-1a33-4619-8b29-12f7c252cd5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e60b10edfba4abb8f8b6aeaff05d1ba, user_id=f88ef74448f748f3af4cf46e2ae2c603, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:19.558975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94fc3f-1a33-4619-8b29-12f7c252cd5c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:19.622688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 852/1720] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:19 2022] PUT /identity/v3/projects/8e60b10edfba4abb8f8b6aeaff05d1ba/users/f88ef74448f748f3af4cf46e2ae2c603/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:19.627598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94fc3f-1a33-4619-8b29-12f7c252cd5c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:19.657894 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:19.680740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-52291527-a7d6-46f9-84c6-f769c72946cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec5b844ca664f2cb082cdfd9af65c9c', 'request_id': 'req-52291527-a7d6-46f9-84c6-f769c72946cd'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:19.692352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-52291527-a7d6-46f9-84c6-f769c72946cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec5b844ca664f2cb082cdfd9af65c9c', 'request_id': 'req-52291527-a7d6-46f9-84c6-f769c72946cd'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:19.709929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-52291527-a7d6-46f9-84c6-f769c72946cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec5b844ca664f2cb082cdfd9af65c9c', 'request_id': 'req-52291527-a7d6-46f9-84c6-f769c72946cd'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:19.724000 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:19.749720 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-52291527-a7d6-46f9-84c6-f769c72946cd admin admin] The token cache is being invalidate because project bec5b844ca664f2cb082cdfd9af65c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:19.750018 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-52291527-a7d6-46f9-84c6-f769c72946cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:19.751923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-52291527-a7d6-46f9-84c6-f769c72946cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:19.754930 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 869/1721] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:19 2022] DELETE /identity/v3/projects/bec5b844ca664f2cb082cdfd9af65c9c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:19.760331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e38b66-729c-4e68-ace9-0065e72b5d3c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:19.760626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e38b66-729c-4e68-ace9-0065e72b5d3c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:19.760904 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e38b66-729c-4e68-ace9-0065e72b5d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:19.808510 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b7e38b66-729c-4e68-ace9-0065e72b5d3c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:19.809757 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b7e38b66-729c-4e68-ace9-0065e72b5d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:19.858742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94fc3f-1a33-4619-8b29-12f7c252cd5c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:19.989194 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 870/1722] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:19:20.010811 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197a84c-2aaa-42bf-8687-ddcf304aef14 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:20.013527 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197a84c-2aaa-42bf-8687-ddcf304aef14 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:20.016195 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197a84c-2aaa-42bf-8687-ddcf304aef14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:20.042617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d197a84c-2aaa-42bf-8687-ddcf304aef14 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:20.044040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d197a84c-2aaa-42bf-8687-ddcf304aef14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:20.044223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f295b-63aa-43a5-a769-c76521dc9a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:20.044979 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f295b-63aa-43a5-a769-c76521dc9a42 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:20.045217 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f295b-63aa-43a5-a769-c76521dc9a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:20.045494 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f295b-63aa-43a5-a769-c76521dc9a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:20.046221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f295b-63aa-43a5-a769-c76521dc9a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:20.047831 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f295b-63aa-43a5-a769-c76521dc9a42 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:20.076954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 871/1723] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:20.078506 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197a84c-2aaa-42bf-8687-ddcf304aef14 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:20.083639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 853/1724] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:19:20.088960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f295b-63aa-43a5-a769-c76521dc9a42 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:20.105697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8a4f295b-63aa-43a5-a769-c76521dc9a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:20.112086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197a84c-2aaa-42bf-8687-ddcf304aef14 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:20.132442 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642b68c-abc2-4928-9697-48201a7919c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:20.133674 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642b68c-abc2-4928-9697-48201a7919c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:20.133674 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642b68c-abc2-4928-9697-48201a7919c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:20.134074 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642b68c-abc2-4928-9697-48201a7919c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:20.135830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642b68c-abc2-4928-9697-48201a7919c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:19:20.139147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642b68c-abc2-4928-9697-48201a7919c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:20.145899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642b68c-abc2-4928-9697-48201a7919c3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:20.148944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f295b-63aa-43a5-a769-c76521dc9a42 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:20.175819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 872/1725] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:19:20.177462 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a57094-d4a0-4db2-90a1-adda89ba72d6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:20.177765 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a57094-d4a0-4db2-90a1-adda89ba72d6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:20.178042 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a57094-d4a0-4db2-90a1-adda89ba72d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:20.193238 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d75c11-431e-487a-91b1-48ef227682ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:20.194176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d75c11-431e-487a-91b1-48ef227682ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:20.200435 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d75c11-431e-487a-91b1-48ef227682ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:20.216865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d75c11-431e-487a-91b1-48ef227682ec admin admin] PATH_INFO: `/v3/projects/8e60b10edfba4abb8f8b6aeaff05d1ba/users/f88ef74448f748f3af4cf46e2ae2c603/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:20.231911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d75c11-431e-487a-91b1-48ef227682ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e60b10edfba4abb8f8b6aeaff05d1ba, user_id=f88ef74448f748f3af4cf46e2ae2c603, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:20.242618 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d75c11-431e-487a-91b1-48ef227682ec admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:20.244910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-52a57094-d4a0-4db2-90a1-adda89ba72d6 None None] MFA Rules not processed for user `471739ee64504a6fa88d5d52eb0c1df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:20.246321 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-52a57094-d4a0-4db2-90a1-adda89ba72d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:20.298524 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 854/1726] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:20 2022] PUT /identity/v3/projects/8e60b10edfba4abb8f8b6aeaff05d1ba/users/f88ef74448f748f3af4cf46e2ae2c603/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:20.300314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d75c11-431e-487a-91b1-48ef227682ec admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:20.376836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 873/1727] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:20.378649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3333aa-db19-49fe-8a7c-2f337578115a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:20.379012 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3333aa-db19-49fe-8a7c-2f337578115a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:20.379463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3333aa-db19-49fe-8a7c-2f337578115a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:20.413903 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ba3333aa-db19-49fe-8a7c-2f337578115a None None] MFA Rules not processed for user `f88ef74448f748f3af4cf46e2ae2c603`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:20.415281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ba3333aa-db19-49fe-8a7c-2f337578115a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:20.493690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:20.534654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d75c11-431e-487a-91b1-48ef227682ec admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:20.539708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8991e0-5c25-4b69-bbfd-62ef3d513313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:20.540444 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8991e0-5c25-4b69-bbfd-62ef3d513313 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:20.540786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8991e0-5c25-4b69-bbfd-62ef3d513313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:20.541004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8991e0-5c25-4b69-bbfd-62ef3d513313 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:20.541952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8991e0-5c25-4b69-bbfd-62ef3d513313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:20.544462 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8991e0-5c25-4b69-bbfd-62ef3d513313 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:20.555610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 874/1728] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:20.580773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3333aa-db19-49fe-8a7c-2f337578115a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:20.582737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ba3333aa-db19-49fe-8a7c-2f337578115a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:20.654456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 855/1729] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:20 2022] POST /identity/v3/projects => generated 369 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:20.657384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8991e0-5c25-4b69-bbfd-62ef3d513313 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:20.718247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3333aa-db19-49fe-8a7c-2f337578115a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:20.852457 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:20.886631 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c2d0b-784b-4cd4-8784-dfc25a732e0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:20.887341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c2d0b-784b-4cd4-8784-dfc25a732e0d service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:20.887613 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c2d0b-784b-4cd4-8784-dfc25a732e0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:20.887894 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c2d0b-784b-4cd4-8784-dfc25a732e0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:20.907743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8991e0-5c25-4b69-bbfd-62ef3d513313 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:20.922083 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af40007-2efd-4cec-a2ba-2e19868e821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:20.922793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af40007-2efd-4cec-a2ba-2e19868e821d admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:20.923081 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af40007-2efd-4cec-a2ba-2e19868e821d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:20.923368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af40007-2efd-4cec-a2ba-2e19868e821d admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:20.928154 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af40007-2efd-4cec-a2ba-2e19868e821d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:20.930364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af40007-2efd-4cec-a2ba-2e19868e821d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:21.023273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 856/1730] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:20 2022] POST /identity/v3/users => generated 285 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:21.028441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af40007-2efd-4cec-a2ba-2e19868e821d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:21.047576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c2d0b-784b-4cd4-8784-dfc25a732e0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:21.050220 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c2d0b-784b-4cd4-8784-dfc25a732e0d service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:21.091281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af40007-2efd-4cec-a2ba-2e19868e821d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:21.104999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 875/1731] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:20 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:19:21.117815 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcae41-68b8-4ece-a2e5-a894052e8e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:21.118753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcae41-68b8-4ece-a2e5-a894052e8e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:21.119349 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcae41-68b8-4ece-a2e5-a894052e8e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:21.120499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcae41-68b8-4ece-a2e5-a894052e8e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:21.121589 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcae41-68b8-4ece-a2e5-a894052e8e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:21.126417 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcae41-68b8-4ece-a2e5-a894052e8e49 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:21.158218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 857/1732] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:21.160288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c2d0b-784b-4cd4-8784-dfc25a732e0d service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:21.198396 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c2d0b-784b-4cd4-8784-dfc25a732e0d service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:21.251197 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602138d2-bbf3-4c8b-aefb-0b2fcead96b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:21.253289 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602138d2-bbf3-4c8b-aefb-0b2fcead96b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:21.254668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602138d2-bbf3-4c8b-aefb-0b2fcead96b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:21.256320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602138d2-bbf3-4c8b-aefb-0b2fcead96b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:21.258771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602138d2-bbf3-4c8b-aefb-0b2fcead96b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:21.263619 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602138d2-bbf3-4c8b-aefb-0b2fcead96b4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:21.300507 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 876/1733] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:21.307630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcae41-68b8-4ece-a2e5-a894052e8e49 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:21.326745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcae41-68b8-4ece-a2e5-a894052e8e49 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:21.337336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cc161-e73c-4360-b2ce-d8ae10dc022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:21.340008 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cc161-e73c-4360-b2ce-d8ae10dc022e admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:21.341185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cc161-e73c-4360-b2ce-d8ae10dc022e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:21.341763 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cc161-e73c-4360-b2ce-d8ae10dc022e admin admin] PATH_INFO: `/v3/projects/d3705d5193c04ce5b69a14141cf1317a/users/ac28ab3feff7497f90219ed182ff3a05/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:21.370268 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cc161-e73c-4360-b2ce-d8ae10dc022e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3705d5193c04ce5b69a14141cf1317a, user_id=ac28ab3feff7497f90219ed182ff3a05, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:21.373963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cc161-e73c-4360-b2ce-d8ae10dc022e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:21.401498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 858/1734] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:21 2022] PUT /identity/v3/projects/d3705d5193c04ce5b69a14141cf1317a/users/ac28ab3feff7497f90219ed182ff3a05/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:21.415496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e31c16-6163-4253-a2a2-6038f2f0e252 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:21.415887 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e31c16-6163-4253-a2a2-6038f2f0e252 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:21.416446 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e31c16-6163-4253-a2a2-6038f2f0e252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:21.489909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-91e31c16-6163-4253-a2a2-6038f2f0e252 None None] MFA Rules not processed for user `ac28ab3feff7497f90219ed182ff3a05`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:21.494656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-91e31c16-6163-4253-a2a2-6038f2f0e252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:21.545819 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6b2b2-84e3-40c1-98c2-06f183b10d29 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:21.546217 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6b2b2-84e3-40c1-98c2-06f183b10d29 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:21.546588 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6b2b2-84e3-40c1-98c2-06f183b10d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:21.573887 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:21.646737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-64c6b2b2-84e3-40c1-98c2-06f183b10d29 None None] MFA Rules not processed for user `139716cccc014f2398791641de0d414c`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:21.649744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-64c6b2b2-84e3-40c1-98c2-06f183b10d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:21.692623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 877/1735] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:21.693193 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e31c16-6163-4253-a2a2-6038f2f0e252 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:21.840165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 859/1736] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:21.852775 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6b2b2-84e3-40c1-98c2-06f183b10d29 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:21.870018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6b2b2-84e3-40c1-98c2-06f183b10d29 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:21.875259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e3042-c968-418e-9df7-2a99592e60df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:21.876111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e3042-c968-418e-9df7-2a99592e60df admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:21.876437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e3042-c968-418e-9df7-2a99592e60df admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:21.876713 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e3042-c968-418e-9df7-2a99592e60df admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:21.877409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e3042-c968-418e-9df7-2a99592e60df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:21.879388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e3042-c968-418e-9df7-2a99592e60df admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:21.881017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e31c16-6163-4253-a2a2-6038f2f0e252 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:21.904350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39231e9e-1d56-4bbb-acc4-67f275f0c09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:21.921541 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 860/1737] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:21 2022] POST /identity/v3/projects => generated 369 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:21.923024 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e3042-c968-418e-9df7-2a99592e60df admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:21.926830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bd1e3042-c968-418e-9df7-2a99592e60df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:21.934941 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39231e9e-1d56-4bbb-acc4-67f275f0c09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:21.937779 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39231e9e-1d56-4bbb-acc4-67f275f0c09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:21.938799 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39231e9e-1d56-4bbb-acc4-67f275f0c09e admin admin] PATH_INFO: `/v3/users/7c38facd8a074f9fb3b5a7d9552a5168` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:21.946351 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39231e9e-1d56-4bbb-acc4-67f275f0c09e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c38facd8a074f9fb3b5a7d9552a5168)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:21.951911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39231e9e-1d56-4bbb-acc4-67f275f0c09e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:22.106430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e3042-c968-418e-9df7-2a99592e60df admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:22.132399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfcf77-b179-43fc-97db-4fd60248f523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:22.133427 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfcf77-b179-43fc-97db-4fd60248f523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:22.133779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfcf77-b179-43fc-97db-4fd60248f523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:22.134059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfcf77-b179-43fc-97db-4fd60248f523 admin admin] PATH_INFO: `/v3/users/13c5e9dc5cff47ef9fb2c6a5e5110260` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:22.149602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfcf77-b179-43fc-97db-4fd60248f523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13c5e9dc5cff47ef9fb2c6a5e5110260)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:22.166895 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-39231e9e-1d56-4bbb-acc4-67f275f0c09e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c38facd8a074f9fb3b5a7d9552a5168'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:22.171672 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-39231e9e-1d56-4bbb-acc4-67f275f0c09e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c38facd8a074f9fb3b5a7d9552a5168'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:22.172165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfcf77-b179-43fc-97db-4fd60248f523 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:22.174522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-39231e9e-1d56-4bbb-acc4-67f275f0c09e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c38facd8a074f9fb3b5a7d9552a5168'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:22.195722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:22.220388 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-39231e9e-1d56-4bbb-acc4-67f275f0c09e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c38facd8a074f9fb3b5a7d9552a5168'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:22.255260 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-39231e9e-1d56-4bbb-acc4-67f275f0c09e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c38facd8a074f9fb3b5a7d9552a5168'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:22.305650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 878/1738] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:21 2022] DELETE /identity/v3/users/7c38facd8a074f9fb3b5a7d9552a5168 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:22.316069 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5299cc-1582-481c-b97f-1b881a37eef6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:22.317408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5299cc-1582-481c-b97f-1b881a37eef6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:22.318808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5299cc-1582-481c-b97f-1b881a37eef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:22.362872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-73cfcf77-b179-43fc-97db-4fd60248f523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13c5e9dc5cff47ef9fb2c6a5e5110260'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:22.382671 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-73cfcf77-b179-43fc-97db-4fd60248f523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13c5e9dc5cff47ef9fb2c6a5e5110260'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:22.383509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-73cfcf77-b179-43fc-97db-4fd60248f523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13c5e9dc5cff47ef9fb2c6a5e5110260'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:22.385828 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-73cfcf77-b179-43fc-97db-4fd60248f523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13c5e9dc5cff47ef9fb2c6a5e5110260'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:22.389682 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ba5299cc-1582-481c-b97f-1b881a37eef6 None None] MFA Rules not processed for user `139716cccc014f2398791641de0d414c`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:22.393213 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ba5299cc-1582-481c-b97f-1b881a37eef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:22.401780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-73cfcf77-b179-43fc-97db-4fd60248f523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13c5e9dc5cff47ef9fb2c6a5e5110260'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:22.434937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 861/1739] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:21 2022] DELETE /identity/v3/users/13c5e9dc5cff47ef9fb2c6a5e5110260 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:22.435755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfcf77-b179-43fc-97db-4fd60248f523 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:22.444449 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-73cfcf77-b179-43fc-97db-4fd60248f523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:22.512866 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:22.549605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 879/1740] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:22.550926 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91e5fb-18ad-43d0-bdd9-4148ef3b3bff None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:22.551373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91e5fb-18ad-43d0-bdd9-4148ef3b3bff None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:22.551841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91e5fb-18ad-43d0-bdd9-4148ef3b3bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:22.591486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4f91e5fb-18ad-43d0-bdd9-4148ef3b3bff None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:22.592891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4f91e5fb-18ad-43d0-bdd9-4148ef3b3bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:22.608486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 880/1741] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:22.610257 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8f2cb-a1a4-4055-904e-3e4cf7346b3d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:22.610820 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8f2cb-a1a4-4055-904e-3e4cf7346b3d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:22.611262 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8f2cb-a1a4-4055-904e-3e4cf7346b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:22.611710 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfcf77-b179-43fc-97db-4fd60248f523 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:22.620467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8e82d-0647-40d2-b6b6-b0c33af4d84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:22.621406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8e82d-0647-40d2-b6b6-b0c33af4d84c admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:22.621859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8e82d-0647-40d2-b6b6-b0c33af4d84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:22.622283 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8e82d-0647-40d2-b6b6-b0c33af4d84c admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:22.623229 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8e82d-0647-40d2-b6b6-b0c33af4d84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:22.626317 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8e82d-0647-40d2-b6b6-b0c33af4d84c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:22.638802 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-64e8f2cb-a1a4-4055-904e-3e4cf7346b3d None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:22.640365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-64e8f2cb-a1a4-4055-904e-3e4cf7346b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:22.674277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 881/1742] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:22.674277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8f2cb-a1a4-4055-904e-3e4cf7346b3d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:22.677898 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-64e8f2cb-a1a4-4055-904e-3e4cf7346b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:22.678413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 862/1743] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:22 2022] POST /identity/v3/users => generated 291 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:22.679439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8e82d-0647-40d2-b6b6-b0c33af4d84c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:22.683812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-43f8e82d-0647-40d2-b6b6-b0c33af4d84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:22.789738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8e82d-0647-40d2-b6b6-b0c33af4d84c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:22.798168 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c21750-5e07-432f-937d-699317549f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:22.800064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c21750-5e07-432f-937d-699317549f20 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:22.800576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c21750-5e07-432f-937d-699317549f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:22.801089 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c21750-5e07-432f-937d-699317549f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:22.829399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c21750-5e07-432f-937d-699317549f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:22.835368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c21750-5e07-432f-937d-699317549f20 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:22.875846 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 863/1744] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:22.878957 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c21750-5e07-432f-937d-699317549f20 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:22.903819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8f2cb-a1a4-4055-904e-3e4cf7346b3d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:22.917569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c21750-5e07-432f-937d-699317549f20 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:22.923635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9982639-5cb4-48f6-8ba9-f5d87f2efa7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:22.924366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9982639-5cb4-48f6-8ba9-f5d87f2efa7d service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:22.924657 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9982639-5cb4-48f6-8ba9-f5d87f2efa7d service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:22.924941 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9982639-5cb4-48f6-8ba9-f5d87f2efa7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:22.930540 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b9982639-5cb4-48f6-8ba9-f5d87f2efa7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:22.944529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65c764-306a-4aed-b581-13232bb350c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:22.946916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65c764-306a-4aed-b581-13232bb350c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:22.949688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65c764-306a-4aed-b581-13232bb350c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:22.949989 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65c764-306a-4aed-b581-13232bb350c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:22.950885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65c764-306a-4aed-b581-13232bb350c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:22.966419 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65c764-306a-4aed-b581-13232bb350c8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:22.988670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 864/1745] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:22.990674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65c764-306a-4aed-b581-13232bb350c8 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:23.002778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:23.008436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65c764-306a-4aed-b581-13232bb350c8 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:23.017052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca43cc6-17fa-4ffa-bfba-f10b673a105f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:23.020498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca43cc6-17fa-4ffa-bfba-f10b673a105f service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:23.021092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca43cc6-17fa-4ffa-bfba-f10b673a105f service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:23.022351 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca43cc6-17fa-4ffa-bfba-f10b673a105f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:23.048372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca43cc6-17fa-4ffa-bfba-f10b673a105f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:23.050261 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca43cc6-17fa-4ffa-bfba-f10b673a105f service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:23.068201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 865/1746] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:23.069472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca43cc6-17fa-4ffa-bfba-f10b673a105f service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:23.093022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca43cc6-17fa-4ffa-bfba-f10b673a105f service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:23.099349 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864e82c-f718-40b6-a4fe-082daa7cbf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:23.100712 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864e82c-f718-40b6-a4fe-082daa7cbf23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:23.101100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864e82c-f718-40b6-a4fe-082daa7cbf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:23.101932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864e82c-f718-40b6-a4fe-082daa7cbf23 admin admin] PATH_INFO: `/v3/projects/350434878c3441ef8e9f99c385e02048/users/1d328047a7844043a8040d8409f89224/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:23.133917 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9982639-5cb4-48f6-8ba9-f5d87f2efa7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:23.136663 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9982639-5cb4-48f6-8ba9-f5d87f2efa7d service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:23.136817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864e82c-f718-40b6-a4fe-082daa7cbf23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350434878c3441ef8e9f99c385e02048, user_id=1d328047a7844043a8040d8409f89224, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:23.143796 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864e82c-f718-40b6-a4fe-082daa7cbf23 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:23.152825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 882/1747] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:23.154576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028ea44-e47f-4bbd-8b7a-5f3114db2d2c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:23.154947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028ea44-e47f-4bbd-8b7a-5f3114db2d2c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:23.155370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028ea44-e47f-4bbd-8b7a-5f3114db2d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:23.188541 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 866/1748] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:23 2022] PUT /identity/v3/projects/350434878c3441ef8e9f99c385e02048/users/1d328047a7844043a8040d8409f89224/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:23.192599 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864e82c-f718-40b6-a4fe-082daa7cbf23 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:23.211143 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e028ea44-e47f-4bbd-8b7a-5f3114db2d2c None None] MFA Rules not processed for user `6fa2cda90dc54933a3fe22880bebb478`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:23.212728 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e028ea44-e47f-4bbd-8b7a-5f3114db2d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:23.410278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 883/1749] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:23.468921 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864e82c-f718-40b6-a4fe-082daa7cbf23 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:23.488284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e4746-1473-464c-8d6b-67a7e752b2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:23.489023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e4746-1473-464c-8d6b-67a7e752b2eb admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:23.489310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e4746-1473-464c-8d6b-67a7e752b2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:23.489593 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e4746-1473-464c-8d6b-67a7e752b2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:23.490343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e4746-1473-464c-8d6b-67a7e752b2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:23.504292 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e4746-1473-464c-8d6b-67a7e752b2eb admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:23.542298 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 867/1750] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:23.542765 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028ea44-e47f-4bbd-8b7a-5f3114db2d2c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:23.564907 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028ea44-e47f-4bbd-8b7a-5f3114db2d2c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:23.583812 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded87e3-a70e-47aa-ab75-066c7cc22ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:23.584737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded87e3-a70e-47aa-ab75-066c7cc22ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:23.585029 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded87e3-a70e-47aa-ab75-066c7cc22ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:23.585306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded87e3-a70e-47aa-ab75-066c7cc22ce3 admin admin] PATH_INFO: `/v3/projects/350434878c3441ef8e9f99c385e02048/users/1d328047a7844043a8040d8409f89224/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:23.594504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded87e3-a70e-47aa-ab75-066c7cc22ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350434878c3441ef8e9f99c385e02048, user_id=1d328047a7844043a8040d8409f89224, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:23.608454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded87e3-a70e-47aa-ab75-066c7cc22ce3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:23.635275 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:23.656858 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 884/1751] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:23 2022] PUT /identity/v3/projects/350434878c3441ef8e9f99c385e02048/users/1d328047a7844043a8040d8409f89224/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:23.659588 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334629-b51c-4658-8dd1-a58bafbb5226 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:23.659922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334629-b51c-4658-8dd1-a58bafbb5226 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:23.660209 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334629-b51c-4658-8dd1-a58bafbb5226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:23.758906 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-1e334629-b51c-4658-8dd1-a58bafbb5226 None None] MFA Rules not processed for user `1d328047a7844043a8040d8409f89224`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:23.761815 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1e334629-b51c-4658-8dd1-a58bafbb5226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:23.980776 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b0c26-cc05-463d-ae00-9d91d8dbbf0a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:23.981332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b0c26-cc05-463d-ae00-9d91d8dbbf0a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:23.982340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b0c26-cc05-463d-ae00-9d91d8dbbf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:24.016745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 868/1752] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:23 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:24.026633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e334629-b51c-4658-8dd1-a58bafbb5226 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:24.028345 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1e334629-b51c-4658-8dd1-a58bafbb5226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:24.178984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-763b0c26-cc05-463d-ae00-9d91d8dbbf0a None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:24.183414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-763b0c26-cc05-463d-ae00-9d91d8dbbf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:24.252005 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:24.264898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e334629-b51c-4658-8dd1-a58bafbb5226 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:24.270465 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6eef67-7ffb-4eb4-9dd5-4b373d6744d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:24.274388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eef67-7ffb-4eb4-9dd5-4b373d6744d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:24.274707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eef67-7ffb-4eb4-9dd5-4b373d6744d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:24.275004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eef67-7ffb-4eb4-9dd5-4b373d6744d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:24.301029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6eef67-7ffb-4eb4-9dd5-4b373d6744d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:24.304833 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6eef67-7ffb-4eb4-9dd5-4b373d6744d1 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:24.331934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 869/1753] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:24 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:19:24.419223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6eef67-7ffb-4eb4-9dd5-4b373d6744d1 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:24.420754 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-de6eef67-7ffb-4eb4-9dd5-4b373d6744d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:24.440755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6eef67-7ffb-4eb4-9dd5-4b373d6744d1 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:24.450267 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4605f-0147-4855-adcc-531f7c50a28c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:24.450950 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4605f-0147-4855-adcc-531f7c50a28c service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:24.451238 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4605f-0147-4855-adcc-531f7c50a28c service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:24.451518 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4605f-0147-4855-adcc-531f7c50a28c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:24.459956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 885/1754] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 25 16:19:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:24.460527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-44e4605f-0147-4855-adcc-531f7c50a28c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:24.647036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4605f-0147-4855-adcc-531f7c50a28c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:24.648554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4605f-0147-4855-adcc-531f7c50a28c service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:24.676947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b0c26-cc05-463d-ae00-9d91d8dbbf0a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:24.678867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-763b0c26-cc05-463d-ae00-9d91d8dbbf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:24.690739 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 870/1755] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:19:24.758128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4605f-0147-4855-adcc-531f7c50a28c service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:24.759894 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-44e4605f-0147-4855-adcc-531f7c50a28c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:24.887849 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b0c26-cc05-463d-ae00-9d91d8dbbf0a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:24.909513 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18922c7-b904-42e1-8c72-9dd738718969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:24.911017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18922c7-b904-42e1-8c72-9dd738718969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:24.911470 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18922c7-b904-42e1-8c72-9dd738718969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:24.911910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18922c7-b904-42e1-8c72-9dd738718969 admin admin] PATH_INFO: `/v3/projects/a4bd440dced94e5dabeb91cf7802c387` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:24.914681 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18922c7-b904-42e1-8c72-9dd738718969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4bd440dced94e5dabeb91cf7802c387)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:24.921813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18922c7-b904-42e1-8c72-9dd738718969 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:25.070077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4605f-0147-4855-adcc-531f7c50a28c service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:25.123817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a18922c7-b904-42e1-8c72-9dd738718969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4bd440dced94e5dabeb91cf7802c387', 'request_id': 'req-a18922c7-b904-42e1-8c72-9dd738718969'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:25.154780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a18922c7-b904-42e1-8c72-9dd738718969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4bd440dced94e5dabeb91cf7802c387', 'request_id': 'req-a18922c7-b904-42e1-8c72-9dd738718969'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:25.183327 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a18922c7-b904-42e1-8c72-9dd738718969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4bd440dced94e5dabeb91cf7802c387', 'request_id': 'req-a18922c7-b904-42e1-8c72-9dd738718969'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:25.236396 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a18922c7-b904-42e1-8c72-9dd738718969 admin admin] The token cache is being invalidate because project a4bd440dced94e5dabeb91cf7802c387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:25.239125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a18922c7-b904-42e1-8c72-9dd738718969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:25.245848 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a18922c7-b904-42e1-8c72-9dd738718969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:25.254138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 886/1756] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:24 2022] DELETE /identity/v3/projects/a4bd440dced94e5dabeb91cf7802c387 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:25.256033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18922c7-b904-42e1-8c72-9dd738718969 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:25.264681 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a18922c7-b904-42e1-8c72-9dd738718969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:25.281711 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:25.291728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd8dde-3e17-43f2-aa5c-05f4c8e23577 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:25.294302 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd8dde-3e17-43f2-aa5c-05f4c8e23577 service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:25.296355 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd8dde-3e17-43f2-aa5c-05f4c8e23577 service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:25.297084 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd8dde-3e17-43f2-aa5c-05f4c8e23577 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:25.318068 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-94dd8dde-3e17-43f2-aa5c-05f4c8e23577 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:25.374489 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:25.551407 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd8dde-3e17-43f2-aa5c-05f4c8e23577 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:25.555067 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd8dde-3e17-43f2-aa5c-05f4c8e23577 service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:25.564589 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18922c7-b904-42e1-8c72-9dd738718969 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:25.585999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec372f5e-abb6-4e0d-9ae5-183f8a9284c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:25.589069 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec372f5e-abb6-4e0d-9ae5-183f8a9284c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:25.591514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec372f5e-abb6-4e0d-9ae5-183f8a9284c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:25.591958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec372f5e-abb6-4e0d-9ae5-183f8a9284c0 admin admin] PATH_INFO: `/v3/users/f88ef74448f748f3af4cf46e2ae2c603` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:25.598613 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec372f5e-abb6-4e0d-9ae5-183f8a9284c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88ef74448f748f3af4cf46e2ae2c603)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:25.599142 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 871/1757] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:19:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 841 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 16:19:25.614697 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec372f5e-abb6-4e0d-9ae5-183f8a9284c0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:25.811122 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ec372f5e-abb6-4e0d-9ae5-183f8a9284c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88ef74448f748f3af4cf46e2ae2c603'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:25.813738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ec372f5e-abb6-4e0d-9ae5-183f8a9284c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88ef74448f748f3af4cf46e2ae2c603'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:25.819827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ec372f5e-abb6-4e0d-9ae5-183f8a9284c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88ef74448f748f3af4cf46e2ae2c603'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:25.867789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ec372f5e-abb6-4e0d-9ae5-183f8a9284c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88ef74448f748f3af4cf46e2ae2c603'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:25.881213 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ec372f5e-abb6-4e0d-9ae5-183f8a9284c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88ef74448f748f3af4cf46e2ae2c603'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:25.947896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 887/1758] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:25 2022] DELETE /identity/v3/users/f88ef74448f748f3af4cf46e2ae2c603 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:28.135799 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd8dde-3e17-43f2-aa5c-05f4c8e23577 service swift] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:28.156979 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd8dde-3e17-43f2-aa5c-05f4c8e23577 service swift] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:28.401302 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddee444-8154-41cf-a7d7-32704d1beaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:28.402868 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddee444-8154-41cf-a7d7-32704d1beaf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:28.403685 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddee444-8154-41cf-a7d7-32704d1beaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:28.404189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddee444-8154-41cf-a7d7-32704d1beaf0 admin admin] PATH_INFO: `/v3/projects/8e60b10edfba4abb8f8b6aeaff05d1ba` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:28.405949 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddee444-8154-41cf-a7d7-32704d1beaf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e60b10edfba4abb8f8b6aeaff05d1ba)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:28.413957 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddee444-8154-41cf-a7d7-32704d1beaf0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:28.522460 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7ddee444-8154-41cf-a7d7-32704d1beaf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e60b10edfba4abb8f8b6aeaff05d1ba', 'request_id': 'req-7ddee444-8154-41cf-a7d7-32704d1beaf0'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:28.538242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7ddee444-8154-41cf-a7d7-32704d1beaf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e60b10edfba4abb8f8b6aeaff05d1ba', 'request_id': 'req-7ddee444-8154-41cf-a7d7-32704d1beaf0'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:28.549994 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7ddee444-8154-41cf-a7d7-32704d1beaf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e60b10edfba4abb8f8b6aeaff05d1ba', 'request_id': 'req-7ddee444-8154-41cf-a7d7-32704d1beaf0'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:28.570016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec372f5e-abb6-4e0d-9ae5-183f8a9284c0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:28.573035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ec372f5e-abb6-4e0d-9ae5-183f8a9284c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:28.573920 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7ddee444-8154-41cf-a7d7-32704d1beaf0 admin admin] The token cache is being invalidate because project 8e60b10edfba4abb8f8b6aeaff05d1ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:28.574335 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7ddee444-8154-41cf-a7d7-32704d1beaf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:28.576621 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7ddee444-8154-41cf-a7d7-32704d1beaf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:28.587101 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 872/1759] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:28 2022] DELETE /identity/v3/projects/8e60b10edfba4abb8f8b6aeaff05d1ba => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:28.589513 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728819-442c-4b3f-b83a-48190c3279c6 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:28.589933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728819-442c-4b3f-b83a-48190c3279c6 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:28.590308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728819-442c-4b3f-b83a-48190c3279c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:28.602341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec372f5e-abb6-4e0d-9ae5-183f8a9284c0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:28.638801 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b0728819-442c-4b3f-b83a-48190c3279c6 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:28.640225 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b0728819-442c-4b3f-b83a-48190c3279c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:28.736735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:28.784108 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 873/1760] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:28.793312 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160c93b-37f2-4452-bd2c-582183b1ef4a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:28.795753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160c93b-37f2-4452-bd2c-582183b1ef4a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:28.796171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160c93b-37f2-4452-bd2c-582183b1ef4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:28.863862 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80ed3d-7560-4318-a0c9-68b32df370e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:28.864830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80ed3d-7560-4318-a0c9-68b32df370e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:28.865116 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80ed3d-7560-4318-a0c9-68b32df370e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:28.865395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80ed3d-7560-4318-a0c9-68b32df370e1 admin admin] PATH_INFO: `/v3/projects/4785cc8d70cb41cd8039a2843a286e82` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:28.866964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80ed3d-7560-4318-a0c9-68b32df370e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4785cc8d70cb41cd8039a2843a286e82)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:28.875275 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80ed3d-7560-4318-a0c9-68b32df370e1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:28.877469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a160c93b-37f2-4452-bd2c-582183b1ef4a None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:28.885483 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a160c93b-37f2-4452-bd2c-582183b1ef4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:28.943409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 874/1761] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:28.947833 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160c93b-37f2-4452-bd2c-582183b1ef4a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:29.009386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160c93b-37f2-4452-bd2c-582183b1ef4a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:29.047445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b5a76-346a-403d-8203-18d6327e0bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:29.048198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b5a76-346a-403d-8203-18d6327e0bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:29.048475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b5a76-346a-403d-8203-18d6327e0bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:29.048754 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b5a76-346a-403d-8203-18d6327e0bcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:29.049797 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:29.056600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b5a76-346a-403d-8203-18d6327e0bcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:19:29.064513 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b5a76-346a-403d-8203-18d6327e0bcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:29.077880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b5a76-346a-403d-8203-18d6327e0bcc admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:29.148505 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1a80ed3d-7560-4318-a0c9-68b32df370e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4785cc8d70cb41cd8039a2843a286e82', 'request_id': 'req-1a80ed3d-7560-4318-a0c9-68b32df370e1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:29.174277 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 875/1762] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:19:29.175680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b5a76-346a-403d-8203-18d6327e0bcc admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:29.176080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1a80ed3d-7560-4318-a0c9-68b32df370e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4785cc8d70cb41cd8039a2843a286e82', 'request_id': 'req-1a80ed3d-7560-4318-a0c9-68b32df370e1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:29.210538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1a80ed3d-7560-4318-a0c9-68b32df370e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4785cc8d70cb41cd8039a2843a286e82', 'request_id': 'req-1a80ed3d-7560-4318-a0c9-68b32df370e1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:29.225766 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b5a76-346a-403d-8203-18d6327e0bcc admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:29.276338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1a80ed3d-7560-4318-a0c9-68b32df370e1 admin admin] The token cache is being invalidate because project 4785cc8d70cb41cd8039a2843a286e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:29.282018 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1a80ed3d-7560-4318-a0c9-68b32df370e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:29.284213 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1a80ed3d-7560-4318-a0c9-68b32df370e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:29.295006 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 888/1763] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:28 2022] DELETE /identity/v3/projects/4785cc8d70cb41cd8039a2843a286e82 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:29.299573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80ed3d-7560-4318-a0c9-68b32df370e1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:29.307463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1a80ed3d-7560-4318-a0c9-68b32df370e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:29.560751 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f6a09-90b3-468c-9bad-7399df9db2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:29.562986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f6a09-90b3-468c-9bad-7399df9db2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:29.566341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f6a09-90b3-468c-9bad-7399df9db2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:29.570206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f6a09-90b3-468c-9bad-7399df9db2a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:29.573554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f6a09-90b3-468c-9bad-7399df9db2a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:29.577695 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f6a09-90b3-468c-9bad-7399df9db2a1 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:29.703953 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80ed3d-7560-4318-a0c9-68b32df370e1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:29.728535 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbbed2-e036-463d-b3ec-fc0d45a34f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:29.735098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbbed2-e036-463d-b3ec-fc0d45a34f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:29.735414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbbed2-e036-463d-b3ec-fc0d45a34f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:29.737665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 876/1764] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:29 2022] POST /identity/v3/projects => generated 393 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:29.738183 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbbed2-e036-463d-b3ec-fc0d45a34f49 admin admin] PATH_INFO: `/v3/users/8e3d233af2c94546b1005aa679a1bfd3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:29.740741 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f6a09-90b3-468c-9bad-7399df9db2a1 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:29.745328 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbbed2-e036-463d-b3ec-fc0d45a34f49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e3d233af2c94546b1005aa679a1bfd3)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:29.751254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8e2f6a09-90b3-468c-9bad-7399df9db2a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:29.757467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbbed2-e036-463d-b3ec-fc0d45a34f49 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:29.931361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b6bbbed2-e036-463d-b3ec-fc0d45a34f49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e3d233af2c94546b1005aa679a1bfd3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:29.937032 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b6bbbed2-e036-463d-b3ec-fc0d45a34f49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e3d233af2c94546b1005aa679a1bfd3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:29.941030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b6bbbed2-e036-463d-b3ec-fc0d45a34f49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e3d233af2c94546b1005aa679a1bfd3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:29.980853 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b6bbbed2-e036-463d-b3ec-fc0d45a34f49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e3d233af2c94546b1005aa679a1bfd3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:30.031103 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b6bbbed2-e036-463d-b3ec-fc0d45a34f49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e3d233af2c94546b1005aa679a1bfd3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:30.035467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f6a09-90b3-468c-9bad-7399df9db2a1 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:30.070849 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d4b0d-d708-4ee2-9457-1923632245c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:30.072090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d4b0d-d708-4ee2-9457-1923632245c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:30.072090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d4b0d-d708-4ee2-9457-1923632245c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:30.072401 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d4b0d-d708-4ee2-9457-1923632245c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:30.072889 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d4b0d-d708-4ee2-9457-1923632245c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:30.074955 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d4b0d-d708-4ee2-9457-1923632245c0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:30.132487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 889/1765] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:29 2022] DELETE /identity/v3/users/8e3d233af2c94546b1005aa679a1bfd3 => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:30.134916 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855e91c-f8f8-4e5c-901c-26fbdcd6c125 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:30.134916 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855e91c-f8f8-4e5c-901c-26fbdcd6c125 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:30.134916 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855e91c-f8f8-4e5c-901c-26fbdcd6c125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:30.178152 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 877/1766] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:29 2022] POST /identity/v3/users => generated 297 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:30.179172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d4b0d-d708-4ee2-9457-1923632245c0 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:30.192086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-141d4b0d-d708-4ee2-9457-1923632245c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:30.193334 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7855e91c-f8f8-4e5c-901c-26fbdcd6c125 None None] MFA Rules not processed for user `ad22a7d1e01c4c40b7cbefe971755148`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:30.203556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7855e91c-f8f8-4e5c-901c-26fbdcd6c125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:30.238445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d4b0d-d708-4ee2-9457-1923632245c0 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:30.286740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:30.345468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 890/1767] 10.222.0.99 () {58 vars in 1015 bytes} [Mon Jul 25 16:19:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:30.433473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:30.464706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156a239-1e99-4edd-a420-ffd0aca5ee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:30.465404 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156a239-1e99-4edd-a420-ffd0aca5ee70 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:30.465691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156a239-1e99-4edd-a420-ffd0aca5ee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:30.465974 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156a239-1e99-4edd-a420-ffd0aca5ee70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:30.466718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156a239-1e99-4edd-a420-ffd0aca5ee70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:30.472077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156a239-1e99-4edd-a420-ffd0aca5ee70 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:30.487622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 878/1768] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:30.488892 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855e91c-f8f8-4e5c-901c-26fbdcd6c125 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:30.525694 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855e91c-f8f8-4e5c-901c-26fbdcd6c125 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:30.546508 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34e2e8-d524-40d9-9e72-746d0b4eaab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:30.547321 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34e2e8-d524-40d9-9e72-746d0b4eaab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:30.547617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34e2e8-d524-40d9-9e72-746d0b4eaab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:30.547899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34e2e8-d524-40d9-9e72-746d0b4eaab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:30.555391 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156a239-1e99-4edd-a420-ffd0aca5ee70 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:30.558221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9156a239-1e99-4edd-a420-ffd0aca5ee70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:30.576116 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34e2e8-d524-40d9-9e72-746d0b4eaab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:30.579171 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34e2e8-d524-40d9-9e72-746d0b4eaab5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:30.589179 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156a239-1e99-4edd-a420-ffd0aca5ee70 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:30.606104 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce74dc2-9065-4209-a5bf-d3226e6709e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:30.612729 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce74dc2-9065-4209-a5bf-d3226e6709e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:30.614231 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce74dc2-9065-4209-a5bf-d3226e6709e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:30.614733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce74dc2-9065-4209-a5bf-d3226e6709e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:30.637701 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 891/1769] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:30.639243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34e2e8-d524-40d9-9e72-746d0b4eaab5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:30.653569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce74dc2-9065-4209-a5bf-d3226e6709e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:30.656662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce74dc2-9065-4209-a5bf-d3226e6709e7 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:30.674458 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34e2e8-d524-40d9-9e72-746d0b4eaab5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:30.696763 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 879/1770] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:30.703360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894fd8a-6ae7-4dec-a864-97a4f2214da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:30.706310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894fd8a-6ae7-4dec-a864-97a4f2214da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:30.707017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894fd8a-6ae7-4dec-a864-97a4f2214da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:30.707017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894fd8a-6ae7-4dec-a864-97a4f2214da3 admin admin] PATH_INFO: `/v3/projects/3543ae02d0814c2893dfaf4fe922912c/users/bb024f639190478893293d8dee019115/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:30.750020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce74dc2-9065-4209-a5bf-d3226e6709e7 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:30.752440 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7ce74dc2-9065-4209-a5bf-d3226e6709e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:30.758069 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894fd8a-6ae7-4dec-a864-97a4f2214da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3543ae02d0814c2893dfaf4fe922912c, user_id=bb024f639190478893293d8dee019115, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:30.765163 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894fd8a-6ae7-4dec-a864-97a4f2214da3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:30.779422 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce74dc2-9065-4209-a5bf-d3226e6709e7 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:30.805140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1975a-7435-42f7-ba67-a811c995de90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:30.805908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1975a-7435-42f7-ba67-a811c995de90 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:30.806140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1975a-7435-42f7-ba67-a811c995de90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:30.806421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1975a-7435-42f7-ba67-a811c995de90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:30.832346 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 892/1771] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:30 2022] PUT /identity/v3/projects/3543ae02d0814c2893dfaf4fe922912c/users/bb024f639190478893293d8dee019115/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:30.834077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1951b16-99a1-47a6-bdf0-0bfc556b8b18 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:30.836731 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1951b16-99a1-47a6-bdf0-0bfc556b8b18 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:30.837122 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1951b16-99a1-47a6-bdf0-0bfc556b8b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:30.884537 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1975a-7435-42f7-ba67-a811c995de90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:30.899668 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1975a-7435-42f7-ba67-a811c995de90 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:30.925925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e1951b16-99a1-47a6-bdf0-0bfc556b8b18 None None] MFA Rules not processed for user `bb024f639190478893293d8dee019115`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:30.927314 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e1951b16-99a1-47a6-bdf0-0bfc556b8b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:30.940305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 880/1772] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:31.129677 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1975a-7435-42f7-ba67-a811c995de90 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:31.131199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e5e1975a-7435-42f7-ba67-a811c995de90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:31.177994 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1975a-7435-42f7-ba67-a811c995de90 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:31.205600 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 893/1773] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:31.210158 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1951b16-99a1-47a6-bdf0-0bfc556b8b18 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:31.370080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef02b9b-af44-423b-98dc-712ad84e24f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:31.371763 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef02b9b-af44-423b-98dc-712ad84e24f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:31.372405 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef02b9b-af44-423b-98dc-712ad84e24f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:31.374766 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef02b9b-af44-423b-98dc-712ad84e24f4 admin admin] PATH_INFO: `/v3/users/ac28ab3feff7497f90219ed182ff3a05` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:31.377229 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef02b9b-af44-423b-98dc-712ad84e24f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac28ab3feff7497f90219ed182ff3a05)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:31.385469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef02b9b-af44-423b-98dc-712ad84e24f4 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:31.421248 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1951b16-99a1-47a6-bdf0-0bfc556b8b18 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:31.442111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916adeb-cbc0-4bff-bea1-f55803e80610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:31.442557 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916adeb-cbc0-4bff-bea1-f55803e80610 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:31.443193 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916adeb-cbc0-4bff-bea1-f55803e80610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:31.443579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916adeb-cbc0-4bff-bea1-f55803e80610 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:31.444461 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916adeb-cbc0-4bff-bea1-f55803e80610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:31.446577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916adeb-cbc0-4bff-bea1-f55803e80610 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:31.514131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-cef02b9b-af44-423b-98dc-712ad84e24f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac28ab3feff7497f90219ed182ff3a05'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:31.541199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-cef02b9b-af44-423b-98dc-712ad84e24f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac28ab3feff7497f90219ed182ff3a05'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:31.542415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-cef02b9b-af44-423b-98dc-712ad84e24f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac28ab3feff7497f90219ed182ff3a05'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:31.543983 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-cef02b9b-af44-423b-98dc-712ad84e24f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac28ab3feff7497f90219ed182ff3a05'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:31.582385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-cef02b9b-af44-423b-98dc-712ad84e24f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac28ab3feff7497f90219ed182ff3a05'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:31.604637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 894/1774] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:31 2022] POST /identity/v3/projects => generated 393 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:31.607626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916adeb-cbc0-4bff-bea1-f55803e80610 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:31.611796 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0916adeb-cbc0-4bff-bea1-f55803e80610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:31.626637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 881/1775] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:31 2022] DELETE /identity/v3/users/ac28ab3feff7497f90219ed182ff3a05 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:31.631101 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e969df5-1bb2-4db6-a844-2dfa1c825e47 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:31.632644 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e969df5-1bb2-4db6-a844-2dfa1c825e47 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:31.633089 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e969df5-1bb2-4db6-a844-2dfa1c825e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:31.685759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8e969df5-1bb2-4db6-a844-2dfa1c825e47 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:31.687728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8e969df5-1bb2-4db6-a844-2dfa1c825e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:31.701568 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:31.795832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:31.892309 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916adeb-cbc0-4bff-bea1-f55803e80610 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:31.981954 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 882/1776] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:32.041361 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e969df5-1bb2-4db6-a844-2dfa1c825e47 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:32.042880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8e969df5-1bb2-4db6-a844-2dfa1c825e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:32.048998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226a659-96ad-4a93-9667-c3f015102b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:32.049696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a659-96ad-4a93-9667-c3f015102b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:32.049981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a659-96ad-4a93-9667-c3f015102b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:32.050292 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a659-96ad-4a93-9667-c3f015102b51 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:32.050965 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226a659-96ad-4a93-9667-c3f015102b51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:32.053248 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226a659-96ad-4a93-9667-c3f015102b51 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:32.126060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 895/1777] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:31 2022] POST /identity/v3/users => generated 303 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:32.127146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226a659-96ad-4a93-9667-c3f015102b51 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:32.152088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226a659-96ad-4a93-9667-c3f015102b51 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:32.166668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5f733-403e-45f5-8428-4c68990fd294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:32.167279 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5f733-403e-45f5-8428-4c68990fd294 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:32.167395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5f733-403e-45f5-8428-4c68990fd294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:32.167642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5f733-403e-45f5-8428-4c68990fd294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:32.168923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5f733-403e-45f5-8428-4c68990fd294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:32.170030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5f733-403e-45f5-8428-4c68990fd294 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:32.204432 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 896/1778] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:32.205752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5f733-403e-45f5-8428-4c68990fd294 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:32.231824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5f733-403e-45f5-8428-4c68990fd294 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:32.244871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b782b8-a662-4771-a2c9-f3a8e3d42ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:32.246011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b782b8-a662-4771-a2c9-f3a8e3d42ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:32.246150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b782b8-a662-4771-a2c9-f3a8e3d42ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:32.246452 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b782b8-a662-4771-a2c9-f3a8e3d42ec2 admin admin] PATH_INFO: `/v3/projects/44ba655f9e6649249f2252c2da4be481/users/9305752daae44e6eb5790647dd6d79b5/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:32.265011 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e969df5-1bb2-4db6-a844-2dfa1c825e47 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:32.277151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de38f35-e69a-468f-a867-80c53a2c0e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:32.277838 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de38f35-e69a-468f-a867-80c53a2c0e23 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:32.278139 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de38f35-e69a-468f-a867-80c53a2c0e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:32.278413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de38f35-e69a-468f-a867-80c53a2c0e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:32.281639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b782b8-a662-4771-a2c9-f3a8e3d42ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ba655f9e6649249f2252c2da4be481, user_id=9305752daae44e6eb5790647dd6d79b5, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:32.288988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b782b8-a662-4771-a2c9-f3a8e3d42ec2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:32.317140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de38f35-e69a-468f-a867-80c53a2c0e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:32.318783 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 897/1779] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:32 2022] PUT /identity/v3/projects/44ba655f9e6649249f2252c2da4be481/users/9305752daae44e6eb5790647dd6d79b5/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:32.319867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b782b8-a662-4771-a2c9-f3a8e3d42ec2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:32.322703 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de38f35-e69a-468f-a867-80c53a2c0e23 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:32.361220 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 883/1780] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:32.465839 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b782b8-a662-4771-a2c9-f3a8e3d42ec2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:32.471459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc386ce9-a781-47ac-9297-30fb1d2a9402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:32.472438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc386ce9-a781-47ac-9297-30fb1d2a9402 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:32.472893 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc386ce9-a781-47ac-9297-30fb1d2a9402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:32.473321 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc386ce9-a781-47ac-9297-30fb1d2a9402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:32.474205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc386ce9-a781-47ac-9297-30fb1d2a9402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:32.475996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc386ce9-a781-47ac-9297-30fb1d2a9402 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:32.489142 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 898/1781] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:32.493352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de38f35-e69a-468f-a867-80c53a2c0e23 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:32.506858 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de38f35-e69a-468f-a867-80c53a2c0e23 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:32.519409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd4453-4379-49c1-bb4c-347bc13dc4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:32.520236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4453-4379-49c1-bb4c-347bc13dc4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:32.520603 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4453-4379-49c1-bb4c-347bc13dc4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:32.520827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4453-4379-49c1-bb4c-347bc13dc4c8 admin admin] PATH_INFO: `/v3/projects/44ba655f9e6649249f2252c2da4be481/users/9305752daae44e6eb5790647dd6d79b5/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:32.526248 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd4453-4379-49c1-bb4c-347bc13dc4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ba655f9e6649249f2252c2da4be481, user_id=9305752daae44e6eb5790647dd6d79b5, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:32.533899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd4453-4379-49c1-bb4c-347bc13dc4c8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:32.556841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 884/1782] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:32 2022] PUT /identity/v3/projects/44ba655f9e6649249f2252c2da4be481/users/9305752daae44e6eb5790647dd6d79b5/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:32.572093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ced0b9-7882-4c96-aa43-4f9d76cb1584 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:32.572772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ced0b9-7882-4c96-aa43-4f9d76cb1584 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:32.573151 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ced0b9-7882-4c96-aa43-4f9d76cb1584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:32.771284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-82ced0b9-7882-4c96-aa43-4f9d76cb1584 None None] MFA Rules not processed for user `9305752daae44e6eb5790647dd6d79b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:32.776563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-82ced0b9-7882-4c96-aa43-4f9d76cb1584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:32.801036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:33.027002 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 899/1783] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:33.043213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd4453-4379-49c1-bb4c-347bc13dc4c8 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:33.045179 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3dfd4453-4379-49c1-bb4c-347bc13dc4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:33.240978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd4453-4379-49c1-bb4c-347bc13dc4c8 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:33.272054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a823da3-3353-4327-a440-bf4180f93021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:33.272808 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a823da3-3353-4327-a440-bf4180f93021 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:33.273156 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a823da3-3353-4327-a440-bf4180f93021 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:33.273466 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a823da3-3353-4327-a440-bf4180f93021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:33.318675 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a823da3-3353-4327-a440-bf4180f93021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:33.320501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a823da3-3353-4327-a440-bf4180f93021 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:33.356094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 885/1784] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:33.559067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ced0b9-7882-4c96-aa43-4f9d76cb1584 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:33.560763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-82ced0b9-7882-4c96-aa43-4f9d76cb1584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:33.601635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ced0b9-7882-4c96-aa43-4f9d76cb1584 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:33.609829 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82399f1-3621-4d2f-a033-e0afc3148b20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:33.613929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82399f1-3621-4d2f-a033-e0afc3148b20 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:33.615128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82399f1-3621-4d2f-a033-e0afc3148b20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:33.615795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82399f1-3621-4d2f-a033-e0afc3148b20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:33.618325 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e82399f1-3621-4d2f-a033-e0afc3148b20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:33.679220 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a823da3-3353-4327-a440-bf4180f93021 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:33.680718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2a823da3-3353-4327-a440-bf4180f93021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:33.830742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82399f1-3621-4d2f-a033-e0afc3148b20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:33.836604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82399f1-3621-4d2f-a033-e0afc3148b20 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:33.877776 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 900/1785] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:33.929035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a823da3-3353-4327-a440-bf4180f93021 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:33.940991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7b8df-23a7-4c3e-877a-ef0e18de38df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:33.952352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7b8df-23a7-4c3e-877a-ef0e18de38df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:33.952352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7b8df-23a7-4c3e-877a-ef0e18de38df admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:33.952631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7b8df-23a7-4c3e-877a-ef0e18de38df admin admin] PATH_INFO: `/v3/projects/3fabf7170ba247d29dc40fe99b4aed71` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:33.954762 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7b8df-23a7-4c3e-877a-ef0e18de38df admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fabf7170ba247d29dc40fe99b4aed71)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:33.966612 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7b8df-23a7-4c3e-877a-ef0e18de38df admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:33.976364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:34.177607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b6b7b8df-23a7-4c3e-877a-ef0e18de38df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fabf7170ba247d29dc40fe99b4aed71', 'request_id': 'req-b6b7b8df-23a7-4c3e-877a-ef0e18de38df'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:34.203002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b6b7b8df-23a7-4c3e-877a-ef0e18de38df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fabf7170ba247d29dc40fe99b4aed71', 'request_id': 'req-b6b7b8df-23a7-4c3e-877a-ef0e18de38df'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:34.270409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b6b7b8df-23a7-4c3e-877a-ef0e18de38df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fabf7170ba247d29dc40fe99b4aed71', 'request_id': 'req-b6b7b8df-23a7-4c3e-877a-ef0e18de38df'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:34.338732 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b6b7b8df-23a7-4c3e-877a-ef0e18de38df admin admin] The token cache is being invalidate because project 3fabf7170ba247d29dc40fe99b4aed71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:34.339126 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b6b7b8df-23a7-4c3e-877a-ef0e18de38df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:34.342662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b6b7b8df-23a7-4c3e-877a-ef0e18de38df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:34.349373 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 886/1786] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:33 2022] DELETE /identity/v3/projects/3fabf7170ba247d29dc40fe99b4aed71 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:34.355819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0842f-b1e3-4eb2-890b-accc2dc45cd6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:34.356436 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0842f-b1e3-4eb2-890b-accc2dc45cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:34.356877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0842f-b1e3-4eb2-890b-accc2dc45cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:34.451196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b4c0842f-b1e3-4eb2-890b-accc2dc45cd6 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:34.454547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b4c0842f-b1e3-4eb2-890b-accc2dc45cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:34.689528 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 901/1787] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:34.698553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e148e-dc62-4425-8429-7e345593fc23 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:34.699472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e148e-dc62-4425-8429-7e345593fc23 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:34.699851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e148e-dc62-4425-8429-7e345593fc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:34.777502 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6f0e148e-dc62-4425-8429-7e345593fc23 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:34.787219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6f0e148e-dc62-4425-8429-7e345593fc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:34.816913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 887/1788] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:34.821176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0842f-b1e3-4eb2-890b-accc2dc45cd6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:34.834484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0842f-b1e3-4eb2-890b-accc2dc45cd6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:34.847964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1180c59-3c08-4e21-be46-39dc6ce5e022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:34.851052 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1180c59-3c08-4e21-be46-39dc6ce5e022 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:34.852610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1180c59-3c08-4e21-be46-39dc6ce5e022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:34.854070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1180c59-3c08-4e21-be46-39dc6ce5e022 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:34.855042 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1180c59-3c08-4e21-be46-39dc6ce5e022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:19:34.861052 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1180c59-3c08-4e21-be46-39dc6ce5e022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:34.864989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1180c59-3c08-4e21-be46-39dc6ce5e022 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:34.937071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 902/1789] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:19:34.941723 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e148e-dc62-4425-8429-7e345593fc23 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:34.961686 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e148e-dc62-4425-8429-7e345593fc23 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:34.989102 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191f05f-0640-49d8-829c-14b5b4f95293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:34.990003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191f05f-0640-49d8-829c-14b5b4f95293 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:34.990392 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191f05f-0640-49d8-829c-14b5b4f95293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:34.991096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191f05f-0640-49d8-829c-14b5b4f95293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:34.997612 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191f05f-0640-49d8-829c-14b5b4f95293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:35.012617 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191f05f-0640-49d8-829c-14b5b4f95293 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:35.078576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 888/1790] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:34 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:35.079268 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1180c59-3c08-4e21-be46-39dc6ce5e022 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:35.095824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1180c59-3c08-4e21-be46-39dc6ce5e022 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:35.214838 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:35.347228 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19682c4-c738-4d90-95db-8351eed1c914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:35.350279 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19682c4-c738-4d90-95db-8351eed1c914 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:35.355281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19682c4-c738-4d90-95db-8351eed1c914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:35.355693 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19682c4-c738-4d90-95db-8351eed1c914 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:35.356803 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19682c4-c738-4d90-95db-8351eed1c914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:35.360279 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19682c4-c738-4d90-95db-8351eed1c914 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:35.451108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 903/1791] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:35 2022] POST /identity/v3/users => generated 294 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:35.454886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191f05f-0640-49d8-829c-14b5b4f95293 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:35.471039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191f05f-0640-49d8-829c-14b5b4f95293 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:35.501071 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f674ef-f12f-4fb7-a066-d956ea2bfb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:35.502050 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f674ef-f12f-4fb7-a066-d956ea2bfb9a admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:35.502573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f674ef-f12f-4fb7-a066-d956ea2bfb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:35.504692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f674ef-f12f-4fb7-a066-d956ea2bfb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:35.505689 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f674ef-f12f-4fb7-a066-d956ea2bfb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:35.508147 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f674ef-f12f-4fb7-a066-d956ea2bfb9a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:35.570087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 889/1792] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:35.571544 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19682c4-c738-4d90-95db-8351eed1c914 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:35.595454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19682c4-c738-4d90-95db-8351eed1c914 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:35.621320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a553a-d3e1-4ea7-b0a6-755107ee5a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:35.622788 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a553a-d3e1-4ea7-b0a6-755107ee5a6a admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:35.623465 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a553a-d3e1-4ea7-b0a6-755107ee5a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:35.624016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a553a-d3e1-4ea7-b0a6-755107ee5a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:35.625163 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a553a-d3e1-4ea7-b0a6-755107ee5a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:35.627788 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a553a-d3e1-4ea7-b0a6-755107ee5a6a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:35.646600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e972a7-31c5-4572-bc53-e74438f54295 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:35.647352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e972a7-31c5-4572-bc53-e74438f54295 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:35.647905 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e972a7-31c5-4572-bc53-e74438f54295 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:35.650749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 890/1793] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 25 16:19:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:19:35.665536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e972a7-31c5-4572-bc53-e74438f54295 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:35.668834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 904/1794] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:35.699144 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e972a7-31c5-4572-bc53-e74438f54295 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:35.709729 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887246c8-251d-4b2d-859f-f249fb01d275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:35.711137 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887246c8-251d-4b2d-859f-f249fb01d275 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:35.711809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887246c8-251d-4b2d-859f-f249fb01d275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:35.712722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887246c8-251d-4b2d-859f-f249fb01d275 admin admin] PATH_INFO: `/v3/projects/d7f77431bf974fc980165567a862ecc4/users/a456719843d943d5a3d9f530cb667b1f/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:35.753280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887246c8-251d-4b2d-859f-f249fb01d275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f77431bf974fc980165567a862ecc4, user_id=a456719843d943d5a3d9f530cb667b1f, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:35.757990 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb9c68-84a3-43f4-bffd-f31f60187121 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:35.758580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb9c68-84a3-43f4-bffd-f31f60187121 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:35.759132 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb9c68-84a3-43f4-bffd-f31f60187121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:35.767521 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887246c8-251d-4b2d-859f-f249fb01d275 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:35.813523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-aeeb9c68-84a3-43f4-bffd-f31f60187121 None None] MFA Rules not processed for user `c455f8d340444b068249213ff504895e`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:35.820814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 891/1795] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:35 2022] PUT /identity/v3/projects/d7f77431bf974fc980165567a862ecc4/users/a456719843d943d5a3d9f530cb667b1f/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:35.822018 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-aeeb9c68-84a3-43f4-bffd-f31f60187121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:35.839386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081385e7-fa05-4a93-9ed8-b1e094d0a33e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:35.840088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081385e7-fa05-4a93-9ed8-b1e094d0a33e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:35.840729 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081385e7-fa05-4a93-9ed8-b1e094d0a33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:35.935527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-081385e7-fa05-4a93-9ed8-b1e094d0a33e None None] MFA Rules not processed for user `a456719843d943d5a3d9f530cb667b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:35.938460 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-081385e7-fa05-4a93-9ed8-b1e094d0a33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:36.085408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 905/1796] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 25 16:19:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:19:36.182613 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 892/1797] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:36.188527 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb9c68-84a3-43f4-bffd-f31f60187121 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:36.390101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb9c68-84a3-43f4-bffd-f31f60187121 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:36.407860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928bc0e-2d1f-4b67-b6eb-3c465922feba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:36.408439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928bc0e-2d1f-4b67-b6eb-3c465922feba admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:36.408733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928bc0e-2d1f-4b67-b6eb-3c465922feba admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:36.409017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928bc0e-2d1f-4b67-b6eb-3c465922feba admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:36.409772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928bc0e-2d1f-4b67-b6eb-3c465922feba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:36.417185 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928bc0e-2d1f-4b67-b6eb-3c465922feba admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:36.490646 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081385e7-fa05-4a93-9ed8-b1e094d0a33e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:36.492507 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-081385e7-fa05-4a93-9ed8-b1e094d0a33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:36.496467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 906/1798] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:36 2022] POST /identity/v3/projects => generated 385 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:36.500119 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928bc0e-2d1f-4b67-b6eb-3c465922feba admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:36.551312 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081385e7-fa05-4a93-9ed8-b1e094d0a33e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:36.584747 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:36.603163 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:36.674117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0c366-8093-47ed-a7ab-d02fb5369832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:36.675090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0c366-8093-47ed-a7ab-d02fb5369832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:36.683295 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0c366-8093-47ed-a7ab-d02fb5369832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:36.683814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0c366-8093-47ed-a7ab-d02fb5369832 admin admin] PATH_INFO: `/v3/projects/d3705d5193c04ce5b69a14141cf1317a` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:36.685694 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0c366-8093-47ed-a7ab-d02fb5369832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3705d5193c04ce5b69a14141cf1317a)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:36.688074 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0c366-8093-47ed-a7ab-d02fb5369832 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:36.701047 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928bc0e-2d1f-4b67-b6eb-3c465922feba admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:36.707409 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d788396-b3f1-457d-bcdf-9313357e0ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:36.708019 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d788396-b3f1-457d-bcdf-9313357e0ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:36.708465 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d788396-b3f1-457d-bcdf-9313357e0ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:36.708853 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d788396-b3f1-457d-bcdf-9313357e0ba9 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:36.710461 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d788396-b3f1-457d-bcdf-9313357e0ba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:36.713754 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d788396-b3f1-457d-bcdf-9313357e0ba9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:36.776391 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 907/1799] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:36 2022] POST /identity/v3/users => generated 299 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:36.779905 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d788396-b3f1-457d-bcdf-9313357e0ba9 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:36.787748 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3d788396-b3f1-457d-bcdf-9313357e0ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:36.812541 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-94d0c366-8093-47ed-a7ab-d02fb5369832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3705d5193c04ce5b69a14141cf1317a', 'request_id': 'req-94d0c366-8093-47ed-a7ab-d02fb5369832'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:36.830744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-94d0c366-8093-47ed-a7ab-d02fb5369832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3705d5193c04ce5b69a14141cf1317a', 'request_id': 'req-94d0c366-8093-47ed-a7ab-d02fb5369832'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:36.840946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-94d0c366-8093-47ed-a7ab-d02fb5369832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3705d5193c04ce5b69a14141cf1317a', 'request_id': 'req-94d0c366-8093-47ed-a7ab-d02fb5369832'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:36.867548 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-94d0c366-8093-47ed-a7ab-d02fb5369832 admin admin] The token cache is being invalidate because project d3705d5193c04ce5b69a14141cf1317a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:36.870281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-94d0c366-8093-47ed-a7ab-d02fb5369832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:36.872649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-94d0c366-8093-47ed-a7ab-d02fb5369832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:36.878508 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 893/1800] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:36 2022] DELETE /identity/v3/projects/d3705d5193c04ce5b69a14141cf1317a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:36.879639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0c366-8093-47ed-a7ab-d02fb5369832 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:36.892366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-94d0c366-8093-47ed-a7ab-d02fb5369832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:37.079840 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0c366-8093-47ed-a7ab-d02fb5369832 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:37.086460 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da00e7-23d3-4d2e-bffd-554cb886a34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:37.087412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da00e7-23d3-4d2e-bffd-554cb886a34a admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:37.087841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da00e7-23d3-4d2e-bffd-554cb886a34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:37.088282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da00e7-23d3-4d2e-bffd-554cb886a34a admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:37.089120 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da00e7-23d3-4d2e-bffd-554cb886a34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:37.092430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da00e7-23d3-4d2e-bffd-554cb886a34a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:37.107170 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 894/1801] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:37.108867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da00e7-23d3-4d2e-bffd-554cb886a34a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:37.111539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-34da00e7-23d3-4d2e-bffd-554cb886a34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:37.153077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da00e7-23d3-4d2e-bffd-554cb886a34a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:37.153965 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d788396-b3f1-457d-bcdf-9313357e0ba9 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:37.159104 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53a21b-88f8-4084-a4f0-bd951289e3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:37.160232 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53a21b-88f8-4084-a4f0-bd951289e3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:37.160650 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53a21b-88f8-4084-a4f0-bd951289e3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:37.161028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53a21b-88f8-4084-a4f0-bd951289e3aa admin admin] PATH_INFO: `/v3/users/1d328047a7844043a8040d8409f89224` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:37.162575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53a21b-88f8-4084-a4f0-bd951289e3aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d328047a7844043a8040d8409f89224)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:37.164998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53a21b-88f8-4084-a4f0-bd951289e3aa admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:37.342662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:37.362148 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ab53a21b-88f8-4084-a4f0-bd951289e3aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d328047a7844043a8040d8409f89224'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:37.378989 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ab53a21b-88f8-4084-a4f0-bd951289e3aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d328047a7844043a8040d8409f89224'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:37.381540 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ab53a21b-88f8-4084-a4f0-bd951289e3aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d328047a7844043a8040d8409f89224'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:37.383085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ab53a21b-88f8-4084-a4f0-bd951289e3aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d328047a7844043a8040d8409f89224'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:37.415657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ab53a21b-88f8-4084-a4f0-bd951289e3aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d328047a7844043a8040d8409f89224'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:37.429771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55c654-5e6f-48b5-bda7-c2ee60d51c8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:37.430831 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55c654-5e6f-48b5-bda7-c2ee60d51c8f service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:37.431149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55c654-5e6f-48b5-bda7-c2ee60d51c8f service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:37.432392 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55c654-5e6f-48b5-bda7-c2ee60d51c8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:37.434999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fb55c654-5e6f-48b5-bda7-c2ee60d51c8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:37.462164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 895/1802] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:37 2022] DELETE /identity/v3/users/1d328047a7844043a8040d8409f89224 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:37.462164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53a21b-88f8-4084-a4f0-bd951289e3aa admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:37.466065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ab53a21b-88f8-4084-a4f0-bd951289e3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:37.468386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55c654-5e6f-48b5-bda7-c2ee60d51c8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:37.471322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55c654-5e6f-48b5-bda7-c2ee60d51c8f service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:37.549159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 908/1803] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:37.767984 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53a21b-88f8-4084-a4f0-bd951289e3aa admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:37.789311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfa38b-36e6-44ec-8fa3-8ad8c425fd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:37.791708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfa38b-36e6-44ec-8fa3-8ad8c425fd6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:37.792021 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfa38b-36e6-44ec-8fa3-8ad8c425fd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:37.792330 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfa38b-36e6-44ec-8fa3-8ad8c425fd6a admin admin] PATH_INFO: `/v3/projects/8aaee68a65f44f78ac982a20110a291c/users/75b310066b9f485ab3ee3d10f0c5753b/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:37.873586 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfa38b-36e6-44ec-8fa3-8ad8c425fd6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aaee68a65f44f78ac982a20110a291c, user_id=75b310066b9f485ab3ee3d10f0c5753b, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:37.879619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfa38b-36e6-44ec-8fa3-8ad8c425fd6a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:37.930115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 896/1804] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:37 2022] PUT /identity/v3/projects/8aaee68a65f44f78ac982a20110a291c/users/75b310066b9f485ab3ee3d10f0c5753b/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:37.931295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55c654-5e6f-48b5-bda7-c2ee60d51c8f service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:37.951573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55c654-5e6f-48b5-bda7-c2ee60d51c8f service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:38.129949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:38.191993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101c368-efdf-44ec-9c4d-665b9f4af136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:38.192767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101c368-efdf-44ec-9c4d-665b9f4af136 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:38.193055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101c368-efdf-44ec-9c4d-665b9f4af136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:38.193340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101c368-efdf-44ec-9c4d-665b9f4af136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:38.194081 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101c368-efdf-44ec-9c4d-665b9f4af136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:38.199512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101c368-efdf-44ec-9c4d-665b9f4af136 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:38.234619 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 909/1805] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:19:38.239962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfa38b-36e6-44ec-8fa3-8ad8c425fd6a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:38.304619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfa38b-36e6-44ec-8fa3-8ad8c425fd6a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:38.320431 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624713c3-05bb-4331-a91d-e37eef5c651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:38.324541 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624713c3-05bb-4331-a91d-e37eef5c651d admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:38.326325 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624713c3-05bb-4331-a91d-e37eef5c651d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:38.327466 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624713c3-05bb-4331-a91d-e37eef5c651d admin admin] PATH_INFO: `/v3/projects/8aaee68a65f44f78ac982a20110a291c/users/75b310066b9f485ab3ee3d10f0c5753b/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:38.332806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624713c3-05bb-4331-a91d-e37eef5c651d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aaee68a65f44f78ac982a20110a291c, user_id=75b310066b9f485ab3ee3d10f0c5753b, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:38.349386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624713c3-05bb-4331-a91d-e37eef5c651d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:38.388715 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 897/1806] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:38 2022] PUT /identity/v3/projects/8aaee68a65f44f78ac982a20110a291c/users/75b310066b9f485ab3ee3d10f0c5753b/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:38.405175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c057d91-11aa-4a32-a4d4-e0cf487f6edc None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:38.405876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c057d91-11aa-4a32-a4d4-e0cf487f6edc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:38.406380 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c057d91-11aa-4a32-a4d4-e0cf487f6edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:38.564442 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8c057d91-11aa-4a32-a4d4-e0cf487f6edc None None] MFA Rules not processed for user `75b310066b9f485ab3ee3d10f0c5753b`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:38.566555 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8c057d91-11aa-4a32-a4d4-e0cf487f6edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:38.741200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 910/1807] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:38.749755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624713c3-05bb-4331-a91d-e37eef5c651d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:38.755025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-624713c3-05bb-4331-a91d-e37eef5c651d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:38.954673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624713c3-05bb-4331-a91d-e37eef5c651d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:38.964202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a16c5-7b2b-4d6d-8720-e5aa00f267b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:38.964932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a16c5-7b2b-4d6d-8720-e5aa00f267b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:38.965216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a16c5-7b2b-4d6d-8720-e5aa00f267b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:38.967150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a16c5-7b2b-4d6d-8720-e5aa00f267b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:39.017736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a16c5-7b2b-4d6d-8720-e5aa00f267b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:39.026978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a16c5-7b2b-4d6d-8720-e5aa00f267b9 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:39.065414 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 898/1808] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:39.133501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c057d91-11aa-4a32-a4d4-e0cf487f6edc None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:39.383241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c057d91-11aa-4a32-a4d4-e0cf487f6edc None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:39.411127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b0069-ee68-413e-9fd3-cb18967238e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:39.415320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b0069-ee68-413e-9fd3-cb18967238e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:39.417669 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b0069-ee68-413e-9fd3-cb18967238e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:39.420523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b0069-ee68-413e-9fd3-cb18967238e8 admin admin] PATH_INFO: `/v3/users/a456719843d943d5a3d9f530cb667b1f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:39.423182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b0069-ee68-413e-9fd3-cb18967238e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a456719843d943d5a3d9f530cb667b1f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:39.433350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b0069-ee68-413e-9fd3-cb18967238e8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:39.567959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-359b0069-ee68-413e-9fd3-cb18967238e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a456719843d943d5a3d9f530cb667b1f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:39.568869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-359b0069-ee68-413e-9fd3-cb18967238e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a456719843d943d5a3d9f530cb667b1f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:39.579251 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-359b0069-ee68-413e-9fd3-cb18967238e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a456719843d943d5a3d9f530cb667b1f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:39.601571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-359b0069-ee68-413e-9fd3-cb18967238e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a456719843d943d5a3d9f530cb667b1f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:39.617180 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:39.636816 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-359b0069-ee68-413e-9fd3-cb18967238e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a456719843d943d5a3d9f530cb667b1f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:39.735391 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 911/1809] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:39 2022] DELETE /identity/v3/users/a456719843d943d5a3d9f530cb667b1f => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:39.739527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ce77-274e-4b35-899a-aff14c8d72fa None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:39.740070 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ce77-274e-4b35-899a-aff14c8d72fa None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:39.740757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ce77-274e-4b35-899a-aff14c8d72fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:39.808999 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d152ce77-274e-4b35-899a-aff14c8d72fa None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:39.814351 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d152ce77-274e-4b35-899a-aff14c8d72fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:39.819457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd270-11a7-4963-9e6f-65ea11a9e38d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:39.819708 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd270-11a7-4963-9e6f-65ea11a9e38d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:39.819998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd270-11a7-4963-9e6f-65ea11a9e38d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:39.821539 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 912/1810] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 25 16:19:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:19:39.910834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:40.006326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 899/1811] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:40.018345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbd270-11a7-4963-9e6f-65ea11a9e38d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:40.020413 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cdcbd270-11a7-4963-9e6f-65ea11a9e38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:40.069893 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbd270-11a7-4963-9e6f-65ea11a9e38d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:40.074952 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356ed19-5ab7-4079-83a7-860aa054faba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:40.075988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356ed19-5ab7-4079-83a7-860aa054faba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:40.076281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356ed19-5ab7-4079-83a7-860aa054faba admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:40.076597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356ed19-5ab7-4079-83a7-860aa054faba admin admin] PATH_INFO: `/v3/users/bb024f639190478893293d8dee019115` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:40.079771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356ed19-5ab7-4079-83a7-860aa054faba admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb024f639190478893293d8dee019115)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:40.082086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356ed19-5ab7-4079-83a7-860aa054faba admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:40.151045 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152ce77-274e-4b35-899a-aff14c8d72fa None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:40.153387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d152ce77-274e-4b35-899a-aff14c8d72fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:40.201122 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0356ed19-5ab7-4079-83a7-860aa054faba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb024f639190478893293d8dee019115'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:40.201861 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0356ed19-5ab7-4079-83a7-860aa054faba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb024f639190478893293d8dee019115'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:40.202504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0356ed19-5ab7-4079-83a7-860aa054faba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb024f639190478893293d8dee019115'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:40.229669 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0356ed19-5ab7-4079-83a7-860aa054faba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb024f639190478893293d8dee019115'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:40.244860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0356ed19-5ab7-4079-83a7-860aa054faba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb024f639190478893293d8dee019115'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:40.341521 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152ce77-274e-4b35-899a-aff14c8d72fa None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:40.374274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 913/1812] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:40 2022] DELETE /identity/v3/users/bb024f639190478893293d8dee019115 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:40.388280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca72091-5ccb-4a39-9b98-ece9ada0f892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:40.388616 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb5f5f-19de-4f98-baaa-f64067dec639 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:40.388616 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb5f5f-19de-4f98-baaa-f64067dec639 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:40.388761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca72091-5ccb-4a39-9b98-ece9ada0f892 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:40.388761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca72091-5ccb-4a39-9b98-ece9ada0f892 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:40.388761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca72091-5ccb-4a39-9b98-ece9ada0f892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:40.388961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb5f5f-19de-4f98-baaa-f64067dec639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:40.396604 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9ca72091-5ccb-4a39-9b98-ece9ada0f892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:40.435181 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca72091-5ccb-4a39-9b98-ece9ada0f892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:40.436879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca72091-5ccb-4a39-9b98-ece9ada0f892 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:40.448319 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-fbeb5f5f-19de-4f98-baaa-f64067dec639 None None] MFA Rules not processed for user `c455f8d340444b068249213ff504895e`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:40.449941 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fbeb5f5f-19de-4f98-baaa-f64067dec639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:40.472947 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 900/1813] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:40.474497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a9041-371c-4932-9b7d-a5068923ddd5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:40.474887 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a9041-371c-4932-9b7d-a5068923ddd5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:40.475258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a9041-371c-4932-9b7d-a5068923ddd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:40.523831 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-160a9041-371c-4932-9b7d-a5068923ddd5 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:40.527894 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-160a9041-371c-4932-9b7d-a5068923ddd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:40.617571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 914/1814] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 25 16:19:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:40.653084 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 901/1815] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:40.705605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb5f5f-19de-4f98-baaa-f64067dec639 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:40.707538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fbeb5f5f-19de-4f98-baaa-f64067dec639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:40.860103 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:40.905032 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb5f5f-19de-4f98-baaa-f64067dec639 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:40.921516 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa1792-0ebe-4827-92c9-e91a311e20ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:40.922769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa1792-0ebe-4827-92c9-e91a311e20ec service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:40.923260 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa1792-0ebe-4827-92c9-e91a311e20ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:40.923636 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa1792-0ebe-4827-92c9-e91a311e20ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:40.953634 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa1792-0ebe-4827-92c9-e91a311e20ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:40.955229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa1792-0ebe-4827-92c9-e91a311e20ec service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:40.976692 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 915/1816] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:41.387793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a9041-371c-4932-9b7d-a5068923ddd5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:41.390530 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-160a9041-371c-4932-9b7d-a5068923ddd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:41.420946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a9041-371c-4932-9b7d-a5068923ddd5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:41.432748 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99347a2a-e1a7-4421-ad0d-04b3c14ef261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:41.433476 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99347a2a-e1a7-4421-ad0d-04b3c14ef261 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:41.434087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99347a2a-e1a7-4421-ad0d-04b3c14ef261 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:41.434793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99347a2a-e1a7-4421-ad0d-04b3c14ef261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:41.451099 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99347a2a-e1a7-4421-ad0d-04b3c14ef261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:41.453287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99347a2a-e1a7-4421-ad0d-04b3c14ef261 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:41.471581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 902/1817] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:41.766825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa1792-0ebe-4827-92c9-e91a311e20ec service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:41.770017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-30aa1792-0ebe-4827-92c9-e91a311e20ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:41.788146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa1792-0ebe-4827-92c9-e91a311e20ec service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:41.809947 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99347a2a-e1a7-4421-ad0d-04b3c14ef261 service nova] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:41.811992 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-99347a2a-e1a7-4421-ad0d-04b3c14ef261 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:41.835711 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea20d68-2d3b-475c-b6db-1e641f787ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:41.839611 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea20d68-2d3b-475c-b6db-1e641f787ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:41.840278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea20d68-2d3b-475c-b6db-1e641f787ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:41.842806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea20d68-2d3b-475c-b6db-1e641f787ed3 admin admin] PATH_INFO: `/v3/projects/350434878c3441ef8e9f99c385e02048` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:41.845843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99347a2a-e1a7-4421-ad0d-04b3c14ef261 service nova] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:41.847242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea20d68-2d3b-475c-b6db-1e641f787ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=350434878c3441ef8e9f99c385e02048)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:41.849760 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea20d68-2d3b-475c-b6db-1e641f787ed3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:41.861176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f7568-5762-4b76-92cd-c2ca3aad52f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:41.862109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f7568-5762-4b76-92cd-c2ca3aad52f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:41.862397 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f7568-5762-4b76-92cd-c2ca3aad52f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:41.862683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f7568-5762-4b76-92cd-c2ca3aad52f4 admin admin] PATH_INFO: `/v3/projects/d7f77431bf974fc980165567a862ecc4` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:41.865881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f7568-5762-4b76-92cd-c2ca3aad52f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f77431bf974fc980165567a862ecc4)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:41.867826 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f7568-5762-4b76-92cd-c2ca3aad52f4 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:41.944526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7ea20d68-2d3b-475c-b6db-1e641f787ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '350434878c3441ef8e9f99c385e02048', 'request_id': 'req-7ea20d68-2d3b-475c-b6db-1e641f787ed3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:41.952972 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7ea20d68-2d3b-475c-b6db-1e641f787ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '350434878c3441ef8e9f99c385e02048', 'request_id': 'req-7ea20d68-2d3b-475c-b6db-1e641f787ed3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:41.959403 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-997f7568-5762-4b76-92cd-c2ca3aad52f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f77431bf974fc980165567a862ecc4', 'request_id': 'req-997f7568-5762-4b76-92cd-c2ca3aad52f4'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:41.960692 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7ea20d68-2d3b-475c-b6db-1e641f787ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '350434878c3441ef8e9f99c385e02048', 'request_id': 'req-7ea20d68-2d3b-475c-b6db-1e641f787ed3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:41.963871 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:41.982785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-997f7568-5762-4b76-92cd-c2ca3aad52f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f77431bf974fc980165567a862ecc4', 'request_id': 'req-997f7568-5762-4b76-92cd-c2ca3aad52f4'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:41.996906 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-997f7568-5762-4b76-92cd-c2ca3aad52f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f77431bf974fc980165567a862ecc4', 'request_id': 'req-997f7568-5762-4b76-92cd-c2ca3aad52f4'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:41.997779 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7ea20d68-2d3b-475c-b6db-1e641f787ed3 admin admin] The token cache is being invalidate because project 350434878c3441ef8e9f99c385e02048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:41.998784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7ea20d68-2d3b-475c-b6db-1e641f787ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:41.999770 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7ea20d68-2d3b-475c-b6db-1e641f787ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.002683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 916/1818] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:41 2022] DELETE /identity/v3/projects/350434878c3441ef8e9f99c385e02048 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:42.011144 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0245b-cbbc-4a61-86b3-1daef451495b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:42.011648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0245b-cbbc-4a61-86b3-1daef451495b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:42.012142 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0245b-cbbc-4a61-86b3-1daef451495b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:42.024581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-997f7568-5762-4b76-92cd-c2ca3aad52f4 admin admin] The token cache is being invalidate because project d7f77431bf974fc980165567a862ecc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:42.025221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-997f7568-5762-4b76-92cd-c2ca3aad52f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.028074 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-997f7568-5762-4b76-92cd-c2ca3aad52f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.037447 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 903/1819] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:41 2022] DELETE /identity/v3/projects/d7f77431bf974fc980165567a862ecc4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:42.042313 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f7568-5762-4b76-92cd-c2ca3aad52f4 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:42.043746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-997f7568-5762-4b76-92cd-c2ca3aad52f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:42.065944 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a3d0245b-cbbc-4a61-86b3-1daef451495b None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:42.067221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a3d0245b-cbbc-4a61-86b3-1daef451495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:42.169280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f7568-5762-4b76-92cd-c2ca3aad52f4 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:42.174762 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6d4ce-4f8f-4e5d-9acb-fd65e1dcab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:42.175980 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6d4ce-4f8f-4e5d-9acb-fd65e1dcab6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:42.175980 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6d4ce-4f8f-4e5d-9acb-fd65e1dcab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:42.176344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6d4ce-4f8f-4e5d-9acb-fd65e1dcab6a admin admin] PATH_INFO: `/v3/users/75b310066b9f485ab3ee3d10f0c5753b` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:42.177812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6d4ce-4f8f-4e5d-9acb-fd65e1dcab6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b310066b9f485ab3ee3d10f0c5753b)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:42.180176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6d4ce-4f8f-4e5d-9acb-fd65e1dcab6a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:42.217362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 917/1820] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:42.218508 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0245b-cbbc-4a61-86b3-1daef451495b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:42.230833 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a3d0245b-cbbc-4a61-86b3-1daef451495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:42.255538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0245b-cbbc-4a61-86b3-1daef451495b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:42.260925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3abce-7fbb-4b3a-85f4-5ead80285803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:42.261907 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3abce-7fbb-4b3a-85f4-5ead80285803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:42.262271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3abce-7fbb-4b3a-85f4-5ead80285803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:42.262671 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3abce-7fbb-4b3a-85f4-5ead80285803 admin admin] PATH_INFO: `/v3/projects/3543ae02d0814c2893dfaf4fe922912c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:42.264233 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3abce-7fbb-4b3a-85f4-5ead80285803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3543ae02d0814c2893dfaf4fe922912c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:42.266254 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3abce-7fbb-4b3a-85f4-5ead80285803 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:42.271830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-23d6d4ce-4f8f-4e5d-9acb-fd65e1dcab6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b310066b9f485ab3ee3d10f0c5753b'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.286283 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-23d6d4ce-4f8f-4e5d-9acb-fd65e1dcab6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b310066b9f485ab3ee3d10f0c5753b'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.287534 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-23d6d4ce-4f8f-4e5d-9acb-fd65e1dcab6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b310066b9f485ab3ee3d10f0c5753b'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.288368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-23d6d4ce-4f8f-4e5d-9acb-fd65e1dcab6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b310066b9f485ab3ee3d10f0c5753b'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.310855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-23d6d4ce-4f8f-4e5d-9acb-fd65e1dcab6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b310066b9f485ab3ee3d10f0c5753b'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.324861 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 904/1821] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:42 2022] DELETE /identity/v3/users/75b310066b9f485ab3ee3d10f0c5753b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:42.326172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855c7bf-670c-4893-a6f5-71c5870423f2 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:42.326458 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855c7bf-670c-4893-a6f5-71c5870423f2 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:42.326734 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855c7bf-670c-4893-a6f5-71c5870423f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:42.348734 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47d3abce-7fbb-4b3a-85f4-5ead80285803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3543ae02d0814c2893dfaf4fe922912c', 'request_id': 'req-47d3abce-7fbb-4b3a-85f4-5ead80285803'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.353018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7855c7bf-670c-4893-a6f5-71c5870423f2 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:42.354932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7855c7bf-670c-4893-a6f5-71c5870423f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:42.356736 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47d3abce-7fbb-4b3a-85f4-5ead80285803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3543ae02d0814c2893dfaf4fe922912c', 'request_id': 'req-47d3abce-7fbb-4b3a-85f4-5ead80285803'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.365956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47d3abce-7fbb-4b3a-85f4-5ead80285803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3543ae02d0814c2893dfaf4fe922912c', 'request_id': 'req-47d3abce-7fbb-4b3a-85f4-5ead80285803'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.368438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:42.389870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47d3abce-7fbb-4b3a-85f4-5ead80285803 admin admin] The token cache is being invalidate because project 3543ae02d0814c2893dfaf4fe922912c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:42.390343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47d3abce-7fbb-4b3a-85f4-5ead80285803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.391158 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47d3abce-7fbb-4b3a-85f4-5ead80285803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.412580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 918/1822] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:42 2022] DELETE /identity/v3/projects/3543ae02d0814c2893dfaf4fe922912c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:42.413559 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3abce-7fbb-4b3a-85f4-5ead80285803 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:42.414976 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-47d3abce-7fbb-4b3a-85f4-5ead80285803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:42.436667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 905/1823] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:42.440964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855c7bf-670c-4893-a6f5-71c5870423f2 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:42.448589 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:42.453896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855c7bf-670c-4893-a6f5-71c5870423f2 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:42.463544 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95286588-206f-4c50-b0e4-df9e4ab1110b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:42.464854 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95286588-206f-4c50-b0e4-df9e4ab1110b admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:42.465384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95286588-206f-4c50-b0e4-df9e4ab1110b admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:42.465872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95286588-206f-4c50-b0e4-df9e4ab1110b admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:42.467028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95286588-206f-4c50-b0e4-df9e4ab1110b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:19:42.467636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95286588-206f-4c50-b0e4-df9e4ab1110b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:42.471164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95286588-206f-4c50-b0e4-df9e4ab1110b admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:42.495763 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 906/1824] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:19:42.499811 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95286588-206f-4c50-b0e4-df9e4ab1110b admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:42.512342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95286588-206f-4c50-b0e4-df9e4ab1110b admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:42.517092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3abce-7fbb-4b3a-85f4-5ead80285803 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:42.520674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0c2d7-d6f7-40c1-80e2-1c0cdf92b600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:42.521566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0c2d7-d6f7-40c1-80e2-1c0cdf92b600 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:42.522002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0c2d7-d6f7-40c1-80e2-1c0cdf92b600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:42.522423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0c2d7-d6f7-40c1-80e2-1c0cdf92b600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:42.523479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0c2d7-d6f7-40c1-80e2-1c0cdf92b600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:42.526700 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0c2d7-d6f7-40c1-80e2-1c0cdf92b600 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:42.527698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1384a9-246e-49c2-a31f-a25c399c922f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:42.528723 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1384a9-246e-49c2-a31f-a25c399c922f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:42.529073 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1384a9-246e-49c2-a31f-a25c399c922f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:42.529414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1384a9-246e-49c2-a31f-a25c399c922f admin admin] PATH_INFO: `/v3/users/9305752daae44e6eb5790647dd6d79b5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:42.530744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1384a9-246e-49c2-a31f-a25c399c922f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9305752daae44e6eb5790647dd6d79b5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:42.533315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1384a9-246e-49c2-a31f-a25c399c922f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:42.571349 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 907/1825] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:42 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:19:42.581964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0c2d7-d6f7-40c1-80e2-1c0cdf92b600 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:42.644461 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1f1384a9-246e-49c2-a31f-a25c399c922f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9305752daae44e6eb5790647dd6d79b5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.646428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1f1384a9-246e-49c2-a31f-a25c399c922f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9305752daae44e6eb5790647dd6d79b5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.647086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1f1384a9-246e-49c2-a31f-a25c399c922f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9305752daae44e6eb5790647dd6d79b5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.657107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1f1384a9-246e-49c2-a31f-a25c399c922f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9305752daae44e6eb5790647dd6d79b5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.672052 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1f1384a9-246e-49c2-a31f-a25c399c922f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9305752daae44e6eb5790647dd6d79b5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:42.682352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0c2d7-d6f7-40c1-80e2-1c0cdf92b600 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:42.696537 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d7dd5-b222-417f-9c4f-6c9732decc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:42.697242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d7dd5-b222-417f-9c4f-6c9732decc14 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:42.697519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 919/1826] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:42 2022] DELETE /identity/v3/users/9305752daae44e6eb5790647dd6d79b5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:42.697656 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d7dd5-b222-417f-9c4f-6c9732decc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:42.697808 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d7dd5-b222-417f-9c4f-6c9732decc14 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:42.698485 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d7dd5-b222-417f-9c4f-6c9732decc14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:42.700462 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d7dd5-b222-417f-9c4f-6c9732decc14 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:42.734146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 908/1827] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:42 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:42.738308 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1384a9-246e-49c2-a31f-a25c399c922f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:42.740116 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1f1384a9-246e-49c2-a31f-a25c399c922f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:42.783743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d7dd5-b222-417f-9c4f-6c9732decc14 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:42.786887 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7f9d7dd5-b222-417f-9c4f-6c9732decc14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:42.805001 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d7dd5-b222-417f-9c4f-6c9732decc14 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:42.840236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1384a9-246e-49c2-a31f-a25c399c922f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:42.856962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65497d-f8a9-4800-9940-5a9da86fa797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:42.857660 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65497d-f8a9-4800-9940-5a9da86fa797 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:42.858030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65497d-f8a9-4800-9940-5a9da86fa797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:42.859114 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65497d-f8a9-4800-9940-5a9da86fa797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:42.860593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65497d-f8a9-4800-9940-5a9da86fa797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:42.864586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65497d-f8a9-4800-9940-5a9da86fa797 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:42.888205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 920/1828] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:42.888553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8f8b5-3f3d-4925-826a-e26577dcc20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:42.889332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65497d-f8a9-4800-9940-5a9da86fa797 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:42.889588 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8f8b5-3f3d-4925-826a-e26577dcc20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:42.889875 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8f8b5-3f3d-4925-826a-e26577dcc20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:42.890151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8f8b5-3f3d-4925-826a-e26577dcc20f admin admin] PATH_INFO: `/v3/projects/8aaee68a65f44f78ac982a20110a291c` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:42.892150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8f8b5-3f3d-4925-826a-e26577dcc20f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aaee68a65f44f78ac982a20110a291c)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:42.894352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8f8b5-3f3d-4925-826a-e26577dcc20f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:42.903985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65497d-f8a9-4800-9940-5a9da86fa797 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:42.913484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff667d-ca63-48b0-8880-38317bdbaf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:42.914791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff667d-ca63-48b0-8880-38317bdbaf32 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:42.915173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff667d-ca63-48b0-8880-38317bdbaf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:42.916186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff667d-ca63-48b0-8880-38317bdbaf32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:42.917056 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff667d-ca63-48b0-8880-38317bdbaf32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:42.918889 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff667d-ca63-48b0-8880-38317bdbaf32 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:42.923679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:42.948563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 921/1829] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:42.950085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff667d-ca63-48b0-8880-38317bdbaf32 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:42.970372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff667d-ca63-48b0-8880-38317bdbaf32 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:42.992294 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-cad8f8b5-3f3d-4925-826a-e26577dcc20f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aaee68a65f44f78ac982a20110a291c', 'request_id': 'req-cad8f8b5-3f3d-4925-826a-e26577dcc20f'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:43.005785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-cad8f8b5-3f3d-4925-826a-e26577dcc20f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aaee68a65f44f78ac982a20110a291c', 'request_id': 'req-cad8f8b5-3f3d-4925-826a-e26577dcc20f'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:43.015186 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:43.021972 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-cad8f8b5-3f3d-4925-826a-e26577dcc20f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aaee68a65f44f78ac982a20110a291c', 'request_id': 'req-cad8f8b5-3f3d-4925-826a-e26577dcc20f'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:43.053300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7555dd9-2e8b-4d7a-9a55-43a855520318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:43.053754 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-cad8f8b5-3f3d-4925-826a-e26577dcc20f admin admin] The token cache is being invalidate because project 8aaee68a65f44f78ac982a20110a291c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:43.054050 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-cad8f8b5-3f3d-4925-826a-e26577dcc20f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:43.054743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-cad8f8b5-3f3d-4925-826a-e26577dcc20f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:43.055406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7555dd9-2e8b-4d7a-9a55-43a855520318 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.056599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7555dd9-2e8b-4d7a-9a55-43a855520318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.056712 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 909/1830] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:42 2022] DELETE /identity/v3/projects/8aaee68a65f44f78ac982a20110a291c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:43.057258 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7555dd9-2e8b-4d7a-9a55-43a855520318 admin admin] PATH_INFO: `/v3/projects/0062e071f4f7459ba3cabb746eddb4af/users/e286fd93cfad4c2ea15bf432fa33ea73/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.063611 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11208ed-bdb3-49db-bbf2-c84e40915413 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.064287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11208ed-bdb3-49db-bbf2-c84e40915413 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.064287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11208ed-bdb3-49db-bbf2-c84e40915413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.079352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7555dd9-2e8b-4d7a-9a55-43a855520318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0062e071f4f7459ba3cabb746eddb4af, user_id=e286fd93cfad4c2ea15bf432fa33ea73, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:43.085492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-f11208ed-bdb3-49db-bbf2-c84e40915413 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:43.086711 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f11208ed-bdb3-49db-bbf2-c84e40915413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:43.093619 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7555dd9-2e8b-4d7a-9a55-43a855520318 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:43.103853 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 910/1831] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:43.103853 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11208ed-bdb3-49db-bbf2-c84e40915413 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:43.106080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f11208ed-bdb3-49db-bbf2-c84e40915413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:43.116940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 922/1832] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:42 2022] PUT /identity/v3/projects/0062e071f4f7459ba3cabb746eddb4af/users/e286fd93cfad4c2ea15bf432fa33ea73/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:43.118333 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0971a3-25a3-4384-a3ce-86014b564560 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.118818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0971a3-25a3-4384-a3ce-86014b564560 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.119109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0971a3-25a3-4384-a3ce-86014b564560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.122855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11208ed-bdb3-49db-bbf2-c84e40915413 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:43.143320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6a0971a3-25a3-4384-a3ce-86014b564560 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:43.144986 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6a0971a3-25a3-4384-a3ce-86014b564560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:43.190394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f885ae-c334-4ac2-a755-2357df3e83c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:43.191820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f885ae-c334-4ac2-a755-2357df3e83c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.192348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f885ae-c334-4ac2-a755-2357df3e83c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.192826 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f885ae-c334-4ac2-a755-2357df3e83c5 admin admin] PATH_INFO: `/v3/projects/44ba655f9e6649249f2252c2da4be481` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.194219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f885ae-c334-4ac2-a755-2357df3e83c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44ba655f9e6649249f2252c2da4be481)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:43.196421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f885ae-c334-4ac2-a755-2357df3e83c5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:43.210204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 923/1833] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:43.211489 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ca54f-ef07-4ed5-af21-92528d1a507d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.211854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ca54f-ef07-4ed5-af21-92528d1a507d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.212203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ca54f-ef07-4ed5-af21-92528d1a507d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.245011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5c3ca54f-ef07-4ed5-af21-92528d1a507d None None] MFA Rules not processed for user `e286fd93cfad4c2ea15bf432fa33ea73`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:43.246844 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5c3ca54f-ef07-4ed5-af21-92528d1a507d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:43.270573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a8f885ae-c334-4ac2-a755-2357df3e83c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ba655f9e6649249f2252c2da4be481', 'request_id': 'req-a8f885ae-c334-4ac2-a755-2357df3e83c5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:43.282982 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a8f885ae-c334-4ac2-a755-2357df3e83c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ba655f9e6649249f2252c2da4be481', 'request_id': 'req-a8f885ae-c334-4ac2-a755-2357df3e83c5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:43.296614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a8f885ae-c334-4ac2-a755-2357df3e83c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ba655f9e6649249f2252c2da4be481', 'request_id': 'req-a8f885ae-c334-4ac2-a755-2357df3e83c5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:43.319334 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a8f885ae-c334-4ac2-a755-2357df3e83c5 admin admin] The token cache is being invalidate because project 44ba655f9e6649249f2252c2da4be481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:43.319642 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a8f885ae-c334-4ac2-a755-2357df3e83c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:43.320359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a8f885ae-c334-4ac2-a755-2357df3e83c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:43.325887 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 911/1834] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:43 2022] DELETE /identity/v3/projects/44ba655f9e6649249f2252c2da4be481 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:43.325887 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f885ae-c334-4ac2-a755-2357df3e83c5 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:43.325887 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a8f885ae-c334-4ac2-a755-2357df3e83c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:43.339721 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 924/1835] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:43.345057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45fac7-179d-471c-8644-fb84bc940e80 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.345511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45fac7-179d-471c-8644-fb84bc940e80 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.345803 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45fac7-179d-471c-8644-fb84bc940e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.365422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bb45fac7-179d-471c-8644-fb84bc940e80 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:43.366886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bb45fac7-179d-471c-8644-fb84bc940e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:43.371893 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:43.401392 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f885ae-c334-4ac2-a755-2357df3e83c5 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:43.410659 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ddf15-38ef-41cc-9cc9-6f3c4a1113cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:43.411523 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ddf15-38ef-41cc-9cc9-6f3c4a1113cf admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.411876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ddf15-38ef-41cc-9cc9-6f3c4a1113cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.412070 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ddf15-38ef-41cc-9cc9-6f3c4a1113cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.412949 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ddf15-38ef-41cc-9cc9-6f3c4a1113cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:19:43.421757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ddf15-38ef-41cc-9cc9-6f3c4a1113cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:43.426083 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ddf15-38ef-41cc-9cc9-6f3c4a1113cf admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:43.441327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 912/1836] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:19:43.442384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ddf15-38ef-41cc-9cc9-6f3c4a1113cf admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:43.444597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a06ddf15-38ef-41cc-9cc9-6f3c4a1113cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:43.450177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 925/1837] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:43.451005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45fac7-179d-471c-8644-fb84bc940e80 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:43.453577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:43.459318 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ddf15-38ef-41cc-9cc9-6f3c4a1113cf admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:43.461150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45fac7-179d-471c-8644-fb84bc940e80 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:43.466060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcd51c-cc43-424b-be89-090e7bdd7120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:43.466224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213ba87-9904-48d2-aa8e-b8c7257fa2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:43.466730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcd51c-cc43-424b-be89-090e7bdd7120 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.466830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213ba87-9904-48d2-aa8e-b8c7257fa2cd admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.467014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcd51c-cc43-424b-be89-090e7bdd7120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.467109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213ba87-9904-48d2-aa8e-b8c7257fa2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.467294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcd51c-cc43-424b-be89-090e7bdd7120 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.467401 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213ba87-9904-48d2-aa8e-b8c7257fa2cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.467983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcd51c-cc43-424b-be89-090e7bdd7120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:43.468081 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213ba87-9904-48d2-aa8e-b8c7257fa2cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:43.470102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcd51c-cc43-424b-be89-090e7bdd7120 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:43.470439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213ba87-9904-48d2-aa8e-b8c7257fa2cd admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:43.509056 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 926/1838] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:43 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:43.509271 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 913/1839] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:43 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:43.509398 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e2171-6b8f-4860-a1ed-07cff867012c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.509398 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e2171-6b8f-4860-a1ed-07cff867012c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.509398 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e2171-6b8f-4860-a1ed-07cff867012c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.509593 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213ba87-9904-48d2-aa8e-b8c7257fa2cd admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:43.526560 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3d2e2171-6b8f-4860-a1ed-07cff867012c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:43.527803 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3d2e2171-6b8f-4860-a1ed-07cff867012c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:43.568921 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213ba87-9904-48d2-aa8e-b8c7257fa2cd admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:43.599734 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 927/1840] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:43.600702 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e2171-6b8f-4860-a1ed-07cff867012c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:43.611486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e2171-6b8f-4860-a1ed-07cff867012c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:43.621020 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162786a-5732-4190-9f86-4e424790c43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:43.621716 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162786a-5732-4190-9f86-4e424790c43e admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.622008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162786a-5732-4190-9f86-4e424790c43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.622356 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162786a-5732-4190-9f86-4e424790c43e admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.622984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162786a-5732-4190-9f86-4e424790c43e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:43.625004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162786a-5732-4190-9f86-4e424790c43e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:43.648860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc1ea3-c73a-4c0a-a9ef-f6c90914a6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:43.649544 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc1ea3-c73a-4c0a-a9ef-f6c90914a6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.650016 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc1ea3-c73a-4c0a-a9ef-f6c90914a6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.650320 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc1ea3-c73a-4c0a-a9ef-f6c90914a6d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.651010 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc1ea3-c73a-4c0a-a9ef-f6c90914a6d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:43.654082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 928/1841] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:43 2022] POST /identity/v3/users => generated 300 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:43.654082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162786a-5732-4190-9f86-4e424790c43e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:43.654286 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc1ea3-c73a-4c0a-a9ef-f6c90914a6d5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:43.663562 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162786a-5732-4190-9f86-4e424790c43e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:43.683053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effea7a-9802-4678-932b-34ef5dbcd3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:43.684128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effea7a-9802-4678-932b-34ef5dbcd3cb admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.684527 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effea7a-9802-4678-932b-34ef5dbcd3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.684808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effea7a-9802-4678-932b-34ef5dbcd3cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.685636 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effea7a-9802-4678-932b-34ef5dbcd3cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:19:43.685957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effea7a-9802-4678-932b-34ef5dbcd3cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:43.689631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 914/1842] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:43 2022] POST /identity/v3/users => generated 296 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:19:43.689631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc1ea3-c73a-4c0a-a9ef-f6c90914a6d5 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:43.689820 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effea7a-9802-4678-932b-34ef5dbcd3cb admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:43.699496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc1ea3-c73a-4c0a-a9ef-f6c90914a6d5 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:43.704709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 929/1843] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:19:43.705723 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effea7a-9802-4678-932b-34ef5dbcd3cb admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:43.706853 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd0b2a-f786-48cb-b6ed-7c0f5273c8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:43.708345 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd0b2a-f786-48cb-b6ed-7c0f5273c8bf admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.708757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd0b2a-f786-48cb-b6ed-7c0f5273c8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.709143 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd0b2a-f786-48cb-b6ed-7c0f5273c8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.710025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd0b2a-f786-48cb-b6ed-7c0f5273c8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:43.711857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd0b2a-f786-48cb-b6ed-7c0f5273c8bf admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:43.722470 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effea7a-9802-4678-932b-34ef5dbcd3cb admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:43.729062 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 915/1844] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:43.730083 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd0b2a-f786-48cb-b6ed-7c0f5273c8bf admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:43.732129 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b448c8a-9f4a-42a8-937d-a5c4d5fb12be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:43.733131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b448c8a-9f4a-42a8-937d-a5c4d5fb12be admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.733705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b448c8a-9f4a-42a8-937d-a5c4d5fb12be admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.734060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b448c8a-9f4a-42a8-937d-a5c4d5fb12be admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.734985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b448c8a-9f4a-42a8-937d-a5c4d5fb12be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:43.737125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b448c8a-9f4a-42a8-937d-a5c4d5fb12be admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:43.742204 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd0b2a-f786-48cb-b6ed-7c0f5273c8bf admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:43.748604 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c0fec-cb60-43b1-903d-87ec4206cd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:43.749277 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c0fec-cb60-43b1-903d-87ec4206cd9e admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.749559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c0fec-cb60-43b1-903d-87ec4206cd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.749833 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c0fec-cb60-43b1-903d-87ec4206cd9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.750522 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c0fec-cb60-43b1-903d-87ec4206cd9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:43.752608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c0fec-cb60-43b1-903d-87ec4206cd9e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:43.763956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 930/1845] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:43.768307 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b448c8a-9f4a-42a8-937d-a5c4d5fb12be admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:43.795980 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 916/1846] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:43 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:43.797267 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c0fec-cb60-43b1-903d-87ec4206cd9e admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:43.798938 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b448c8a-9f4a-42a8-937d-a5c4d5fb12be admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:43.892379 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:43.894233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:43.913684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c0fec-cb60-43b1-903d-87ec4206cd9e admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:43.919365 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1028c-0aec-4299-a12c-b181541a21a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:43.920698 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1028c-0aec-4299-a12c-b181541a21a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.921052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1028c-0aec-4299-a12c-b181541a21a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.921406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1028c-0aec-4299-a12c-b181541a21a5 admin admin] PATH_INFO: `/v3/projects/5ca0c5691e43446298b1c8305e0ba06f/users/59addc83176d4506817c45adcee063e6/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.925087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea950d-78d0-4093-91cb-4e01e55b0f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:43.927736 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea950d-78d0-4093-91cb-4e01e55b0f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:43.928717 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea950d-78d0-4093-91cb-4e01e55b0f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:43.930594 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea950d-78d0-4093-91cb-4e01e55b0f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:43.932051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea950d-78d0-4093-91cb-4e01e55b0f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:43.935834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea950d-78d0-4093-91cb-4e01e55b0f78 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:43.941798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1028c-0aec-4299-a12c-b181541a21a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca0c5691e43446298b1c8305e0ba06f, user_id=59addc83176d4506817c45adcee063e6, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:43.945517 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1028c-0aec-4299-a12c-b181541a21a5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:43.958341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 931/1847] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:43.959240 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea950d-78d0-4093-91cb-4e01e55b0f78 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:43.971426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea950d-78d0-4093-91cb-4e01e55b0f78 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:43.989208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 917/1848] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:43 2022] PUT /identity/v3/projects/5ca0c5691e43446298b1c8305e0ba06f/users/59addc83176d4506817c45adcee063e6/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:43.989912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1028c-0aec-4299-a12c-b181541a21a5 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:44.125184 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02d8f3-b29a-4f6f-8fed-5336e1cbb400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:44.126010 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02d8f3-b29a-4f6f-8fed-5336e1cbb400 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:44.126362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02d8f3-b29a-4f6f-8fed-5336e1cbb400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:44.126642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02d8f3-b29a-4f6f-8fed-5336e1cbb400 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:44.127354 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02d8f3-b29a-4f6f-8fed-5336e1cbb400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:44.128813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1028c-0aec-4299-a12c-b181541a21a5 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:44.130203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02d8f3-b29a-4f6f-8fed-5336e1cbb400 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:44.138394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696f652-fe14-4e59-8dd6-1c3d9c5e8f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:44.139387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696f652-fe14-4e59-8dd6-1c3d9c5e8f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:44.139682 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696f652-fe14-4e59-8dd6-1c3d9c5e8f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:44.139963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696f652-fe14-4e59-8dd6-1c3d9c5e8f28 admin admin] PATH_INFO: `/v3/projects/a5a88ae9d3de414d899bad38211fa252/users/c2b20dc0180e48ae8080715b1a1e9d06/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:44.173708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696f652-fe14-4e59-8dd6-1c3d9c5e8f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a88ae9d3de414d899bad38211fa252, user_id=c2b20dc0180e48ae8080715b1a1e9d06, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:44.179244 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696f652-fe14-4e59-8dd6-1c3d9c5e8f28 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:44.182178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 932/1849] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:43 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:44.183287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02d8f3-b29a-4f6f-8fed-5336e1cbb400 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:44.210110 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02d8f3-b29a-4f6f-8fed-5336e1cbb400 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:44.223977 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 918/1850] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:43 2022] PUT /identity/v3/projects/a5a88ae9d3de414d899bad38211fa252/users/c2b20dc0180e48ae8080715b1a1e9d06/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:44.225327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696f652-fe14-4e59-8dd6-1c3d9c5e8f28 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:44.325220 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8438d-3552-415f-b781-fb3ee7b43acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:44.326036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8438d-3552-415f-b781-fb3ee7b43acb admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:44.326420 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8438d-3552-415f-b781-fb3ee7b43acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:44.326800 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8438d-3552-415f-b781-fb3ee7b43acb admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:44.327635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8438d-3552-415f-b781-fb3ee7b43acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:44.329852 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8438d-3552-415f-b781-fb3ee7b43acb admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:44.342097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696f652-fe14-4e59-8dd6-1c3d9c5e8f28 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:44.344314 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 933/1851] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:44.345604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bab93e-17b2-4412-a62c-b422f628ddda None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:44.346003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bab93e-17b2-4412-a62c-b422f628ddda None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:44.346375 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bab93e-17b2-4412-a62c-b422f628ddda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:44.349300 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ad68d-a728-4f76-a295-46f790ba2eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:44.350218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ad68d-a728-4f76-a295-46f790ba2eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:44.350734 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ad68d-a728-4f76-a295-46f790ba2eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:44.351037 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ad68d-a728-4f76-a295-46f790ba2eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:44.351882 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ad68d-a728-4f76-a295-46f790ba2eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:44.354838 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ad68d-a728-4f76-a295-46f790ba2eaa admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:44.368415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 919/1852] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:44.369603 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ad68d-a728-4f76-a295-46f790ba2eaa admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:44.381287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f1bab93e-17b2-4412-a62c-b422f628ddda None None] MFA Rules not processed for user `c2b20dc0180e48ae8080715b1a1e9d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:44.382529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ad68d-a728-4f76-a295-46f790ba2eaa admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:44.382797 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f1bab93e-17b2-4412-a62c-b422f628ddda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:44.392028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3a91c-ac67-425a-8055-3acbab0736cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:44.392853 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3a91c-ac67-425a-8055-3acbab0736cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:44.393187 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3a91c-ac67-425a-8055-3acbab0736cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:44.393468 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3a91c-ac67-425a-8055-3acbab0736cf admin admin] PATH_INFO: `/v3/projects/5ca0c5691e43446298b1c8305e0ba06f/users/59addc83176d4506817c45adcee063e6/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:44.395972 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3a91c-ac67-425a-8055-3acbab0736cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca0c5691e43446298b1c8305e0ba06f, user_id=59addc83176d4506817c45adcee063e6, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:44.399600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3a91c-ac67-425a-8055-3acbab0736cf admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:44.420843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 920/1853] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:44 2022] PUT /identity/v3/projects/5ca0c5691e43446298b1c8305e0ba06f/users/59addc83176d4506817c45adcee063e6/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:44.423658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3a91c-ac67-425a-8055-3acbab0736cf admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:44.473586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:44.486937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 934/1854] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:44.487901 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b1f63-8008-4e57-9281-6b79a4a56fa5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:44.488196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b1f63-8008-4e57-9281-6b79a4a56fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:44.488500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b1f63-8008-4e57-9281-6b79a4a56fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:44.500063 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:44.538507 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3a91c-ac67-425a-8055-3acbab0736cf admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:44.542658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ad4b1f63-8008-4e57-9281-6b79a4a56fa5 None None] MFA Rules not processed for user `59addc83176d4506817c45adcee063e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:44.544236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ad4b1f63-8008-4e57-9281-6b79a4a56fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:44.544696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51770a2b-8bf8-4dfd-82a2-e4a9a66c1c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:44.545378 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51770a2b-8bf8-4dfd-82a2-e4a9a66c1c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:44.545754 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51770a2b-8bf8-4dfd-82a2-e4a9a66c1c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:44.546047 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51770a2b-8bf8-4dfd-82a2-e4a9a66c1c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:44.546778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51770a2b-8bf8-4dfd-82a2-e4a9a66c1c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:44.548590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51770a2b-8bf8-4dfd-82a2-e4a9a66c1c7f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:44.569832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 921/1855] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:44.569832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51770a2b-8bf8-4dfd-82a2-e4a9a66c1c7f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:44.592018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51770a2b-8bf8-4dfd-82a2-e4a9a66c1c7f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:44.597588 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421413a-1a86-4ab8-9092-bb5d8494db23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:44.598350 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421413a-1a86-4ab8-9092-bb5d8494db23 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:44.598706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421413a-1a86-4ab8-9092-bb5d8494db23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:44.599049 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421413a-1a86-4ab8-9092-bb5d8494db23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:44.599813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421413a-1a86-4ab8-9092-bb5d8494db23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:44.601832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421413a-1a86-4ab8-9092-bb5d8494db23 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:44.632310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 922/1856] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:44 2022] POST /identity/v3/projects => generated 399 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:44.632310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421413a-1a86-4ab8-9092-bb5d8494db23 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:44.665360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 935/1857] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:44.667723 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b1f63-8008-4e57-9281-6b79a4a56fa5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:44.690114 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b1f63-8008-4e57-9281-6b79a4a56fa5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:44.713268 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421413a-1a86-4ab8-9092-bb5d8494db23 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:44.718750 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42619de-b4b9-4f90-a9b2-1217b042e4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:44.719655 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42619de-b4b9-4f90-a9b2-1217b042e4ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:44.719944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42619de-b4b9-4f90-a9b2-1217b042e4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:44.720227 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42619de-b4b9-4f90-a9b2-1217b042e4ea admin admin] PATH_INFO: `/v3/projects/5b68c163d6d04e7795b197bf528fa297/users/d70f292b1d45467491e316aa81fe69fe/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:44.737233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42619de-b4b9-4f90-a9b2-1217b042e4ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b68c163d6d04e7795b197bf528fa297, user_id=d70f292b1d45467491e316aa81fe69fe, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:44.740578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42619de-b4b9-4f90-a9b2-1217b042e4ea admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:44.760000 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 923/1858] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:44 2022] PUT /identity/v3/projects/5b68c163d6d04e7795b197bf528fa297/users/d70f292b1d45467491e316aa81fe69fe/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:44.762600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42619de-b4b9-4f90-a9b2-1217b042e4ea admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:44.763233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e42619de-b4b9-4f90-a9b2-1217b042e4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:44.766881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8f567-c96f-44df-92e9-b88bef804fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:44.767574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8f567-c96f-44df-92e9-b88bef804fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:44.768478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8f567-c96f-44df-92e9-b88bef804fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:44.768478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8f567-c96f-44df-92e9-b88bef804fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:44.768912 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8f567-c96f-44df-92e9-b88bef804fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:44.770976 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8f567-c96f-44df-92e9-b88bef804fa4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:44.793992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 936/1859] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:44 2022] POST /identity/v3/users => generated 306 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:44.795439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a7c06-6ad5-4292-8d29-054fe5a8cee1 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:44.795721 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a7c06-6ad5-4292-8d29-054fe5a8cee1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:44.796001 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a7c06-6ad5-4292-8d29-054fe5a8cee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:44.825189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e31a7c06-6ad5-4292-8d29-054fe5a8cee1 None None] MFA Rules not processed for user `d70f292b1d45467491e316aa81fe69fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:44.826470 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e31a7c06-6ad5-4292-8d29-054fe5a8cee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:44.828804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42619de-b4b9-4f90-a9b2-1217b042e4ea admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:44.832981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ce845-4674-44ae-9ec4-f5fa518c4acd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:44.833644 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ce845-4674-44ae-9ec4-f5fa518c4acd service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:44.833938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ce845-4674-44ae-9ec4-f5fa518c4acd service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:44.834314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ce845-4674-44ae-9ec4-f5fa518c4acd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:44.883754 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:44.894880 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 937/1860] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:44.896340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a7c06-6ad5-4292-8d29-054fe5a8cee1 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:44.900931 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:44.907641 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ce845-4674-44ae-9ec4-f5fa518c4acd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:44.909581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ce845-4674-44ae-9ec4-f5fa518c4acd service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:44.920301 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 924/1861] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:44.920648 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ce845-4674-44ae-9ec4-f5fa518c4acd service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:44.974094 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a7c06-6ad5-4292-8d29-054fe5a8cee1 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:44.979733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b429af-0bcf-4c7e-aae6-363421b35347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:44.980459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b429af-0bcf-4c7e-aae6-363421b35347 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:44.980744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b429af-0bcf-4c7e-aae6-363421b35347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:44.981024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b429af-0bcf-4c7e-aae6-363421b35347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:44.981860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b429af-0bcf-4c7e-aae6-363421b35347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:44.983535 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b429af-0bcf-4c7e-aae6-363421b35347 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:44.995237 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ce845-4674-44ae-9ec4-f5fa518c4acd service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:44.996754 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 938/1862] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:45.000898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56647136-ca47-4a96-adf7-bca42b22794a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:45.001082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b429af-0bcf-4c7e-aae6-363421b35347 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:45.001574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647136-ca47-4a96-adf7-bca42b22794a admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:45.001854 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647136-ca47-4a96-adf7-bca42b22794a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:45.002127 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647136-ca47-4a96-adf7-bca42b22794a admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:45.002946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56647136-ca47-4a96-adf7-bca42b22794a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:45.004875 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56647136-ca47-4a96-adf7-bca42b22794a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:45.014565 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b429af-0bcf-4c7e-aae6-363421b35347 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:45.022264 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2a977-2b72-4d42-bfa3-8985d11e9df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:45.023312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2a977-2b72-4d42-bfa3-8985d11e9df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:45.023605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2a977-2b72-4d42-bfa3-8985d11e9df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:45.023887 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2a977-2b72-4d42-bfa3-8985d11e9df0 admin admin] PATH_INFO: `/v3/projects/33e3c062d2c8439e960c6d677bb0b234/users/850ecc0c5f9a401e86d82c9a2f842b49/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:45.042744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 925/1863] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:44 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:45.046922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56647136-ca47-4a96-adf7-bca42b22794a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:45.047073 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2a977-2b72-4d42-bfa3-8985d11e9df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e3c062d2c8439e960c6d677bb0b234, user_id=850ecc0c5f9a401e86d82c9a2f842b49, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:45.050267 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2a977-2b72-4d42-bfa3-8985d11e9df0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:45.064394 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 939/1864] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:45 2022] PUT /identity/v3/projects/33e3c062d2c8439e960c6d677bb0b234/users/850ecc0c5f9a401e86d82c9a2f842b49/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:45.068209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2a977-2b72-4d42-bfa3-8985d11e9df0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:45.135679 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56647136-ca47-4a96-adf7-bca42b22794a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:45.157412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2a977-2b72-4d42-bfa3-8985d11e9df0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:45.162704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec07b4-ceb6-4105-b833-9b4f3deb7b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:45.163378 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec07b4-ceb6-4105-b833-9b4f3deb7b90 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:45.163667 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec07b4-ceb6-4105-b833-9b4f3deb7b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:45.163946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec07b4-ceb6-4105-b833-9b4f3deb7b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:45.164710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec07b4-ceb6-4105-b833-9b4f3deb7b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:45.166333 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec07b4-ceb6-4105-b833-9b4f3deb7b90 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:45.178148 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 940/1865] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:45.182402 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec07b4-ceb6-4105-b833-9b4f3deb7b90 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:45.192143 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec07b4-ceb6-4105-b833-9b4f3deb7b90 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:45.197724 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106af912-2bff-4c46-bb5a-9a72f29aaea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:45.198526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106af912-2bff-4c46-bb5a-9a72f29aaea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:45.198809 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106af912-2bff-4c46-bb5a-9a72f29aaea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:45.199084 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106af912-2bff-4c46-bb5a-9a72f29aaea9 admin admin] PATH_INFO: `/v3/projects/33e3c062d2c8439e960c6d677bb0b234/users/850ecc0c5f9a401e86d82c9a2f842b49/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:45.201826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106af912-2bff-4c46-bb5a-9a72f29aaea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e3c062d2c8439e960c6d677bb0b234, user_id=850ecc0c5f9a401e86d82c9a2f842b49, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:45.203818 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1e2c1-e273-4dce-9f82-a8c59f845792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:45.204175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106af912-2bff-4c46-bb5a-9a72f29aaea9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:45.204871 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1e2c1-e273-4dce-9f82-a8c59f845792 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:45.205316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1e2c1-e273-4dce-9f82-a8c59f845792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:45.205776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1e2c1-e273-4dce-9f82-a8c59f845792 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:45.206893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1e2c1-e273-4dce-9f82-a8c59f845792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:45.209834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1e2c1-e273-4dce-9f82-a8c59f845792 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:45.216332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 941/1866] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:45 2022] PUT /identity/v3/projects/33e3c062d2c8439e960c6d677bb0b234/users/850ecc0c5f9a401e86d82c9a2f842b49/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:45.227091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39e527-8dfc-4e74-8617-aef42d6257f4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:45.227476 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39e527-8dfc-4e74-8617-aef42d6257f4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:45.227799 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39e527-8dfc-4e74-8617-aef42d6257f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:45.239325 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 926/1867] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:45 2022] POST /identity/v3/users => generated 300 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:45.243457 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1e2c1-e273-4dce-9f82-a8c59f845792 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:45.252782 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:45.258953 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1e2c1-e273-4dce-9f82-a8c59f845792 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:45.259842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8c39e527-8dfc-4e74-8617-aef42d6257f4 None None] MFA Rules not processed for user `850ecc0c5f9a401e86d82c9a2f842b49`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:45.261107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8c39e527-8dfc-4e74-8617-aef42d6257f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:45.311671 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:45.333076 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758eb43-e553-4c8d-8056-6c92eff88648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:45.334352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758eb43-e553-4c8d-8056-6c92eff88648 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:45.335335 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758eb43-e553-4c8d-8056-6c92eff88648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:45.335642 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758eb43-e553-4c8d-8056-6c92eff88648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:45.336539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758eb43-e553-4c8d-8056-6c92eff88648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:45.338450 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758eb43-e553-4c8d-8056-6c92eff88648 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:45.349792 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 942/1868] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:45 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:19:45.349792 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39e527-8dfc-4e74-8617-aef42d6257f4 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:45.361028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 927/1869] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:19:45.361939 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758eb43-e553-4c8d-8056-6c92eff88648 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:45.378379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758eb43-e553-4c8d-8056-6c92eff88648 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:45.388528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2491a-91f9-4389-80fb-73b65d83f478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:45.388528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2491a-91f9-4389-80fb-73b65d83f478 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:45.388528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2491a-91f9-4389-80fb-73b65d83f478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:45.388528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2491a-91f9-4389-80fb-73b65d83f478 admin admin] PATH_INFO: `/v3/projects/ef4618c00cee46568d26b58a6fbb28e9/users/12c8206fbe4b49c8b0b460f0b565899d/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:45.408515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2491a-91f9-4389-80fb-73b65d83f478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4618c00cee46568d26b58a6fbb28e9, user_id=12c8206fbe4b49c8b0b460f0b565899d, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:45.412101 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2491a-91f9-4389-80fb-73b65d83f478 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:45.427936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 928/1870] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:45 2022] PUT /identity/v3/projects/ef4618c00cee46568d26b58a6fbb28e9/users/12c8206fbe4b49c8b0b460f0b565899d/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:45.429422 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2491a-91f9-4389-80fb-73b65d83f478 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:45.432039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-15e2491a-91f9-4389-80fb-73b65d83f478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:45.433984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39e527-8dfc-4e74-8617-aef42d6257f4 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:45.507964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2491a-91f9-4389-80fb-73b65d83f478 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:45.514988 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb25be-77b7-4367-accf-65b37f52e3df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:45.515669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb25be-77b7-4367-accf-65b37f52e3df service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:45.515985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb25be-77b7-4367-accf-65b37f52e3df service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:45.516461 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb25be-77b7-4367-accf-65b37f52e3df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:45.516632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f7eb0-3f1a-4aa7-b463-e747f2c3a27c tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59addc83176d4506817c45adcee063e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ca0c5691e43446298b1c8305e0ba06f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:45.519962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f7eb0-3f1a-4aa7-b463-e747f2c3a27c tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:45.520294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f7eb0-3f1a-4aa7-b463-e747f2c3a27c tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:45.520587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f7eb0-3f1a-4aa7-b463-e747f2c3a27c tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:45.522224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f7eb0-3f1a-4aa7-b463-e747f2c3a27c tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:19:45.524267 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f7eb0-3f1a-4aa7-b463-e747f2c3a27c tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:45.528108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f7eb0-3f1a-4aa7-b463-e747f2c3a27c tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:45.543588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 943/1871] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:19:45.544519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f7eb0-3f1a-4aa7-b463-e747f2c3a27c tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:45.644049 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb25be-77b7-4367-accf-65b37f52e3df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:45.646539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb25be-77b7-4367-accf-65b37f52e3df service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:45.685826 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 929/1872] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:45 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:45.685826 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb25be-77b7-4367-accf-65b37f52e3df service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:45.707684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb25be-77b7-4367-accf-65b37f52e3df service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:45.710473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f7eb0-3f1a-4aa7-b463-e747f2c3a27c tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:45.714020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679cbfc-6d09-46f3-9ab9-74fc86d2baae tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59addc83176d4506817c45adcee063e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ca0c5691e43446298b1c8305e0ba06f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:45.714798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679cbfc-6d09-46f3-9ab9-74fc86d2baae tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:45.715165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679cbfc-6d09-46f3-9ab9-74fc86d2baae tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:45.715453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679cbfc-6d09-46f3-9ab9-74fc86d2baae tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:45.716327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679cbfc-6d09-46f3-9ab9-74fc86d2baae tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:45.718621 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679cbfc-6d09-46f3-9ab9-74fc86d2baae tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:45.726497 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6d713-3e7c-4d80-88c9-f9c58f50c3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:45.732610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6d713-3e7c-4d80-88c9-f9c58f50c3fd admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:45.732610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6d713-3e7c-4d80-88c9-f9c58f50c3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:45.732610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6d713-3e7c-4d80-88c9-f9c58f50c3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:45.732610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6d713-3e7c-4d80-88c9-f9c58f50c3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:45.736392 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6d713-3e7c-4d80-88c9-f9c58f50c3fd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:45.758871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 944/1873] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:45.764053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6d713-3e7c-4d80-88c9-f9c58f50c3fd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:45.770739 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 930/1874] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:45 2022] POST /identity/v3/projects => generated 354 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:45.771579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679cbfc-6d09-46f3-9ab9-74fc86d2baae tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:45.780668 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:45.786597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6d713-3e7c-4d80-88c9-f9c58f50c3fd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:45.817117 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:45.867936 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee2bc5-5b5b-432c-82d3-611037f9d047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:45.869006 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee2bc5-5b5b-432c-82d3-611037f9d047 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:45.869484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee2bc5-5b5b-432c-82d3-611037f9d047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:45.869988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee2bc5-5b5b-432c-82d3-611037f9d047 admin admin] PATH_INFO: `/v3/projects/ef4618c00cee46568d26b58a6fbb28e9/users/12c8206fbe4b49c8b0b460f0b565899d/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:45.871459 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679cbfc-6d09-46f3-9ab9-74fc86d2baae tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:45.873828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee2bc5-5b5b-432c-82d3-611037f9d047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4618c00cee46568d26b58a6fbb28e9, user_id=12c8206fbe4b49c8b0b460f0b565899d, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:45.876720 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee2bc5-5b5b-432c-82d3-611037f9d047 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:45.877990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80334e42-f738-4251-81cb-81fe6dda4a53 tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59addc83176d4506817c45adcee063e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ca0c5691e43446298b1c8305e0ba06f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:45.879030 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80334e42-f738-4251-81cb-81fe6dda4a53 tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:45.879511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80334e42-f738-4251-81cb-81fe6dda4a53 tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:45.879979 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80334e42-f738-4251-81cb-81fe6dda4a53 tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:45.880945 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80334e42-f738-4251-81cb-81fe6dda4a53 tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:19:45.881331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80334e42-f738-4251-81cb-81fe6dda4a53 tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:45.883138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80334e42-f738-4251-81cb-81fe6dda4a53 tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:45.889124 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 945/1875] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:45 2022] PUT /identity/v3/projects/ef4618c00cee46568d26b58a6fbb28e9/users/12c8206fbe4b49c8b0b460f0b565899d/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:45.889991 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee2bc5-5b5b-432c-82d3-611037f9d047 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:45.903702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 931/1876] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:19:45.905160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceff6f2-7dd5-45b3-bf05-d1ebd9a20ced None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:45.905525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceff6f2-7dd5-45b3-bf05-d1ebd9a20ced None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:45.905946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceff6f2-7dd5-45b3-bf05-d1ebd9a20ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:45.940922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3ceff6f2-7dd5-45b3-bf05-d1ebd9a20ced None None] MFA Rules not processed for user `12c8206fbe4b49c8b0b460f0b565899d`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:45.942475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3ceff6f2-7dd5-45b3-bf05-d1ebd9a20ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:45.967080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee2bc5-5b5b-432c-82d3-611037f9d047 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:45.972611 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244884b7-7607-4762-a39a-395c8453b3cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:45.973407 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244884b7-7607-4762-a39a-395c8453b3cf service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:45.973849 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244884b7-7607-4762-a39a-395c8453b3cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:45.974200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244884b7-7607-4762-a39a-395c8453b3cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:46.032756 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 932/1877] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:46.033742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceff6f2-7dd5-45b3-bf05-d1ebd9a20ced None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:46.042721 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244884b7-7607-4762-a39a-395c8453b3cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:46.044365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244884b7-7607-4762-a39a-395c8453b3cf service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:46.053412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 946/1878] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:46.054225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244884b7-7607-4762-a39a-395c8453b3cf service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:46.063236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244884b7-7607-4762-a39a-395c8453b3cf service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:46.067148 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b95f7-d61a-4242-8a61-47220d4963dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:46.068326 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b95f7-d61a-4242-8a61-47220d4963dd service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:46.068326 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b95f7-d61a-4242-8a61-47220d4963dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:46.068540 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b95f7-d61a-4242-8a61-47220d4963dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:46.078529 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b95f7-d61a-4242-8a61-47220d4963dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:46.079955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b95f7-d61a-4242-8a61-47220d4963dd service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:46.090426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 947/1879] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:46.099749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceff6f2-7dd5-45b3-bf05-d1ebd9a20ced None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:46.112455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a5ca8-3e37-4410-a2e2-af076233bd3a tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59addc83176d4506817c45adcee063e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ca0c5691e43446298b1c8305e0ba06f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:46.112455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a5ca8-3e37-4410-a2e2-af076233bd3a tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:46.112455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a5ca8-3e37-4410-a2e2-af076233bd3a tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:46.112753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a5ca8-3e37-4410-a2e2-af076233bd3a tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] PATH_INFO: `/v3/projects/60d75abded824946a44935abe4890dcb` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:46.112753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a5ca8-3e37-4410-a2e2-af076233bd3a tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] RBAC: Authorizing `identity:delete_project(project_id=60d75abded824946a44935abe4890dcb)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:46.113128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a5ca8-3e37-4410-a2e2-af076233bd3a tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:46.153526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:46.177607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-546a5ca8-3e37-4410-a2e2-af076233bd3a tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d75abded824946a44935abe4890dcb', 'request_id': 'req-546a5ca8-3e37-4410-a2e2-af076233bd3a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:46.187025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-546a5ca8-3e37-4410-a2e2-af076233bd3a tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d75abded824946a44935abe4890dcb', 'request_id': 'req-546a5ca8-3e37-4410-a2e2-af076233bd3a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:46.195822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-546a5ca8-3e37-4410-a2e2-af076233bd3a tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d75abded824946a44935abe4890dcb', 'request_id': 'req-546a5ca8-3e37-4410-a2e2-af076233bd3a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:46.215728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-546a5ca8-3e37-4410-a2e2-af076233bd3a tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] The token cache is being invalidate because project 60d75abded824946a44935abe4890dcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:46.216039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-546a5ca8-3e37-4410-a2e2-af076233bd3a tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:46.216759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-546a5ca8-3e37-4410-a2e2-af076233bd3a tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:46.219115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 933/1880] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:46 2022] DELETE /identity/v3/projects/60d75abded824946a44935abe4890dcb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:46.233427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b95f7-d61a-4242-8a61-47220d4963dd service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:46.305477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:46.311893 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b95f7-d61a-4242-8a61-47220d4963dd service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:46.390443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188ac45-523a-445d-a975-d76edc52f565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:46.391652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188ac45-523a-445d-a975-d76edc52f565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:46.392095 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188ac45-523a-445d-a975-d76edc52f565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:46.393002 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188ac45-523a-445d-a975-d76edc52f565 admin admin] PATH_INFO: `/v3/users/d70f292b1d45467491e316aa81fe69fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:46.394788 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188ac45-523a-445d-a975-d76edc52f565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70f292b1d45467491e316aa81fe69fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:46.396715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188ac45-523a-445d-a975-d76edc52f565 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:46.455835 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2188ac45-523a-445d-a975-d76edc52f565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70f292b1d45467491e316aa81fe69fe'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:46.456515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2188ac45-523a-445d-a975-d76edc52f565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70f292b1d45467491e316aa81fe69fe'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:46.457293 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2188ac45-523a-445d-a975-d76edc52f565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70f292b1d45467491e316aa81fe69fe'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:46.465443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2188ac45-523a-445d-a975-d76edc52f565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70f292b1d45467491e316aa81fe69fe'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:46.476277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2188ac45-523a-445d-a975-d76edc52f565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70f292b1d45467491e316aa81fe69fe'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:46.489851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a5ca8-3e37-4410-a2e2-af076233bd3a tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:46.491292 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-546a5ca8-3e37-4410-a2e2-af076233bd3a tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:46.496466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 948/1881] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:46 2022] DELETE /identity/v3/users/d70f292b1d45467491e316aa81fe69fe => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:46.500998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1649df-451c-47e9-a3e3-a9e3f33888f1 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:46.501234 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1649df-451c-47e9-a3e3-a9e3f33888f1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:46.501516 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1649df-451c-47e9-a3e3-a9e3f33888f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:46.506267 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a5ca8-3e37-4410-a2e2-af076233bd3a tempest-VolumeQuotaClassesTest-609148032 tempest-VolumeQuotaClassesTest-609148032-project-admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:46.522117 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7c1649df-451c-47e9-a3e3-a9e3f33888f1 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:46.523480 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7c1649df-451c-47e9-a3e3-a9e3f33888f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:46.564179 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f1230-1e40-478b-9fe1-ccfc77a5b5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:46.565089 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f1230-1e40-478b-9fe1-ccfc77a5b5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:46.565376 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f1230-1e40-478b-9fe1-ccfc77a5b5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:46.565657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f1230-1e40-478b-9fe1-ccfc77a5b5bc admin admin] PATH_INFO: `/v3/users/e286fd93cfad4c2ea15bf432fa33ea73` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:46.566868 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f1230-1e40-478b-9fe1-ccfc77a5b5bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e286fd93cfad4c2ea15bf432fa33ea73)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:46.568834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f1230-1e40-478b-9fe1-ccfc77a5b5bc admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:46.589737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 949/1882] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:19:46.596443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1649df-451c-47e9-a3e3-a9e3f33888f1 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:46.597949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7c1649df-451c-47e9-a3e3-a9e3f33888f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:46.624977 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-214f1230-1e40-478b-9fe1-ccfc77a5b5bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e286fd93cfad4c2ea15bf432fa33ea73'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:46.630235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:46.633742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-214f1230-1e40-478b-9fe1-ccfc77a5b5bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e286fd93cfad4c2ea15bf432fa33ea73'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:46.634669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-214f1230-1e40-478b-9fe1-ccfc77a5b5bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e286fd93cfad4c2ea15bf432fa33ea73'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:46.636326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-214f1230-1e40-478b-9fe1-ccfc77a5b5bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e286fd93cfad4c2ea15bf432fa33ea73'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:46.657798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-214f1230-1e40-478b-9fe1-ccfc77a5b5bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e286fd93cfad4c2ea15bf432fa33ea73'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:46.671867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 934/1883] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:46 2022] DELETE /identity/v3/users/e286fd93cfad4c2ea15bf432fa33ea73 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:46.676308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe2faf-af90-4a30-9957-282d6088b557 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:46.676605 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe2faf-af90-4a30-9957-282d6088b557 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:46.676880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe2faf-af90-4a30-9957-282d6088b557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:46.677233 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1649df-451c-47e9-a3e3-a9e3f33888f1 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:46.701037 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6ebe2faf-af90-4a30-9957-282d6088b557 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:46.702625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6ebe2faf-af90-4a30-9957-282d6088b557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:46.735445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309cbea4-c194-4b8c-9112-6869f318c93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:46.736117 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cbea4-c194-4b8c-9112-6869f318c93e service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:46.736320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cbea4-c194-4b8c-9112-6869f318c93e service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:46.736603 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cbea4-c194-4b8c-9112-6869f318c93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:46.738516 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-309cbea4-c194-4b8c-9112-6869f318c93e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:46.741074 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:46.791578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 935/1884] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:19:46.802253 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe2faf-af90-4a30-9957-282d6088b557 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:46.803758 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6ebe2faf-af90-4a30-9957-282d6088b557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:46.818709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe2faf-af90-4a30-9957-282d6088b557 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:46.827421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682efbb-a6a1-4bd2-884d-3014b3e9e6eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:46.828270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682efbb-a6a1-4bd2-884d-3014b3e9e6eb service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:46.828828 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682efbb-a6a1-4bd2-884d-3014b3e9e6eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:46.829120 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682efbb-a6a1-4bd2-884d-3014b3e9e6eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:46.832561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cbea4-c194-4b8c-9112-6869f318c93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:46.834016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cbea4-c194-4b8c-9112-6869f318c93e service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:46.842874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682efbb-a6a1-4bd2-884d-3014b3e9e6eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:46.844594 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682efbb-a6a1-4bd2-884d-3014b3e9e6eb service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:46.845266 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 950/1885] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:19:46.867451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 936/1886] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:19:47.711528 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309cbea4-c194-4b8c-9112-6869f318c93e service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:47.714038 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-309cbea4-c194-4b8c-9112-6869f318c93e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:47.727459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309cbea4-c194-4b8c-9112-6869f318c93e service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:47.733522 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682efbb-a6a1-4bd2-884d-3014b3e9e6eb service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:47.735574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5682efbb-a6a1-4bd2-884d-3014b3e9e6eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:47.736675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8ef39-0ce1-41b4-b17f-0f7de128db63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:47.738247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8ef39-0ce1-41b4-b17f-0f7de128db63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:47.738247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8ef39-0ce1-41b4-b17f-0f7de128db63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:47.738247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8ef39-0ce1-41b4-b17f-0f7de128db63 admin admin] PATH_INFO: `/v3/projects/5b68c163d6d04e7795b197bf528fa297` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:47.739610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8ef39-0ce1-41b4-b17f-0f7de128db63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b68c163d6d04e7795b197bf528fa297)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:47.741641 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8ef39-0ce1-41b4-b17f-0f7de128db63 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:47.762168 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682efbb-a6a1-4bd2-884d-3014b3e9e6eb service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:47.769965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73510abd-5a61-4278-b373-f3a9b6e131fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:47.771140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73510abd-5a61-4278-b373-f3a9b6e131fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:47.771631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73510abd-5a61-4278-b373-f3a9b6e131fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:47.772094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73510abd-5a61-4278-b373-f3a9b6e131fb admin admin] PATH_INFO: `/v3/projects/0062e071f4f7459ba3cabb746eddb4af` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:47.773712 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73510abd-5a61-4278-b373-f3a9b6e131fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0062e071f4f7459ba3cabb746eddb4af)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:47.776349 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73510abd-5a61-4278-b373-f3a9b6e131fb admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:47.825713 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-56c8ef39-0ce1-41b4-b17f-0f7de128db63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b68c163d6d04e7795b197bf528fa297', 'request_id': 'req-56c8ef39-0ce1-41b4-b17f-0f7de128db63'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:47.838253 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-56c8ef39-0ce1-41b4-b17f-0f7de128db63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b68c163d6d04e7795b197bf528fa297', 'request_id': 'req-56c8ef39-0ce1-41b4-b17f-0f7de128db63'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:47.849580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-56c8ef39-0ce1-41b4-b17f-0f7de128db63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b68c163d6d04e7795b197bf528fa297', 'request_id': 'req-56c8ef39-0ce1-41b4-b17f-0f7de128db63'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:47.868282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-73510abd-5a61-4278-b373-f3a9b6e131fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0062e071f4f7459ba3cabb746eddb4af', 'request_id': 'req-73510abd-5a61-4278-b373-f3a9b6e131fb'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:47.871134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-56c8ef39-0ce1-41b4-b17f-0f7de128db63 admin admin] The token cache is being invalidate because project 5b68c163d6d04e7795b197bf528fa297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:47.871581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-56c8ef39-0ce1-41b4-b17f-0f7de128db63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:47.872313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-56c8ef39-0ce1-41b4-b17f-0f7de128db63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:47.876916 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 951/1887] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:47 2022] DELETE /identity/v3/projects/5b68c163d6d04e7795b197bf528fa297 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:47.880639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8ef39-0ce1-41b4-b17f-0f7de128db63 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:47.883599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-56c8ef39-0ce1-41b4-b17f-0f7de128db63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:47.897389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-73510abd-5a61-4278-b373-f3a9b6e131fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0062e071f4f7459ba3cabb746eddb4af', 'request_id': 'req-73510abd-5a61-4278-b373-f3a9b6e131fb'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:47.908794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:47.918499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-73510abd-5a61-4278-b373-f3a9b6e131fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0062e071f4f7459ba3cabb746eddb4af', 'request_id': 'req-73510abd-5a61-4278-b373-f3a9b6e131fb'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:47.941771 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-73510abd-5a61-4278-b373-f3a9b6e131fb admin admin] The token cache is being invalidate because project 0062e071f4f7459ba3cabb746eddb4af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:47.942218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-73510abd-5a61-4278-b373-f3a9b6e131fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:47.943135 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-73510abd-5a61-4278-b373-f3a9b6e131fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:47.945209 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 937/1888] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:47 2022] DELETE /identity/v3/projects/0062e071f4f7459ba3cabb746eddb4af => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:47.949841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73510abd-5a61-4278-b373-f3a9b6e131fb admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:47.951597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-73510abd-5a61-4278-b373-f3a9b6e131fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:47.980496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8ef39-0ce1-41b4-b17f-0f7de128db63 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:48.092832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73510abd-5a61-4278-b373-f3a9b6e131fb admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:48.100037 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21499b1-7c9c-4f8b-8ca1-ca2f35822188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:48.101146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21499b1-7c9c-4f8b-8ca1-ca2f35822188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:48.101550 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21499b1-7c9c-4f8b-8ca1-ca2f35822188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:48.101895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21499b1-7c9c-4f8b-8ca1-ca2f35822188 admin admin] PATH_INFO: `/v3/users/59addc83176d4506817c45adcee063e6` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:48.103502 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21499b1-7c9c-4f8b-8ca1-ca2f35822188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59addc83176d4506817c45adcee063e6)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:48.106272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21499b1-7c9c-4f8b-8ca1-ca2f35822188 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:48.110115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547a725-a741-4fae-b27d-2f0b95d2257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:48.111088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547a725-a741-4fae-b27d-2f0b95d2257b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:48.111419 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547a725-a741-4fae-b27d-2f0b95d2257b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:48.111737 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547a725-a741-4fae-b27d-2f0b95d2257b admin admin] PATH_INFO: `/v3/users/12c8206fbe4b49c8b0b460f0b565899d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:48.113773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547a725-a741-4fae-b27d-2f0b95d2257b admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c8206fbe4b49c8b0b460f0b565899d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:48.115820 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547a725-a741-4fae-b27d-2f0b95d2257b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:48.177070 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:48.180399 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f547a725-a741-4fae-b27d-2f0b95d2257b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c8206fbe4b49c8b0b460f0b565899d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:48.181886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f547a725-a741-4fae-b27d-2f0b95d2257b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c8206fbe4b49c8b0b460f0b565899d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:48.183337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f21499b1-7c9c-4f8b-8ca1-ca2f35822188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59addc83176d4506817c45adcee063e6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:48.184010 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f547a725-a741-4fae-b27d-2f0b95d2257b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c8206fbe4b49c8b0b460f0b565899d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:48.198970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f547a725-a741-4fae-b27d-2f0b95d2257b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c8206fbe4b49c8b0b460f0b565899d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:48.199952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f21499b1-7c9c-4f8b-8ca1-ca2f35822188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59addc83176d4506817c45adcee063e6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:48.201060 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f21499b1-7c9c-4f8b-8ca1-ca2f35822188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59addc83176d4506817c45adcee063e6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:48.202394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f21499b1-7c9c-4f8b-8ca1-ca2f35822188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59addc83176d4506817c45adcee063e6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:48.210482 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f547a725-a741-4fae-b27d-2f0b95d2257b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c8206fbe4b49c8b0b460f0b565899d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:48.233406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f21499b1-7c9c-4f8b-8ca1-ca2f35822188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59addc83176d4506817c45adcee063e6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:48.257471 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 952/1889] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:47 2022] DELETE /identity/v3/users/12c8206fbe4b49c8b0b460f0b565899d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:48.267261 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 938/1890] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:47 2022] DELETE /identity/v3/users/59addc83176d4506817c45adcee063e6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:48.985837 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547a725-a741-4fae-b27d-2f0b95d2257b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:48.987475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f547a725-a741-4fae-b27d-2f0b95d2257b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:48.992451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21499b1-7c9c-4f8b-8ca1-ca2f35822188 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:48.995277 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f21499b1-7c9c-4f8b-8ca1-ca2f35822188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:49.045339 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:49.089328 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547a725-a741-4fae-b27d-2f0b95d2257b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:49.110844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21499b1-7c9c-4f8b-8ca1-ca2f35822188 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:49.117625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52d064-5926-4d24-8973-377ac4bf437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:49.119350 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52d064-5926-4d24-8973-377ac4bf437f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.119555 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52d064-5926-4d24-8973-377ac4bf437f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.119844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52d064-5926-4d24-8973-377ac4bf437f admin admin] PATH_INFO: `/v3/projects/ef4618c00cee46568d26b58a6fbb28e9` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.122010 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52d064-5926-4d24-8973-377ac4bf437f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4618c00cee46568d26b58a6fbb28e9)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:49.124125 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52d064-5926-4d24-8973-377ac4bf437f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:49.168408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0837e79-690e-409b-a2c7-1ad58ad37b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:49.169282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0837e79-690e-409b-a2c7-1ad58ad37b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.169579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0837e79-690e-409b-a2c7-1ad58ad37b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.169847 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0837e79-690e-409b-a2c7-1ad58ad37b94 admin admin] PATH_INFO: `/v3/projects/5ca0c5691e43446298b1c8305e0ba06f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.171285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0837e79-690e-409b-a2c7-1ad58ad37b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca0c5691e43446298b1c8305e0ba06f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:49.173652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0837e79-690e-409b-a2c7-1ad58ad37b94 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:49.183852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b52d064-5926-4d24-8973-377ac4bf437f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4618c00cee46568d26b58a6fbb28e9', 'request_id': 'req-0b52d064-5926-4d24-8973-377ac4bf437f'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:49.192687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b52d064-5926-4d24-8973-377ac4bf437f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4618c00cee46568d26b58a6fbb28e9', 'request_id': 'req-0b52d064-5926-4d24-8973-377ac4bf437f'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:49.200602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b52d064-5926-4d24-8973-377ac4bf437f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4618c00cee46568d26b58a6fbb28e9', 'request_id': 'req-0b52d064-5926-4d24-8973-377ac4bf437f'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:49.215227 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b52d064-5926-4d24-8973-377ac4bf437f admin admin] The token cache is being invalidate because project ef4618c00cee46568d26b58a6fbb28e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:49.215488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b52d064-5926-4d24-8973-377ac4bf437f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:49.216282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b52d064-5926-4d24-8973-377ac4bf437f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:49.218332 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 939/1891] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:48 2022] DELETE /identity/v3/projects/ef4618c00cee46568d26b58a6fbb28e9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:49.222787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c416582-2ff7-4e88-a5f1-7f239f7d6d97 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.223087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c416582-2ff7-4e88-a5f1-7f239f7d6d97 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.223369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c416582-2ff7-4e88-a5f1-7f239f7d6d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.238956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0837e79-690e-409b-a2c7-1ad58ad37b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca0c5691e43446298b1c8305e0ba06f', 'request_id': 'req-d0837e79-690e-409b-a2c7-1ad58ad37b94'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:49.246334 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0837e79-690e-409b-a2c7-1ad58ad37b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca0c5691e43446298b1c8305e0ba06f', 'request_id': 'req-d0837e79-690e-409b-a2c7-1ad58ad37b94'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:49.252634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3c416582-2ff7-4e88-a5f1-7f239f7d6d97 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:49.253218 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0837e79-690e-409b-a2c7-1ad58ad37b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca0c5691e43446298b1c8305e0ba06f', 'request_id': 'req-d0837e79-690e-409b-a2c7-1ad58ad37b94'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:49.254367 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3c416582-2ff7-4e88-a5f1-7f239f7d6d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:49.273642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0837e79-690e-409b-a2c7-1ad58ad37b94 admin admin] The token cache is being invalidate because project 5ca0c5691e43446298b1c8305e0ba06f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:49.274085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0837e79-690e-409b-a2c7-1ad58ad37b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:49.275274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0837e79-690e-409b-a2c7-1ad58ad37b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:49.280994 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 953/1892] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:48 2022] DELETE /identity/v3/projects/5ca0c5691e43446298b1c8305e0ba06f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:49.286866 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857de3f2-1f9c-4e00-930a-7220ec4c27bf None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.287574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857de3f2-1f9c-4e00-930a-7220ec4c27bf None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.287574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857de3f2-1f9c-4e00-930a-7220ec4c27bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.310751 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-857de3f2-1f9c-4e00-930a-7220ec4c27bf None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:49.311979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-857de3f2-1f9c-4e00-930a-7220ec4c27bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:49.325054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:49.346650 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 940/1893] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:19:49.356710 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df1f87-66b9-46d7-8912-3e2ed8c11a8f None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.357047 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df1f87-66b9-46d7-8912-3e2ed8c11a8f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.357377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df1f87-66b9-46d7-8912-3e2ed8c11a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.379069 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-89df1f87-66b9-46d7-8912-3e2ed8c11a8f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:49.380144 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-89df1f87-66b9-46d7-8912-3e2ed8c11a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:49.390114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 941/1894] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:49.394695 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df1f87-66b9-46d7-8912-3e2ed8c11a8f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:49.408702 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 954/1895] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:49.410926 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138f47f-0e95-4d6b-83f4-12eeb91a2f16 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.411228 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138f47f-0e95-4d6b-83f4-12eeb91a2f16 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.411653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138f47f-0e95-4d6b-83f4-12eeb91a2f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.413358 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df1f87-66b9-46d7-8912-3e2ed8c11a8f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:49.420676 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c2769-a20b-4b16-8d97-a18b4cf93341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:49.421424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c2769-a20b-4b16-8d97-a18b4cf93341 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.421775 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c2769-a20b-4b16-8d97-a18b4cf93341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.422059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c2769-a20b-4b16-8d97-a18b4cf93341 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.423059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c2769-a20b-4b16-8d97-a18b4cf93341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:19:49.423369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c2769-a20b-4b16-8d97-a18b4cf93341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:49.425303 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c2769-a20b-4b16-8d97-a18b4cf93341 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:49.438217 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c138f47f-0e95-4d6b-83f4-12eeb91a2f16 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:49.439763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c138f47f-0e95-4d6b-83f4-12eeb91a2f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:49.446106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 942/1896] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:19:49.450250 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 955/1897] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:49.451873 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c2769-a20b-4b16-8d97-a18b4cf93341 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:49.454703 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138f47f-0e95-4d6b-83f4-12eeb91a2f16 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:49.467589 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138f47f-0e95-4d6b-83f4-12eeb91a2f16 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:49.473651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ef195-2a46-4bb5-a12f-3ce9c752d226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:49.474633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ef195-2a46-4bb5-a12f-3ce9c752d226 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.475015 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ef195-2a46-4bb5-a12f-3ce9c752d226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.475443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ef195-2a46-4bb5-a12f-3ce9c752d226 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.476322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ef195-2a46-4bb5-a12f-3ce9c752d226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:19:49.476744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ef195-2a46-4bb5-a12f-3ce9c752d226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:49.478815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ef195-2a46-4bb5-a12f-3ce9c752d226 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:49.482623 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c2769-a20b-4b16-8d97-a18b4cf93341 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:49.482895 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:49.488912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3e331-f6fe-45cb-a3f4-9c512af11754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:49.489777 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3e331-f6fe-45cb-a3f4-9c512af11754 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.490065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3e331-f6fe-45cb-a3f4-9c512af11754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.490397 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3e331-f6fe-45cb-a3f4-9c512af11754 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.492500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3e331-f6fe-45cb-a3f4-9c512af11754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:49.494734 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3e331-f6fe-45cb-a3f4-9c512af11754 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:49.499567 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 956/1898] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:19:49.501421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ef195-2a46-4bb5-a12f-3ce9c752d226 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:49.513663 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ef195-2a46-4bb5-a12f-3ce9c752d226 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:49.519734 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d627511-cd58-4d41-b81e-c8ae5a74515b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:49.521490 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627511-cd58-4d41-b81e-c8ae5a74515b admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.521919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627511-cd58-4d41-b81e-c8ae5a74515b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.522627 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627511-cd58-4d41-b81e-c8ae5a74515b admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.523581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d627511-cd58-4d41-b81e-c8ae5a74515b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:49.526508 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d627511-cd58-4d41-b81e-c8ae5a74515b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:49.529697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 943/1899] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:49 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:49.533729 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3e331-f6fe-45cb-a3f4-9c512af11754 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:49.562779 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 957/1900] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:49 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:49.568891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d627511-cd58-4d41-b81e-c8ae5a74515b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:49.616386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3e331-f6fe-45cb-a3f4-9c512af11754 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:49.648788 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d627511-cd58-4d41-b81e-c8ae5a74515b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:49.654593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65a690-548b-4cd5-a429-a4d25c17cd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:49.655429 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65a690-548b-4cd5-a429-a4d25c17cd54 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.655717 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65a690-548b-4cd5-a429-a4d25c17cd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.656629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65a690-548b-4cd5-a429-a4d25c17cd54 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.656982 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65a690-548b-4cd5-a429-a4d25c17cd54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:49.659233 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65a690-548b-4cd5-a429-a4d25c17cd54 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:49.690026 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9209aa-dbc7-4a56-9a53-0700f204525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:49.691913 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 958/1901] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:49 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:49.692356 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9209aa-dbc7-4a56-9a53-0700f204525d admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.692929 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9209aa-dbc7-4a56-9a53-0700f204525d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.693344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9209aa-dbc7-4a56-9a53-0700f204525d admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.694197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9209aa-dbc7-4a56-9a53-0700f204525d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:49.695458 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65a690-548b-4cd5-a429-a4d25c17cd54 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:49.705339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9209aa-dbc7-4a56-9a53-0700f204525d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:49.709503 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65a690-548b-4cd5-a429-a4d25c17cd54 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:49.715325 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a71cc-3edf-421d-b397-4ad1f600e513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:49.716151 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a71cc-3edf-421d-b397-4ad1f600e513 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.716646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a71cc-3edf-421d-b397-4ad1f600e513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.716993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a71cc-3edf-421d-b397-4ad1f600e513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.717978 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a71cc-3edf-421d-b397-4ad1f600e513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:49.721092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a71cc-3edf-421d-b397-4ad1f600e513 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:49.734656 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 944/1902] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:49 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:19:49.738749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9209aa-dbc7-4a56-9a53-0700f204525d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:49.744569 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 959/1903] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:19:49.748222 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a71cc-3edf-421d-b397-4ad1f600e513 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:49.758824 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9209aa-dbc7-4a56-9a53-0700f204525d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:49.760455 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a71cc-3edf-421d-b397-4ad1f600e513 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:49.765109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ac361-f7db-4911-be4d-e5b5df3fb802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:49.765785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ac361-f7db-4911-be4d-e5b5df3fb802 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.766066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ac361-f7db-4911-be4d-e5b5df3fb802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.766474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ac361-f7db-4911-be4d-e5b5df3fb802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.768285 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ac361-f7db-4911-be4d-e5b5df3fb802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:49.768833 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ac361-f7db-4911-be4d-e5b5df3fb802 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:49.778477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec19e5-1691-4325-8d69-5c7de09f14ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:49.779184 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec19e5-1691-4325-8d69-5c7de09f14ef admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.779449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec19e5-1691-4325-8d69-5c7de09f14ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.779727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec19e5-1691-4325-8d69-5c7de09f14ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.780484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec19e5-1691-4325-8d69-5c7de09f14ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:49.782084 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec19e5-1691-4325-8d69-5c7de09f14ef admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:49.786600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 945/1904] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:19:49.790407 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ac361-f7db-4911-be4d-e5b5df3fb802 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:49.800797 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 960/1905] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:19:49.804781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ac361-f7db-4911-be4d-e5b5df3fb802 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:49.808048 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec19e5-1691-4325-8d69-5c7de09f14ef admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:49.814235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950d4a1-ad45-46f8-9b82-4bc2ae1c8dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:49.814235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950d4a1-ad45-46f8-9b82-4bc2ae1c8dff admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.814628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950d4a1-ad45-46f8-9b82-4bc2ae1c8dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.814943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950d4a1-ad45-46f8-9b82-4bc2ae1c8dff admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.817202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950d4a1-ad45-46f8-9b82-4bc2ae1c8dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:49.819338 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950d4a1-ad45-46f8-9b82-4bc2ae1c8dff admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:49.820298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec19e5-1691-4325-8d69-5c7de09f14ef admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:49.827599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e6459-0456-42ef-82c8-6a2d2834495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:49.834910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e6459-0456-42ef-82c8-6a2d2834495b admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.834910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e6459-0456-42ef-82c8-6a2d2834495b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.834910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e6459-0456-42ef-82c8-6a2d2834495b admin admin] PATH_INFO: `/v3/projects/c93a5ac407204a26a54adff6e0c30d47/users/fba8cc1be5904193a5cc68963f2d1acb/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.838284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 946/1906] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:49.839157 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950d4a1-ad45-46f8-9b82-4bc2ae1c8dff admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:49.852080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950d4a1-ad45-46f8-9b82-4bc2ae1c8dff admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:49.858897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981f44d-07bc-42a3-b857-ef01c3adddc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:49.860539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981f44d-07bc-42a3-b857-ef01c3adddc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.860930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981f44d-07bc-42a3-b857-ef01c3adddc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.861317 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981f44d-07bc-42a3-b857-ef01c3adddc2 admin admin] PATH_INFO: `/v3/projects/0ade71c174fd4feea360d25f3a014e3a/users/276e1eae206a48159bc831ebab719a11/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.873515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e6459-0456-42ef-82c8-6a2d2834495b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93a5ac407204a26a54adff6e0c30d47, user_id=fba8cc1be5904193a5cc68963f2d1acb, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:49.876288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e6459-0456-42ef-82c8-6a2d2834495b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:49.880818 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981f44d-07bc-42a3-b857-ef01c3adddc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ade71c174fd4feea360d25f3a014e3a, user_id=276e1eae206a48159bc831ebab719a11, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:49.885832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981f44d-07bc-42a3-b857-ef01c3adddc2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:49.901295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 961/1907] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:49 2022] PUT /identity/v3/projects/c93a5ac407204a26a54adff6e0c30d47/users/fba8cc1be5904193a5cc68963f2d1acb/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:49.905798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 947/1908] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:49 2022] PUT /identity/v3/projects/0ade71c174fd4feea360d25f3a014e3a/users/276e1eae206a48159bc831ebab719a11/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:49.919161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6ed2d-c64f-4421-999e-d57b76eec705 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.919462 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6ed2d-c64f-4421-999e-d57b76eec705 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.920339 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6ed2d-c64f-4421-999e-d57b76eec705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.922961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04336612-187b-4fe8-a8cb-2026a6a7d910 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:49.923255 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04336612-187b-4fe8-a8cb-2026a6a7d910 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:49.923536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04336612-187b-4fe8-a8cb-2026a6a7d910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:49.931665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:49.961184 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-55b6ed2d-c64f-4421-999e-d57b76eec705 None None] MFA Rules not processed for user `276e1eae206a48159bc831ebab719a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:49.963031 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-55b6ed2d-c64f-4421-999e-d57b76eec705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:49.965573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-04336612-187b-4fe8-a8cb-2026a6a7d910 None None] MFA Rules not processed for user `fba8cc1be5904193a5cc68963f2d1acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:49.967081 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-04336612-187b-4fe8-a8cb-2026a6a7d910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:50.086813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 948/1909] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:50.089041 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04336612-187b-4fe8-a8cb-2026a6a7d910 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:50.091064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 962/1910] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:50.101663 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6ed2d-c64f-4421-999e-d57b76eec705 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:50.114906 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:50.173318 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04336612-187b-4fe8-a8cb-2026a6a7d910 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:50.180907 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db19a2-fe11-406a-926f-440fc49e202f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:50.182722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db19a2-fe11-406a-926f-440fc49e202f admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.183299 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db19a2-fe11-406a-926f-440fc49e202f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.183919 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db19a2-fe11-406a-926f-440fc49e202f admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.185622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db19a2-fe11-406a-926f-440fc49e202f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:50.188527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db19a2-fe11-406a-926f-440fc49e202f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:50.206896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6ed2d-c64f-4421-999e-d57b76eec705 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:50.213403 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307b733-ed2e-4c64-93e4-7ba98fc0b74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:50.214110 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307b733-ed2e-4c64-93e4-7ba98fc0b74a admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.214515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307b733-ed2e-4c64-93e4-7ba98fc0b74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.214850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307b733-ed2e-4c64-93e4-7ba98fc0b74a admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.215604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307b733-ed2e-4c64-93e4-7ba98fc0b74a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:50.217601 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307b733-ed2e-4c64-93e4-7ba98fc0b74a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:50.223379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 949/1911] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:50 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:19:50.229758 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db19a2-fe11-406a-926f-440fc49e202f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:50.257558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 963/1912] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:50 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:19:50.261353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307b733-ed2e-4c64-93e4-7ba98fc0b74a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:50.303203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db19a2-fe11-406a-926f-440fc49e202f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:50.329273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:50.331057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307b733-ed2e-4c64-93e4-7ba98fc0b74a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:50.338389 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb03247-f3f0-4df0-9478-399d63d65988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:50.339105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb03247-f3f0-4df0-9478-399d63d65988 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.339415 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb03247-f3f0-4df0-9478-399d63d65988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.339770 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb03247-f3f0-4df0-9478-399d63d65988 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.340515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb03247-f3f0-4df0-9478-399d63d65988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:50.342496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb03247-f3f0-4df0-9478-399d63d65988 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:50.370209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 964/1913] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:50 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:19:50.373418 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb03247-f3f0-4df0-9478-399d63d65988 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:50.375995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67723b5e-4b51-4623-825e-26c8a0e462cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:50.376717 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67723b5e-4b51-4623-825e-26c8a0e462cd admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.377000 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67723b5e-4b51-4623-825e-26c8a0e462cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.377279 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67723b5e-4b51-4623-825e-26c8a0e462cd admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.377972 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67723b5e-4b51-4623-825e-26c8a0e462cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:50.379892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67723b5e-4b51-4623-825e-26c8a0e462cd admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:50.384356 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb03247-f3f0-4df0-9478-399d63d65988 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:50.389240 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76361cd6-e547-4ca2-b3ea-df822efde056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:50.389918 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76361cd6-e547-4ca2-b3ea-df822efde056 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.390200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76361cd6-e547-4ca2-b3ea-df822efde056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.390462 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76361cd6-e547-4ca2-b3ea-df822efde056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.391265 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76361cd6-e547-4ca2-b3ea-df822efde056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:50.393080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76361cd6-e547-4ca2-b3ea-df822efde056 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:50.408446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 950/1914] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:50 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:50.408644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 965/1915] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:50.409414 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67723b5e-4b51-4623-825e-26c8a0e462cd admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:50.410668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76361cd6-e547-4ca2-b3ea-df822efde056 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:50.422526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67723b5e-4b51-4623-825e-26c8a0e462cd admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:50.422716 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76361cd6-e547-4ca2-b3ea-df822efde056 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:50.427328 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b67431-4a79-46da-8068-b0b613dba0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:50.427738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c7b58-a0cd-42c6-8dc6-f0b1a154248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:50.428242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b67431-4a79-46da-8068-b0b613dba0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.428527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c7b58-a0cd-42c6-8dc6-f0b1a154248d admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.428813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b67431-4a79-46da-8068-b0b613dba0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.428955 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c7b58-a0cd-42c6-8dc6-f0b1a154248d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.429131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c7b58-a0cd-42c6-8dc6-f0b1a154248d admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.429228 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b67431-4a79-46da-8068-b0b613dba0dc admin admin] PATH_INFO: `/v3/projects/fc8163e0401948ca9c7c204e4b50657d/users/01387091d9c44913a7d16572780a0d01/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.429867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c7b58-a0cd-42c6-8dc6-f0b1a154248d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:50.432059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c7b58-a0cd-42c6-8dc6-f0b1a154248d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:50.443247 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 951/1916] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:50.447496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c7b58-a0cd-42c6-8dc6-f0b1a154248d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:50.449872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b67431-4a79-46da-8068-b0b613dba0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc8163e0401948ca9c7c204e4b50657d, user_id=01387091d9c44913a7d16572780a0d01, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:50.452563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b67431-4a79-46da-8068-b0b613dba0dc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:50.461260 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c7b58-a0cd-42c6-8dc6-f0b1a154248d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:50.467321 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 966/1917] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:50 2022] PUT /identity/v3/projects/fc8163e0401948ca9c7c204e4b50657d/users/01387091d9c44913a7d16572780a0d01/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:50.471912 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b67431-4a79-46da-8068-b0b613dba0dc admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:50.530076 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:50.543710 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1f1c4-6bca-43aa-82af-0c70fa5d48be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:50.544459 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1f1c4-6bca-43aa-82af-0c70fa5d48be admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.544756 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1f1c4-6bca-43aa-82af-0c70fa5d48be admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.545042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1f1c4-6bca-43aa-82af-0c70fa5d48be admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.546046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1f1c4-6bca-43aa-82af-0c70fa5d48be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:50.548003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1f1c4-6bca-43aa-82af-0c70fa5d48be admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:50.553871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b67431-4a79-46da-8068-b0b613dba0dc admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:50.560949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ce3b7-302d-4e75-8a39-ab7523bc1848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:50.562743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ce3b7-302d-4e75-8a39-ab7523bc1848 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.562860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 952/1918] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:19:50.563353 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1f1c4-6bca-43aa-82af-0c70fa5d48be admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:50.566150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ce3b7-302d-4e75-8a39-ab7523bc1848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.566482 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ce3b7-302d-4e75-8a39-ab7523bc1848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.566981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-75b1f1c4-6bca-43aa-82af-0c70fa5d48be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:50.567255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ce3b7-302d-4e75-8a39-ab7523bc1848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:50.569005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ce3b7-302d-4e75-8a39-ab7523bc1848 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:50.584198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1f1c4-6bca-43aa-82af-0c70fa5d48be admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:50.591384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 967/1919] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:19:50.592435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ce3b7-302d-4e75-8a39-ab7523bc1848 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:50.606388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51034f-1c48-47eb-a4c4-ff846ea2e5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:50.608936 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ce3b7-302d-4e75-8a39-ab7523bc1848 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:50.609709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51034f-1c48-47eb-a4c4-ff846ea2e5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.610337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51034f-1c48-47eb-a4c4-ff846ea2e5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.610865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51034f-1c48-47eb-a4c4-ff846ea2e5ce admin admin] PATH_INFO: `/v3/users/c2b20dc0180e48ae8080715b1a1e9d06` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.612734 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51034f-1c48-47eb-a4c4-ff846ea2e5ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b20dc0180e48ae8080715b1a1e9d06)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:50.615365 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51034f-1c48-47eb-a4c4-ff846ea2e5ce admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:50.616443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ae6d6-e2ab-4316-86d3-84c1aa2799b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:50.617943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ae6d6-e2ab-4316-86d3-84c1aa2799b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.618582 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ae6d6-e2ab-4316-86d3-84c1aa2799b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.619484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ae6d6-e2ab-4316-86d3-84c1aa2799b4 admin admin] PATH_INFO: `/v3/projects/731a16b29ed7435bb46c1cd4042abec6/users/f6981c0b8548426086f781a07f1f75e0/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.643006 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ae6d6-e2ab-4316-86d3-84c1aa2799b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=731a16b29ed7435bb46c1cd4042abec6, user_id=f6981c0b8548426086f781a07f1f75e0, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:50.646510 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ae6d6-e2ab-4316-86d3-84c1aa2799b4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:50.667772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 968/1920] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:50 2022] PUT /identity/v3/projects/731a16b29ed7435bb46c1cd4042abec6/users/f6981c0b8548426086f781a07f1f75e0/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:50.678046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ae6d6-e2ab-4316-86d3-84c1aa2799b4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:50.688872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-fa51034f-1c48-47eb-a4c4-ff846ea2e5ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b20dc0180e48ae8080715b1a1e9d06'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:50.700598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-fa51034f-1c48-47eb-a4c4-ff846ea2e5ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b20dc0180e48ae8080715b1a1e9d06'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:50.701882 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-fa51034f-1c48-47eb-a4c4-ff846ea2e5ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b20dc0180e48ae8080715b1a1e9d06'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:50.702873 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-fa51034f-1c48-47eb-a4c4-ff846ea2e5ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b20dc0180e48ae8080715b1a1e9d06'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:50.735338 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-fa51034f-1c48-47eb-a4c4-ff846ea2e5ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b20dc0180e48ae8080715b1a1e9d06'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:50.749324 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ae6d6-e2ab-4316-86d3-84c1aa2799b4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:50.749632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 953/1921] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:50 2022] DELETE /identity/v3/users/c2b20dc0180e48ae8080715b1a1e9d06 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:50.752649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa3ba5-99e5-4911-b051-91d39a67856d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.752649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa3ba5-99e5-4911-b051-91d39a67856d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.752649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa3ba5-99e5-4911-b051-91d39a67856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.775500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:50.784992 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-dcaa3ba5-99e5-4911-b051-91d39a67856d None None] MFA Rules not processed for user `f6981c0b8548426086f781a07f1f75e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:50.787712 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-dcaa3ba5-99e5-4911-b051-91d39a67856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:50.827078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07448394-aad7-4946-b292-6cd3baf04320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:50.827896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07448394-aad7-4946-b292-6cd3baf04320 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.828205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07448394-aad7-4946-b292-6cd3baf04320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.828475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07448394-aad7-4946-b292-6cd3baf04320 admin admin] PATH_INFO: `/v3/projects/fc8163e0401948ca9c7c204e4b50657d/users/01387091d9c44913a7d16572780a0d01/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.830759 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07448394-aad7-4946-b292-6cd3baf04320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc8163e0401948ca9c7c204e4b50657d, user_id=01387091d9c44913a7d16572780a0d01, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:50.833491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07448394-aad7-4946-b292-6cd3baf04320 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:50.852337 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 969/1922] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:50 2022] PUT /identity/v3/projects/fc8163e0401948ca9c7c204e4b50657d/users/01387091d9c44913a7d16572780a0d01/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:50.854730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2079f-1e0d-4f9c-8203-da1012b0963f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.855023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2079f-1e0d-4f9c-8203-da1012b0963f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.855303 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2079f-1e0d-4f9c-8203-da1012b0963f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.876591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0fd2079f-1e0d-4f9c-8203-da1012b0963f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:50.877961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0fd2079f-1e0d-4f9c-8203-da1012b0963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:50.888175 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 954/1923] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:50.893666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9e30f-546c-4de7-a1be-7b09e4062e33 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.894060 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9e30f-546c-4de7-a1be-7b09e4062e33 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.894413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9e30f-546c-4de7-a1be-7b09e4062e33 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.895865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 955/1924] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 25 16:19:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:19:50.897124 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f886ce0-1eed-4a33-8735-dc59f054c0ec None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.897483 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f886ce0-1eed-4a33-8735-dc59f054c0ec None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.898465 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f886ce0-1eed-4a33-8735-dc59f054c0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.935468 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2f886ce0-1eed-4a33-8735-dc59f054c0ec None None] MFA Rules not processed for user `01387091d9c44913a7d16572780a0d01`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:50.937268 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2f886ce0-1eed-4a33-8735-dc59f054c0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:50.951396 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:50.964067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 970/1925] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:50.967981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2079f-1e0d-4f9c-8203-da1012b0963f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:50.969585 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0fd2079f-1e0d-4f9c-8203-da1012b0963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:50.987074 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2079f-1e0d-4f9c-8203-da1012b0963f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:50.991710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c1519-028b-43a1-affd-92dda6880476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:50.992413 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c1519-028b-43a1-affd-92dda6880476 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:50.992701 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c1519-028b-43a1-affd-92dda6880476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:50.992981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c1519-028b-43a1-affd-92dda6880476 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:50.993732 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c1519-028b-43a1-affd-92dda6880476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:50.995664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c1519-028b-43a1-affd-92dda6880476 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:51.019907 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 956/1926] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:51.021457 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c041f49-b100-4d91-835b-10c7e57bf566 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:51.021756 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c041f49-b100-4d91-835b-10c7e57bf566 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:51.022052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c041f49-b100-4d91-835b-10c7e57bf566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:51.028219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 971/1927] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:50 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:51.029176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c1519-028b-43a1-affd-92dda6880476 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:51.030738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-524c1519-028b-43a1-affd-92dda6880476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:51.046343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7c041f49-b100-4d91-835b-10c7e57bf566 None None] MFA Rules not processed for user `c455f8d340444b068249213ff504895e`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:51.047551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7c041f49-b100-4d91-835b-10c7e57bf566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:51.088287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c1519-028b-43a1-affd-92dda6880476 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:51.092368 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7b9e8-5fde-445a-8495-758943455124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:51.093340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7b9e8-5fde-445a-8495-758943455124 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:51.093640 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7b9e8-5fde-445a-8495-758943455124 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:51.093923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7b9e8-5fde-445a-8495-758943455124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:51.124285 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 957/1928] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 25 16:19:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:51.132549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c041f49-b100-4d91-835b-10c7e57bf566 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:51.158273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:51.205669 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7b9e8-5fde-445a-8495-758943455124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:51.209974 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7b9e8-5fde-445a-8495-758943455124 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:51.221106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c041f49-b100-4d91-835b-10c7e57bf566 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:51.229894 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 972/1929] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:51.232066 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7b9e8-5fde-445a-8495-758943455124 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:51.233695 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-72c7b9e8-5fde-445a-8495-758943455124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:51.243101 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806f53f-7e14-4225-a529-3ac2e020d30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:51.244031 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806f53f-7e14-4225-a529-3ac2e020d30e admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:51.244348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806f53f-7e14-4225-a529-3ac2e020d30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:51.244634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806f53f-7e14-4225-a529-3ac2e020d30e admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:51.245339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806f53f-7e14-4225-a529-3ac2e020d30e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:51.250723 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806f53f-7e14-4225-a529-3ac2e020d30e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:51.303777 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 958/1930] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:51 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:51.304759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806f53f-7e14-4225-a529-3ac2e020d30e admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:51.306889 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4806f53f-7e14-4225-a529-3ac2e020d30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:51.326390 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806f53f-7e14-4225-a529-3ac2e020d30e admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:51.333259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b2426-ffc6-4766-84fc-ba2c1a416f98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:51.333810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b2426-ffc6-4766-84fc-ba2c1a416f98 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:51.334092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b2426-ffc6-4766-84fc-ba2c1a416f98 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:51.334913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b2426-ffc6-4766-84fc-ba2c1a416f98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:51.338548 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7b9e8-5fde-445a-8495-758943455124 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:51.345007 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b1801-6ace-4594-bbc2-da964143de35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:51.345875 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b2426-ffc6-4766-84fc-ba2c1a416f98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:51.346221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b1801-6ace-4594-bbc2-da964143de35 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:51.347268 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b1801-6ace-4594-bbc2-da964143de35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:51.347786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b2426-ffc6-4766-84fc-ba2c1a416f98 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:51.348085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b1801-6ace-4594-bbc2-da964143de35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:51.360405 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 959/1931] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:51.361261 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b2426-ffc6-4766-84fc-ba2c1a416f98 service nova] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:51.372548 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b2426-ffc6-4766-84fc-ba2c1a416f98 service nova] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:51.387723 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98570b3-ec66-48c2-8f52-b9131a62f3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:51.388442 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98570b3-ec66-48c2-8f52-b9131a62f3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:51.388725 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98570b3-ec66-48c2-8f52-b9131a62f3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:51.389003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98570b3-ec66-48c2-8f52-b9131a62f3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:51.389730 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98570b3-ec66-48c2-8f52-b9131a62f3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:51.392939 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98570b3-ec66-48c2-8f52-b9131a62f3e5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:51.417747 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 960/1932] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:51.421975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98570b3-ec66-48c2-8f52-b9131a62f3e5 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:51.436576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:51.437248 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98570b3-ec66-48c2-8f52-b9131a62f3e5 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:51.445365 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a5c4c-18d7-4a71-9f31-67ed3e11d5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:51.446491 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a5c4c-18d7-4a71-9f31-67ed3e11d5d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:51.447734 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a5c4c-18d7-4a71-9f31-67ed3e11d5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:51.448169 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a5c4c-18d7-4a71-9f31-67ed3e11d5d2 admin admin] PATH_INFO: `/v3/projects/4b95efedd3a8495c92e84447ecca3248/users/7ef733644f0749958c55c24359709745/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:51.469392 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b1801-6ace-4594-bbc2-da964143de35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:51.470747 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a5c4c-18d7-4a71-9f31-67ed3e11d5d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b95efedd3a8495c92e84447ecca3248, user_id=7ef733644f0749958c55c24359709745, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:51.472649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b1801-6ace-4594-bbc2-da964143de35 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:51.473145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a5c4c-18d7-4a71-9f31-67ed3e11d5d2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:51.489335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 973/1933] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:51.507651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 961/1934] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:51 2022] PUT /identity/v3/projects/4b95efedd3a8495c92e84447ecca3248/users/7ef733644f0749958c55c24359709745/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:51.512630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b1801-6ace-4594-bbc2-da964143de35 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:51.528982 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b1801-6ace-4594-bbc2-da964143de35 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:51.609014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a5c4c-18d7-4a71-9f31-67ed3e11d5d2 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:51.635878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027f91f-53ba-4a99-a3db-7ef2430e299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:51.636640 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027f91f-53ba-4a99-a3db-7ef2430e299c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:51.637061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027f91f-53ba-4a99-a3db-7ef2430e299c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:51.637501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027f91f-53ba-4a99-a3db-7ef2430e299c admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:51.638110 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027f91f-53ba-4a99-a3db-7ef2430e299c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:51.639948 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027f91f-53ba-4a99-a3db-7ef2430e299c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:51.655983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 974/1935] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:51.657077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027f91f-53ba-4a99-a3db-7ef2430e299c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:51.668185 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027f91f-53ba-4a99-a3db-7ef2430e299c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:51.673562 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c20de5-52fc-4050-a826-8672e6724432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:51.674501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c20de5-52fc-4050-a826-8672e6724432 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:51.674811 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c20de5-52fc-4050-a826-8672e6724432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:51.675085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c20de5-52fc-4050-a826-8672e6724432 admin admin] PATH_INFO: `/v3/projects/4b95efedd3a8495c92e84447ecca3248/users/7ef733644f0749958c55c24359709745/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:51.677691 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c20de5-52fc-4050-a826-8672e6724432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b95efedd3a8495c92e84447ecca3248, user_id=7ef733644f0749958c55c24359709745, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:51.681812 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c20de5-52fc-4050-a826-8672e6724432 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:51.686122 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a5c4c-18d7-4a71-9f31-67ed3e11d5d2 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:51.690036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd02604-5e4a-43e1-9260-e2588e66c086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:51.690914 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd02604-5e4a-43e1-9260-e2588e66c086 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:51.691264 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd02604-5e4a-43e1-9260-e2588e66c086 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:51.691612 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd02604-5e4a-43e1-9260-e2588e66c086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:51.693583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ddd02604-5e4a-43e1-9260-e2588e66c086 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:51.696329 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 975/1936] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:51 2022] PUT /identity/v3/projects/4b95efedd3a8495c92e84447ecca3248/users/7ef733644f0749958c55c24359709745/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:51.705138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49b212-e989-47a5-b7c9-74572132f7dc None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:51.705877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49b212-e989-47a5-b7c9-74572132f7dc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:51.706165 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49b212-e989-47a5-b7c9-74572132f7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:51.745546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8f49b212-e989-47a5-b7c9-74572132f7dc None None] MFA Rules not processed for user `7ef733644f0749958c55c24359709745`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:51.746626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8f49b212-e989-47a5-b7c9-74572132f7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:51.779833 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd02604-5e4a-43e1-9260-e2588e66c086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:51.781523 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd02604-5e4a-43e1-9260-e2588e66c086 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:51.795020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 962/1937] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:51.795957 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd02604-5e4a-43e1-9260-e2588e66c086 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:51.797494 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ddd02604-5e4a-43e1-9260-e2588e66c086 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:51.816369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd02604-5e4a-43e1-9260-e2588e66c086 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:51.833140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:51.872466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 976/1938] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:51.882389 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49b212-e989-47a5-b7c9-74572132f7dc None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:51.886689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8f49b212-e989-47a5-b7c9-74572132f7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:51.932893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ba332-80c0-415c-9723-eee569313332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:51.934254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ba332-80c0-415c-9723-eee569313332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:51.934630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ba332-80c0-415c-9723-eee569313332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:51.934985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ba332-80c0-415c-9723-eee569313332 admin admin] PATH_INFO: `/v3/projects/a5a88ae9d3de414d899bad38211fa252` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:51.936498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ba332-80c0-415c-9723-eee569313332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a88ae9d3de414d899bad38211fa252)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:51.939774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ba332-80c0-415c-9723-eee569313332 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:51.967507 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:51.973953 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49b212-e989-47a5-b7c9-74572132f7dc None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:51.980867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08b922-441d-4c48-b379-4cfa402a9426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:51.981734 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08b922-441d-4c48-b379-4cfa402a9426 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:51.981933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08b922-441d-4c48-b379-4cfa402a9426 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:51.982149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08b922-441d-4c48-b379-4cfa402a9426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:51.998903 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08b922-441d-4c48-b379-4cfa402a9426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:52.000900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08b922-441d-4c48-b379-4cfa402a9426 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:52.014137 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 977/1939] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:52.022481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-c00ba332-80c0-415c-9723-eee569313332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a88ae9d3de414d899bad38211fa252', 'request_id': 'req-c00ba332-80c0-415c-9723-eee569313332'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:52.049298 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-c00ba332-80c0-415c-9723-eee569313332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a88ae9d3de414d899bad38211fa252', 'request_id': 'req-c00ba332-80c0-415c-9723-eee569313332'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:52.058607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-c00ba332-80c0-415c-9723-eee569313332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a88ae9d3de414d899bad38211fa252', 'request_id': 'req-c00ba332-80c0-415c-9723-eee569313332'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:52.072913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-c00ba332-80c0-415c-9723-eee569313332 admin admin] The token cache is being invalidate because project a5a88ae9d3de414d899bad38211fa252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:52.073368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-c00ba332-80c0-415c-9723-eee569313332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:52.074278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-c00ba332-80c0-415c-9723-eee569313332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:52.077027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 963/1940] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:51 2022] DELETE /identity/v3/projects/a5a88ae9d3de414d899bad38211fa252 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:52.080717 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08b922-441d-4c48-b379-4cfa402a9426 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:52.093984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08b922-441d-4c48-b379-4cfa402a9426 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:52.176282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46ea29-d120-440c-a306-51c440819d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:52.177252 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46ea29-d120-440c-a306-51c440819d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:52.177534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46ea29-d120-440c-a306-51c440819d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:52.177809 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46ea29-d120-440c-a306-51c440819d11 admin admin] PATH_INFO: `/v3/users/850ecc0c5f9a401e86d82c9a2f842b49` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:52.179156 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46ea29-d120-440c-a306-51c440819d11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=850ecc0c5f9a401e86d82c9a2f842b49)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:52.181907 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46ea29-d120-440c-a306-51c440819d11 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:52.254693 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1a46ea29-d120-440c-a306-51c440819d11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '850ecc0c5f9a401e86d82c9a2f842b49'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:52.255441 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1a46ea29-d120-440c-a306-51c440819d11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '850ecc0c5f9a401e86d82c9a2f842b49'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:52.256138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1a46ea29-d120-440c-a306-51c440819d11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '850ecc0c5f9a401e86d82c9a2f842b49'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:52.269790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1a46ea29-d120-440c-a306-51c440819d11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '850ecc0c5f9a401e86d82c9a2f842b49'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:52.281105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1a46ea29-d120-440c-a306-51c440819d11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '850ecc0c5f9a401e86d82c9a2f842b49'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:52.312041 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 978/1941] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:52 2022] DELETE /identity/v3/users/850ecc0c5f9a401e86d82c9a2f842b49 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:52.383240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ba332-80c0-415c-9723-eee569313332 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:52.385742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c00ba332-80c0-415c-9723-eee569313332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:52.409960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ba332-80c0-415c-9723-eee569313332 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:52.523857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b812f9-84e1-4a23-91c0-528a54fe87bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:52.525635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b812f9-84e1-4a23-91c0-528a54fe87bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:52.525987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b812f9-84e1-4a23-91c0-528a54fe87bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:52.526332 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b812f9-84e1-4a23-91c0-528a54fe87bd admin admin] PATH_INFO: `/v3/users/276e1eae206a48159bc831ebab719a11` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:52.528314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b812f9-84e1-4a23-91c0-528a54fe87bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=276e1eae206a48159bc831ebab719a11)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:52.531391 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b812f9-84e1-4a23-91c0-528a54fe87bd admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:52.597122 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:52.599333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-48b812f9-84e1-4a23-91c0-528a54fe87bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276e1eae206a48159bc831ebab719a11'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:52.630160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-48b812f9-84e1-4a23-91c0-528a54fe87bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276e1eae206a48159bc831ebab719a11'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:52.631986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-48b812f9-84e1-4a23-91c0-528a54fe87bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276e1eae206a48159bc831ebab719a11'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:52.633532 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-48b812f9-84e1-4a23-91c0-528a54fe87bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276e1eae206a48159bc831ebab719a11'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:52.659821 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-48b812f9-84e1-4a23-91c0-528a54fe87bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276e1eae206a48159bc831ebab719a11'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:52.715980 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 964/1942] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:52 2022] DELETE /identity/v3/users/276e1eae206a48159bc831ebab719a11 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:52.721832 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f0126-295b-4c31-aeaf-091d316d0c49 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:52.722387 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f0126-295b-4c31-aeaf-091d316d0c49 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:52.722810 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f0126-295b-4c31-aeaf-091d316d0c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:52.752856 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-907f0126-295b-4c31-aeaf-091d316d0c49 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:52.754685 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-907f0126-295b-4c31-aeaf-091d316d0c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:52.771788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b812f9-84e1-4a23-91c0-528a54fe87bd admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:52.774461 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-48b812f9-84e1-4a23-91c0-528a54fe87bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:52.896922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 979/1943] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:52.904443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f0126-295b-4c31-aeaf-091d316d0c49 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:52.905847 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-907f0126-295b-4c31-aeaf-091d316d0c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:52.919647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b812f9-84e1-4a23-91c0-528a54fe87bd admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:52.923875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:52.929527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe4bc1-9266-497f-96a2-187a2702260d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:52.930845 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe4bc1-9266-497f-96a2-187a2702260d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:52.932484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe4bc1-9266-497f-96a2-187a2702260d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:52.933128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe4bc1-9266-497f-96a2-187a2702260d admin admin] PATH_INFO: `/v3/projects/33e3c062d2c8439e960c6d677bb0b234` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:52.934646 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe4bc1-9266-497f-96a2-187a2702260d admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e3c062d2c8439e960c6d677bb0b234)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:52.936837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe4bc1-9266-497f-96a2-187a2702260d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:53.010452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0afe4bc1-9266-497f-96a2-187a2702260d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e3c062d2c8439e960c6d677bb0b234', 'request_id': 'req-0afe4bc1-9266-497f-96a2-187a2702260d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:53.022591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f0126-295b-4c31-aeaf-091d316d0c49 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:53.025551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0afe4bc1-9266-497f-96a2-187a2702260d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e3c062d2c8439e960c6d677bb0b234', 'request_id': 'req-0afe4bc1-9266-497f-96a2-187a2702260d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:53.038688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0afe4bc1-9266-497f-96a2-187a2702260d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e3c062d2c8439e960c6d677bb0b234', 'request_id': 'req-0afe4bc1-9266-497f-96a2-187a2702260d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:53.066857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0afe4bc1-9266-497f-96a2-187a2702260d admin admin] The token cache is being invalidate because project 33e3c062d2c8439e960c6d677bb0b234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:53.066857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0afe4bc1-9266-497f-96a2-187a2702260d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:53.066857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0afe4bc1-9266-497f-96a2-187a2702260d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:53.068976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 965/1944] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:52 2022] DELETE /identity/v3/projects/33e3c062d2c8439e960c6d677bb0b234 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:53.073454 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15e52-aa51-4ea2-8eec-008409d184fc None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:53.073808 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15e52-aa51-4ea2-8eec-008409d184fc None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:53.074154 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15e52-aa51-4ea2-8eec-008409d184fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:53.091503 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fbb82-32b0-44d8-9d8d-95756b29c88e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:53.092287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fbb82-32b0-44d8-9d8d-95756b29c88e service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:53.092730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fbb82-32b0-44d8-9d8d-95756b29c88e service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:53.093101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fbb82-32b0-44d8-9d8d-95756b29c88e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:53.098324 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9e1fbb82-32b0-44d8-9d8d-95756b29c88e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:53.115706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-17f15e52-aa51-4ea2-8eec-008409d184fc None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:53.117826 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-17f15e52-aa51-4ea2-8eec-008409d184fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:53.188473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fbb82-32b0-44d8-9d8d-95756b29c88e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:53.189383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:53.190646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fbb82-32b0-44d8-9d8d-95756b29c88e service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:53.206708 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 980/1945] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:19:53.207447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fbb82-32b0-44d8-9d8d-95756b29c88e service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:53.215199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9e1fbb82-32b0-44d8-9d8d-95756b29c88e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:53.219938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 966/1946] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:53.230583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f14b2-14f9-4ece-9b85-0b74409a88f9 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:53.231143 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f14b2-14f9-4ece-9b85-0b74409a88f9 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:53.231720 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f14b2-14f9-4ece-9b85-0b74409a88f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:53.262018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b65f14b2-14f9-4ece-9b85-0b74409a88f9 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:53.262680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b65f14b2-14f9-4ece-9b85-0b74409a88f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:53.278658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 967/1947] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:19:53.283870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f14b2-14f9-4ece-9b85-0b74409a88f9 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:53.297683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f14b2-14f9-4ece-9b85-0b74409a88f9 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:53.302623 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8c7a3-71c0-4a1c-a122-36741d4167a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:53.303431 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8c7a3-71c0-4a1c-a122-36741d4167a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:53.303721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8c7a3-71c0-4a1c-a122-36741d4167a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:53.303998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8c7a3-71c0-4a1c-a122-36741d4167a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:53.304993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8c7a3-71c0-4a1c-a122-36741d4167a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:19:53.305314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8c7a3-71c0-4a1c-a122-36741d4167a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:53.307785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8c7a3-71c0-4a1c-a122-36741d4167a7 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:53.323486 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 968/1948] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:19:53.328195 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8c7a3-71c0-4a1c-a122-36741d4167a7 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:53.329917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-33f8c7a3-71c0-4a1c-a122-36741d4167a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:53.343453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8c7a3-71c0-4a1c-a122-36741d4167a7 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:53.346106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fbb82-32b0-44d8-9d8d-95756b29c88e service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:53.350080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd80119-ecbc-45b2-9157-ab4eed180d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:53.351144 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd80119-ecbc-45b2-9157-ab4eed180d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:53.351634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd80119-ecbc-45b2-9157-ab4eed180d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:53.351998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd80119-ecbc-45b2-9157-ab4eed180d96 admin admin] PATH_INFO: `/v3/users/5383e9aaa76942f6ab61cf11dec383d9` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:53.354619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd80119-ecbc-45b2-9157-ab4eed180d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5383e9aaa76942f6ab61cf11dec383d9)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:53.356870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd80119-ecbc-45b2-9157-ab4eed180d96 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:53.358357 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89bc76-3d34-4838-80de-6961d8fb70fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:53.359216 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89bc76-3d34-4838-80de-6961d8fb70fd service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:53.359509 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89bc76-3d34-4838-80de-6961d8fb70fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:53.359794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89bc76-3d34-4838-80de-6961d8fb70fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:53.365807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3e89bc76-3d34-4838-80de-6961d8fb70fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:53.429045 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:53.449862 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-afd80119-ecbc-45b2-9157-ab4eed180d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5383e9aaa76942f6ab61cf11dec383d9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:53.471538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89bc76-3d34-4838-80de-6961d8fb70fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:53.471739 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-afd80119-ecbc-45b2-9157-ab4eed180d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5383e9aaa76942f6ab61cf11dec383d9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:53.473029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-afd80119-ecbc-45b2-9157-ab4eed180d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5383e9aaa76942f6ab61cf11dec383d9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:53.473502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89bc76-3d34-4838-80de-6961d8fb70fd service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:53.473811 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-afd80119-ecbc-45b2-9157-ab4eed180d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5383e9aaa76942f6ab61cf11dec383d9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:53.485920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 981/1949] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:53.486529 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89bc76-3d34-4838-80de-6961d8fb70fd service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:53.499727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89bc76-3d34-4838-80de-6961d8fb70fd service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:53.505143 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaa424-a8c6-4565-af48-861a60273fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:53.505942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaa424-a8c6-4565-af48-861a60273fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:53.506243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaa424-a8c6-4565-af48-861a60273fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:53.506556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaa424-a8c6-4565-af48-861a60273fd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:53.507286 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdaa424-a8c6-4565-af48-861a60273fd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:53.509716 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdaa424-a8c6-4565-af48-861a60273fd6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:53.534821 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-afd80119-ecbc-45b2-9157-ab4eed180d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5383e9aaa76942f6ab61cf11dec383d9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:53.558888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 982/1950] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:53 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:53.561372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaa424-a8c6-4565-af48-861a60273fd6 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:53.565873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0cdaa424-a8c6-4565-af48-861a60273fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:53.570474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 969/1951] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:53 2022] DELETE /identity/v3/users/5383e9aaa76942f6ab61cf11dec383d9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:53.574915 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7fe8-e074-4487-8487-5323acad1866 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:53.575218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7fe8-e074-4487-8487-5323acad1866 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:53.575502 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7fe8-e074-4487-8487-5323acad1866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:53.623733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-8e6e7fe8-e074-4487-8487-5323acad1866 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:53.628558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8e6e7fe8-e074-4487-8487-5323acad1866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:53.737190 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaa424-a8c6-4565-af48-861a60273fd6 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:53.783792 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 970/1952] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:53.835981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2335c-ab9a-41bf-841f-29b47a8ea9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:53.837066 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2335c-ab9a-41bf-841f-29b47a8ea9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:53.837997 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2335c-ab9a-41bf-841f-29b47a8ea9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:53.838265 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2335c-ab9a-41bf-841f-29b47a8ea9d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:53.839274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2335c-ab9a-41bf-841f-29b47a8ea9d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:53.841624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2335c-ab9a-41bf-841f-29b47a8ea9d9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:53.870039 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 983/1953] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:53 2022] POST /identity/v3/users => generated 283 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:53.872856 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e7fe8-e074-4487-8487-5323acad1866 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:53.874695 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2335c-ab9a-41bf-841f-29b47a8ea9d9 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:53.874943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8e6e7fe8-e074-4487-8487-5323acad1866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:53.886723 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2335c-ab9a-41bf-841f-29b47a8ea9d9 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:53.892554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21797d-dcc9-4792-89b6-e789722a340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:53.893292 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21797d-dcc9-4792-89b6-e789722a340e admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:53.893700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21797d-dcc9-4792-89b6-e789722a340e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:53.893984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21797d-dcc9-4792-89b6-e789722a340e admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:53.894892 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21797d-dcc9-4792-89b6-e789722a340e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:53.896667 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21797d-dcc9-4792-89b6-e789722a340e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:53.909157 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 984/1954] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:53.914382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21797d-dcc9-4792-89b6-e789722a340e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:53.927018 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21797d-dcc9-4792-89b6-e789722a340e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:53.934305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce2873-efcf-47a7-a25c-7c2cc480300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:53.935043 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce2873-efcf-47a7-a25c-7c2cc480300c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:53.935373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce2873-efcf-47a7-a25c-7c2cc480300c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:53.935776 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce2873-efcf-47a7-a25c-7c2cc480300c admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:53.936888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce2873-efcf-47a7-a25c-7c2cc480300c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:53.938764 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce2873-efcf-47a7-a25c-7c2cc480300c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:53.956193 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 985/1955] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:53.958023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce2873-efcf-47a7-a25c-7c2cc480300c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:53.971019 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce2873-efcf-47a7-a25c-7c2cc480300c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:53.977819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fca29-e0fe-46ad-a728-1d2fe0fb1246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:53.979020 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fca29-e0fe-46ad-a728-1d2fe0fb1246 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:53.979308 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fca29-e0fe-46ad-a728-1d2fe0fb1246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:53.979584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fca29-e0fe-46ad-a728-1d2fe0fb1246 admin admin] PATH_INFO: `/v3/projects/a900df2ea0c345aba4deebf9bf39c816/users/67da8d9d155e4d14be7827b146073c72/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:54.007961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fca29-e0fe-46ad-a728-1d2fe0fb1246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a900df2ea0c345aba4deebf9bf39c816, user_id=67da8d9d155e4d14be7827b146073c72, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:54.012629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:54.014004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fca29-e0fe-46ad-a728-1d2fe0fb1246 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:54.027056 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e7fe8-e074-4487-8487-5323acad1866 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:54.031967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:54.033845 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf0451-56b8-4a31-8787-e7faed62864e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:54.035430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf0451-56b8-4a31-8787-e7faed62864e service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:54.035857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf0451-56b8-4a31-8787-e7faed62864e service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:54.036291 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf0451-56b8-4a31-8787-e7faed62864e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:54.048362 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf0451-56b8-4a31-8787-e7faed62864e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:54.049926 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf0451-56b8-4a31-8787-e7faed62864e service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:54.063031 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 971/1956] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:19:54.069436 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 986/1957] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:53 2022] PUT /identity/v3/projects/a900df2ea0c345aba4deebf9bf39c816/users/67da8d9d155e4d14be7827b146073c72/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:54.083146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7cd23-a4fd-4c5b-9ce8-bb79dbf48924 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:54.083679 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7cd23-a4fd-4c5b-9ce8-bb79dbf48924 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:54.084665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7cd23-a4fd-4c5b-9ce8-bb79dbf48924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:54.145128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2eb7cd23-a4fd-4c5b-9ce8-bb79dbf48924 None None] MFA Rules not processed for user `67da8d9d155e4d14be7827b146073c72`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:54.146598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2eb7cd23-a4fd-4c5b-9ce8-bb79dbf48924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:54.307277 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 972/1958] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:54.312772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fca29-e0fe-46ad-a728-1d2fe0fb1246 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:54.320600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7cd23-a4fd-4c5b-9ce8-bb79dbf48924 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:54.323379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2eb7cd23-a4fd-4c5b-9ce8-bb79dbf48924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:54.401203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fca29-e0fe-46ad-a728-1d2fe0fb1246 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:54.406892 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5a676-b9ca-4a8e-8e4f-c70e49ae6d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:54.408075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5a676-b9ca-4a8e-8e4f-c70e49ae6d9a admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:54.408487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5a676-b9ca-4a8e-8e4f-c70e49ae6d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:54.408870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5a676-b9ca-4a8e-8e4f-c70e49ae6d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:54.409676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5a676-b9ca-4a8e-8e4f-c70e49ae6d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:54.412421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5a676-b9ca-4a8e-8e4f-c70e49ae6d9a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:54.419621 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7cd23-a4fd-4c5b-9ce8-bb79dbf48924 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:54.426614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:54.428005 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:54.428632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:54.428845 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a admin admin] PATH_INFO: `/v3/projects/0ade71c174fd4feea360d25f3a014e3a` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:54.430115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ade71c174fd4feea360d25f3a014e3a)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:54.433198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:54.455382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 987/1959] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:54 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:19:54.461520 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5a676-b9ca-4a8e-8e4f-c70e49ae6d9a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:54.509994 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ade71c174fd4feea360d25f3a014e3a', 'request_id': 'req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:54.524223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ade71c174fd4feea360d25f3a014e3a', 'request_id': 'req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:54.531938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ade71c174fd4feea360d25f3a014e3a', 'request_id': 'req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:54.544437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a admin admin] The token cache is being invalidate because project 0ade71c174fd4feea360d25f3a014e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:54.544819 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:54.545892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:54.547435 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 973/1960] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:54 2022] DELETE /identity/v3/projects/0ade71c174fd4feea360d25f3a014e3a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:54.551013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:54.552289 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5a676-b9ca-4a8e-8e4f-c70e49ae6d9a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:54.552691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:54.567936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:54.638471 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98241816-fcf9-4ef4-8137-f7ccbe42be82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:54.639162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98241816-fcf9-4ef4-8137-f7ccbe42be82 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:54.639451 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98241816-fcf9-4ef4-8137-f7ccbe42be82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:54.639732 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98241816-fcf9-4ef4-8137-f7ccbe42be82 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:54.640461 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98241816-fcf9-4ef4-8137-f7ccbe42be82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:54.642771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98241816-fcf9-4ef4-8137-f7ccbe42be82 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:54.664599 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df4e81-a06f-4a4a-8d28-64aabe91d15a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:54.668877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 988/1961] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:54 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:54.669531 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98241816-fcf9-4ef4-8137-f7ccbe42be82 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:54.671124 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-98241816-fcf9-4ef4-8137-f7ccbe42be82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:54.672143 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a061ba-f27b-49b2-aeec-ec74f4a1821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:54.673182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a061ba-f27b-49b2-aeec-ec74f4a1821f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:54.673563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a061ba-f27b-49b2-aeec-ec74f4a1821f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:54.673958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a061ba-f27b-49b2-aeec-ec74f4a1821f admin admin] PATH_INFO: `/v3/users/01387091d9c44913a7d16572780a0d01` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:54.675269 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a061ba-f27b-49b2-aeec-ec74f4a1821f admin admin] RBAC: Authorizing `identity:delete_user(user_id=01387091d9c44913a7d16572780a0d01)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:54.677983 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a061ba-f27b-49b2-aeec-ec74f4a1821f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:54.684488 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98241816-fcf9-4ef4-8137-f7ccbe42be82 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:54.691625 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:54.692572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:54.692855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:54.693132 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88 admin admin] PATH_INFO: `/v3/projects/846f8f4bbab045fe8e5e9fda732893b4` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:54.694344 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=846f8f4bbab045fe8e5e9fda732893b4)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:54.698047 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:54.720587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:54.747224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-c9a061ba-f27b-49b2-aeec-ec74f4a1821f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01387091d9c44913a7d16572780a0d01'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:54.759455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-c9a061ba-f27b-49b2-aeec-ec74f4a1821f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01387091d9c44913a7d16572780a0d01'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:54.760567 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-c9a061ba-f27b-49b2-aeec-ec74f4a1821f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01387091d9c44913a7d16572780a0d01'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:54.761212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-c9a061ba-f27b-49b2-aeec-ec74f4a1821f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01387091d9c44913a7d16572780a0d01'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:54.765243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '846f8f4bbab045fe8e5e9fda732893b4', 'request_id': 'req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:54.772831 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '846f8f4bbab045fe8e5e9fda732893b4', 'request_id': 'req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:54.781679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '846f8f4bbab045fe8e5e9fda732893b4', 'request_id': 'req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:54.788386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-c9a061ba-f27b-49b2-aeec-ec74f4a1821f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01387091d9c44913a7d16572780a0d01'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:54.800973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88 admin admin] The token cache is being invalidate because project 846f8f4bbab045fe8e5e9fda732893b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:54.801413 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:54.802217 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:54.802980 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 974/1962] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:54 2022] DELETE /identity/v3/users/01387091d9c44913a7d16572780a0d01 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:54.803795 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a061ba-f27b-49b2-aeec-ec74f4a1821f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:54.803923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 989/1963] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:54 2022] DELETE /identity/v3/projects/846f8f4bbab045fe8e5e9fda732893b4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:54.807633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c9a061ba-f27b-49b2-aeec-ec74f4a1821f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:54.814902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:54.822444 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:54.910563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a061ba-f27b-49b2-aeec-ec74f4a1821f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:54.916305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8c8f7-f2f0-43dd-8db2-8eb804637d88 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:54.917958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868c1e0-c7da-414d-96fc-6fe4cfd2a85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:54.918649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868c1e0-c7da-414d-96fc-6fe4cfd2a85d admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:54.918934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868c1e0-c7da-414d-96fc-6fe4cfd2a85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:54.919221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868c1e0-c7da-414d-96fc-6fe4cfd2a85d admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:54.921071 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868c1e0-c7da-414d-96fc-6fe4cfd2a85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:54.921975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5ee61-0f4e-438e-808a-e022f1f15c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:54.923109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5ee61-0f4e-438e-808a-e022f1f15c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:54.923766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5ee61-0f4e-438e-808a-e022f1f15c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:54.924221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5ee61-0f4e-438e-808a-e022f1f15c64 admin admin] PATH_INFO: `/v3/users/13654835e6224206a32dde199792f23a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:54.924849 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868c1e0-c7da-414d-96fc-6fe4cfd2a85d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:54.926544 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5ee61-0f4e-438e-808a-e022f1f15c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13654835e6224206a32dde199792f23a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:54.929082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5ee61-0f4e-438e-808a-e022f1f15c64 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:54.941213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 975/1964] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:54.946181 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868c1e0-c7da-414d-96fc-6fe4cfd2a85d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:54.949215 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d868c1e0-c7da-414d-96fc-6fe4cfd2a85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:54.969321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868c1e0-c7da-414d-96fc-6fe4cfd2a85d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:54.975171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989aeb7-618d-4f24-ab46-26467bfa8c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:54.976529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989aeb7-618d-4f24-ab46-26467bfa8c4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:54.976885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989aeb7-618d-4f24-ab46-26467bfa8c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:54.977289 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989aeb7-618d-4f24-ab46-26467bfa8c4a admin admin] PATH_INFO: `/v3/projects/6606d9f57be14e469a26326f25b42cfb/users/9e31d4cffc8d4639b3ea7d175cf150d5/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:55.011697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989aeb7-618d-4f24-ab46-26467bfa8c4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6606d9f57be14e469a26326f25b42cfb, user_id=9e31d4cffc8d4639b3ea7d175cf150d5, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:55.014874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989aeb7-618d-4f24-ab46-26467bfa8c4a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:55.019694 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-63f5ee61-0f4e-438e-808a-e022f1f15c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13654835e6224206a32dde199792f23a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:55.020839 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-63f5ee61-0f4e-438e-808a-e022f1f15c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13654835e6224206a32dde199792f23a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:55.022015 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-63f5ee61-0f4e-438e-808a-e022f1f15c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13654835e6224206a32dde199792f23a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:55.031929 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:55.036606 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-63f5ee61-0f4e-438e-808a-e022f1f15c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13654835e6224206a32dde199792f23a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:55.042167 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 976/1965] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:54 2022] PUT /identity/v3/projects/6606d9f57be14e469a26326f25b42cfb/users/9e31d4cffc8d4639b3ea7d175cf150d5/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:55.046816 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989aeb7-618d-4f24-ab46-26467bfa8c4a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:55.049968 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7989aeb7-618d-4f24-ab46-26467bfa8c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:55.052984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-63f5ee61-0f4e-438e-808a-e022f1f15c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13654835e6224206a32dde199792f23a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:55.083546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 990/1966] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:54 2022] DELETE /identity/v3/users/13654835e6224206a32dde199792f23a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:55.174762 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5ee61-0f4e-438e-808a-e022f1f15c64 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:55.176893 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-63f5ee61-0f4e-438e-808a-e022f1f15c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:55.179013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989aeb7-618d-4f24-ab46-26467bfa8c4a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:55.228656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:55.336008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5ee61-0f4e-438e-808a-e022f1f15c64 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:55.371314 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a2767-acd1-4c96-aeec-6d12d917d390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:55.371314 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a2767-acd1-4c96-aeec-6d12d917d390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:55.371314 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a2767-acd1-4c96-aeec-6d12d917d390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:55.371314 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a2767-acd1-4c96-aeec-6d12d917d390 admin admin] PATH_INFO: `/v3/projects/fc8163e0401948ca9c7c204e4b50657d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:55.371742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa31f5d-201b-4252-8189-65812ab78a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:55.371742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa31f5d-201b-4252-8189-65812ab78a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:55.371742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa31f5d-201b-4252-8189-65812ab78a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:55.371742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa31f5d-201b-4252-8189-65812ab78a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:55.372038 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa31f5d-201b-4252-8189-65812ab78a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:55.378164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a2767-acd1-4c96-aeec-6d12d917d390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc8163e0401948ca9c7c204e4b50657d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:55.381178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a2767-acd1-4c96-aeec-6d12d917d390 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:55.385738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa31f5d-201b-4252-8189-65812ab78a27 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:55.414841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 977/1967] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:55.419603 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa31f5d-201b-4252-8189-65812ab78a27 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:55.452056 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa31f5d-201b-4252-8189-65812ab78a27 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:55.478455 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5c4a2767-acd1-4c96-aeec-6d12d917d390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc8163e0401948ca9c7c204e4b50657d', 'request_id': 'req-5c4a2767-acd1-4c96-aeec-6d12d917d390'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:55.506580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5c4a2767-acd1-4c96-aeec-6d12d917d390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc8163e0401948ca9c7c204e4b50657d', 'request_id': 'req-5c4a2767-acd1-4c96-aeec-6d12d917d390'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:55.535879 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5c4a2767-acd1-4c96-aeec-6d12d917d390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc8163e0401948ca9c7c204e4b50657d', 'request_id': 'req-5c4a2767-acd1-4c96-aeec-6d12d917d390'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:55.538699 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67883691-ea74-46b2-9f35-ae9e2b9c770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:55.540328 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67883691-ea74-46b2-9f35-ae9e2b9c770f admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:55.540819 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67883691-ea74-46b2-9f35-ae9e2b9c770f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:55.541267 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67883691-ea74-46b2-9f35-ae9e2b9c770f admin admin] PATH_INFO: `/v3/projects/6606d9f57be14e469a26326f25b42cfb/users/9e31d4cffc8d4639b3ea7d175cf150d5/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:55.545130 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67883691-ea74-46b2-9f35-ae9e2b9c770f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6606d9f57be14e469a26326f25b42cfb, user_id=9e31d4cffc8d4639b3ea7d175cf150d5, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:55.549970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67883691-ea74-46b2-9f35-ae9e2b9c770f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:55.574733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5c4a2767-acd1-4c96-aeec-6d12d917d390 admin admin] The token cache is being invalidate because project fc8163e0401948ca9c7c204e4b50657d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:55.575145 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5c4a2767-acd1-4c96-aeec-6d12d917d390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:55.575840 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 978/1968] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:55 2022] PUT /identity/v3/projects/6606d9f57be14e469a26326f25b42cfb/users/9e31d4cffc8d4639b3ea7d175cf150d5/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:55.575960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5c4a2767-acd1-4c96-aeec-6d12d917d390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:55.577866 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 991/1969] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:55 2022] DELETE /identity/v3/projects/fc8163e0401948ca9c7c204e4b50657d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:55.582485 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94030fd4-a100-4f27-8ba3-afbbf8e9ea80 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:55.582775 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94030fd4-a100-4f27-8ba3-afbbf8e9ea80 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:55.583050 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94030fd4-a100-4f27-8ba3-afbbf8e9ea80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:55.599411 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd9b0-ff8e-43d4-94ad-457d536d5c7e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:55.599907 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd9b0-ff8e-43d4-94ad-457d536d5c7e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:55.600666 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd9b0-ff8e-43d4-94ad-457d536d5c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:55.605443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-94030fd4-a100-4f27-8ba3-afbbf8e9ea80 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:55.606738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-94030fd4-a100-4f27-8ba3-afbbf8e9ea80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:55.643067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f44fd9b0-ff8e-43d4-94ad-457d536d5c7e None None] MFA Rules not processed for user `9e31d4cffc8d4639b3ea7d175cf150d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:55.644750 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f44fd9b0-ff8e-43d4-94ad-457d536d5c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:55.652608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:55.722595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 979/1970] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:55.725997 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a880c-1589-491e-b75f-0ce1394f8cb7 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:55.726351 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a880c-1589-491e-b75f-0ce1394f8cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:55.726934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a880c-1589-491e-b75f-0ce1394f8cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:55.753043 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-354a880c-1589-491e-b75f-0ce1394f8cb7 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:55.754869 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-354a880c-1589-491e-b75f-0ce1394f8cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:55.767628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 980/1971] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:55.767628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a880c-1589-491e-b75f-0ce1394f8cb7 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:55.767628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-354a880c-1589-491e-b75f-0ce1394f8cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:55.772408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 992/1972] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:55 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:19:55.773802 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fd9b0-ff8e-43d4-94ad-457d536d5c7e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:55.796858 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fd9b0-ff8e-43d4-94ad-457d536d5c7e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:55.797260 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a880c-1589-491e-b75f-0ce1394f8cb7 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:55.816523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc6784-44b1-430d-81f4-1a2ce7a5b61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:55.817222 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc6784-44b1-430d-81f4-1a2ce7a5b61a admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:55.817488 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc6784-44b1-430d-81f4-1a2ce7a5b61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:55.817885 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc6784-44b1-430d-81f4-1a2ce7a5b61a admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:55.818576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc6784-44b1-430d-81f4-1a2ce7a5b61a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:19:55.818982 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc6784-44b1-430d-81f4-1a2ce7a5b61a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:55.820681 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc6784-44b1-430d-81f4-1a2ce7a5b61a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:55.829053 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c67a76-4dce-464f-a4b6-b3a86fad3284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:55.830030 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c67a76-4dce-464f-a4b6-b3a86fad3284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:55.830426 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c67a76-4dce-464f-a4b6-b3a86fad3284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:55.830571 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c67a76-4dce-464f-a4b6-b3a86fad3284 admin admin] PATH_INFO: `/v3/projects/111d2d9b4d2044bd8b4e51e47ae24b61` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:55.832300 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c67a76-4dce-464f-a4b6-b3a86fad3284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=111d2d9b4d2044bd8b4e51e47ae24b61)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:55.834087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c67a76-4dce-464f-a4b6-b3a86fad3284 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:55.836091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 993/1973] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:19:55.840331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc6784-44b1-430d-81f4-1a2ce7a5b61a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:55.842093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-60bc6784-44b1-430d-81f4-1a2ce7a5b61a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:55.876127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:55.900234 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-05c67a76-4dce-464f-a4b6-b3a86fad3284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111d2d9b4d2044bd8b4e51e47ae24b61', 'request_id': 'req-05c67a76-4dce-464f-a4b6-b3a86fad3284'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:55.909095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-05c67a76-4dce-464f-a4b6-b3a86fad3284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111d2d9b4d2044bd8b4e51e47ae24b61', 'request_id': 'req-05c67a76-4dce-464f-a4b6-b3a86fad3284'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:55.914079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc6784-44b1-430d-81f4-1a2ce7a5b61a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:55.915816 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-05c67a76-4dce-464f-a4b6-b3a86fad3284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111d2d9b4d2044bd8b4e51e47ae24b61', 'request_id': 'req-05c67a76-4dce-464f-a4b6-b3a86fad3284'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:55.928289 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-05c67a76-4dce-464f-a4b6-b3a86fad3284 admin admin] The token cache is being invalidate because project 111d2d9b4d2044bd8b4e51e47ae24b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:55.928770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-05c67a76-4dce-464f-a4b6-b3a86fad3284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:55.929438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-05c67a76-4dce-464f-a4b6-b3a86fad3284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:55.931774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 981/1974] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:55 2022] DELETE /identity/v3/projects/111d2d9b4d2044bd8b4e51e47ae24b61 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:55.932313 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c67a76-4dce-464f-a4b6-b3a86fad3284 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:55.933587 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-05c67a76-4dce-464f-a4b6-b3a86fad3284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:55.982212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4cf61-40b1-479e-9f7b-36d1f2724185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:55.983601 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4cf61-40b1-479e-9f7b-36d1f2724185 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:55.984107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4cf61-40b1-479e-9f7b-36d1f2724185 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:55.984579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4cf61-40b1-479e-9f7b-36d1f2724185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:55.986775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b2d4cf61-40b1-479e-9f7b-36d1f2724185 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:56.015338 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c67a76-4dce-464f-a4b6-b3a86fad3284 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:56.020209 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139dcf4-aca4-4a15-8126-f73ff2e4496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:56.020926 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139dcf4-aca4-4a15-8126-f73ff2e4496b admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:56.021232 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139dcf4-aca4-4a15-8126-f73ff2e4496b admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:56.021540 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139dcf4-aca4-4a15-8126-f73ff2e4496b admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:56.022421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139dcf4-aca4-4a15-8126-f73ff2e4496b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:56.024383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139dcf4-aca4-4a15-8126-f73ff2e4496b admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:56.052341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 982/1975] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:55 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:56.053657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afc887-186d-4fe2-91de-9098310dc537 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:56.053949 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afc887-186d-4fe2-91de-9098310dc537 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:56.054214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afc887-186d-4fe2-91de-9098310dc537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:56.059776 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4cf61-40b1-479e-9f7b-36d1f2724185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:56.061288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4cf61-40b1-479e-9f7b-36d1f2724185 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:56.070992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 994/1976] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:55 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:56.072498 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4cf61-40b1-479e-9f7b-36d1f2724185 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:56.074469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a5afc887-186d-4fe2-91de-9098310dc537 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:56.075663 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a5afc887-186d-4fe2-91de-9098310dc537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:56.086133 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4cf61-40b1-479e-9f7b-36d1f2724185 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:56.120683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:56.151660 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e27da3-989a-4970-be67-4475dd1f88a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:56.152380 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e27da3-989a-4970-be67-4475dd1f88a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:56.152663 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e27da3-989a-4970-be67-4475dd1f88a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:56.152939 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e27da3-989a-4970-be67-4475dd1f88a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:56.153633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e27da3-989a-4970-be67-4475dd1f88a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:56.155549 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e27da3-989a-4970-be67-4475dd1f88a2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:56.163773 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 983/1977] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:56.174239 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05664ef-c0ae-4739-a507-04f1585751ca None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:56.174549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05664ef-c0ae-4739-a507-04f1585751ca None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:56.174944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05664ef-c0ae-4739-a507-04f1585751ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:56.181538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 995/1978] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:56 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:56.182275 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e27da3-989a-4970-be67-4475dd1f88a2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:56.183933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-59e27da3-989a-4970-be67-4475dd1f88a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:56.195545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a05664ef-c0ae-4739-a507-04f1585751ca None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:56.196796 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a05664ef-c0ae-4739-a507-04f1585751ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:56.204735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 984/1979] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:19:56.205520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05664ef-c0ae-4739-a507-04f1585751ca None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:56.205728 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:56.218423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05664ef-c0ae-4739-a507-04f1585751ca None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:56.222996 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b1011-e2e7-4fd1-8338-448e759d8391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:56.223659 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b1011-e2e7-4fd1-8338-448e759d8391 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:56.223939 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b1011-e2e7-4fd1-8338-448e759d8391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:56.224214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b1011-e2e7-4fd1-8338-448e759d8391 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:56.224966 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b1011-e2e7-4fd1-8338-448e759d8391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:56.226600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b1011-e2e7-4fd1-8338-448e759d8391 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:56.246276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 985/1980] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:56.247153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b1011-e2e7-4fd1-8338-448e759d8391 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:56.255441 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e27da3-989a-4970-be67-4475dd1f88a2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:56.256938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b1011-e2e7-4fd1-8338-448e759d8391 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:56.259416 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e941eda-02b1-474b-8adc-a2ca2debfd98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:56.260077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e941eda-02b1-474b-8adc-a2ca2debfd98 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:56.260427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e941eda-02b1-474b-8adc-a2ca2debfd98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:56.260708 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e941eda-02b1-474b-8adc-a2ca2debfd98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:56.261945 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d2ebc-cf7c-46f6-802c-4ef6f7a10fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:56.262551 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4e941eda-02b1-474b-8adc-a2ca2debfd98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:56.262674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d2ebc-cf7c-46f6-802c-4ef6f7a10fff admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:56.262871 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d2ebc-cf7c-46f6-802c-4ef6f7a10fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:56.263171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d2ebc-cf7c-46f6-802c-4ef6f7a10fff admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:56.263919 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d2ebc-cf7c-46f6-802c-4ef6f7a10fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:19:56.264240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d2ebc-cf7c-46f6-802c-4ef6f7a10fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:56.265877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d2ebc-cf7c-46f6-802c-4ef6f7a10fff admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:56.279738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 986/1981] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:19:56.280678 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d2ebc-cf7c-46f6-802c-4ef6f7a10fff admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:56.292238 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d2ebc-cf7c-46f6-802c-4ef6f7a10fff admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:56.297198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644094bb-b97a-4a2e-9104-31a4ec69ab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:56.297881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644094bb-b97a-4a2e-9104-31a4ec69ab51 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:56.298167 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644094bb-b97a-4a2e-9104-31a4ec69ab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:56.298445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644094bb-b97a-4a2e-9104-31a4ec69ab51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:56.299176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644094bb-b97a-4a2e-9104-31a4ec69ab51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:56.300825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644094bb-b97a-4a2e-9104-31a4ec69ab51 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:56.312226 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 987/1982] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:56.313034 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644094bb-b97a-4a2e-9104-31a4ec69ab51 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:56.323960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644094bb-b97a-4a2e-9104-31a4ec69ab51 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:56.328595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2302b-b666-4db4-91ad-a5428cc1aa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:56.329544 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2302b-b666-4db4-91ad-a5428cc1aa9a admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:56.329826 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2302b-b666-4db4-91ad-a5428cc1aa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:56.330100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2302b-b666-4db4-91ad-a5428cc1aa9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:56.330518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e941eda-02b1-474b-8adc-a2ca2debfd98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:56.330776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2302b-b666-4db4-91ad-a5428cc1aa9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:56.332010 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e941eda-02b1-474b-8adc-a2ca2debfd98 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:56.332754 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2302b-b666-4db4-91ad-a5428cc1aa9a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:56.341587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 996/1983] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:56.342410 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e941eda-02b1-474b-8adc-a2ca2debfd98 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:56.355380 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e941eda-02b1-474b-8adc-a2ca2debfd98 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:56.361822 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22944856-78bc-40b3-a2f8-59d02edf421c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:56.362911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22944856-78bc-40b3-a2f8-59d02edf421c admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:56.363205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22944856-78bc-40b3-a2f8-59d02edf421c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:56.363514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22944856-78bc-40b3-a2f8-59d02edf421c admin admin] PATH_INFO: `/v3/projects/e1ffe41cbe744954bf26fc751a2bd30d/users/8e652767e363458bb9357eedce334090/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:56.367574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 988/1984] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:56 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:56.372313 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2302b-b666-4db4-91ad-a5428cc1aa9a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:56.381413 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22944856-78bc-40b3-a2f8-59d02edf421c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ffe41cbe744954bf26fc751a2bd30d, user_id=8e652767e363458bb9357eedce334090, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:56.384088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22944856-78bc-40b3-a2f8-59d02edf421c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:56.411339 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 997/1985] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:56 2022] PUT /identity/v3/projects/e1ffe41cbe744954bf26fc751a2bd30d/users/8e652767e363458bb9357eedce334090/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:56.413263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1a5a-8ae6-4979-87ef-1533730ed3bc None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:56.413638 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1a5a-8ae6-4979-87ef-1533730ed3bc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:56.413979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1a5a-8ae6-4979-87ef-1533730ed3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:56.447256 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-51ca1a5a-8ae6-4979-87ef-1533730ed3bc None None] MFA Rules not processed for user `8e652767e363458bb9357eedce334090`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:56.448542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-51ca1a5a-8ae6-4979-87ef-1533730ed3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:56.451348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2302b-b666-4db4-91ad-a5428cc1aa9a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:56.544198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 998/1986] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:56.550173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca1a5a-8ae6-4979-87ef-1533730ed3bc None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:56.554665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8657eb-943f-4a2b-9fe0-a4f042d3abc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:56.556446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8657eb-943f-4a2b-9fe0-a4f042d3abc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:56.556796 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8657eb-943f-4a2b-9fe0-a4f042d3abc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:56.557437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8657eb-943f-4a2b-9fe0-a4f042d3abc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:56.558382 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8657eb-943f-4a2b-9fe0-a4f042d3abc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:56.560749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8657eb-943f-4a2b-9fe0-a4f042d3abc0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:56.566044 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca1a5a-8ae6-4979-87ef-1533730ed3bc None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:56.574590 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde448b-9593-4dd9-a276-722a73acf659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:56.576842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde448b-9593-4dd9-a276-722a73acf659 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:56.590538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde448b-9593-4dd9-a276-722a73acf659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:56.591157 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde448b-9593-4dd9-a276-722a73acf659 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:56.591723 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 989/1987] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:56 2022] POST /identity/v3/users => generated 294 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:19:56.593024 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8657eb-943f-4a2b-9fe0-a4f042d3abc0 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:56.596868 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde448b-9593-4dd9-a276-722a73acf659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:56.605206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde448b-9593-4dd9-a276-722a73acf659 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:56.605521 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8657eb-943f-4a2b-9fe0-a4f042d3abc0 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:56.614780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313dae2-44fa-40cf-9ebd-977209fca5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:56.615643 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313dae2-44fa-40cf-9ebd-977209fca5ac admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:56.615936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313dae2-44fa-40cf-9ebd-977209fca5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:56.616220 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313dae2-44fa-40cf-9ebd-977209fca5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:56.617216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313dae2-44fa-40cf-9ebd-977209fca5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:56.620124 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313dae2-44fa-40cf-9ebd-977209fca5ac admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:56.642241 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 990/1988] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:56.646623 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313dae2-44fa-40cf-9ebd-977209fca5ac admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:56.654846 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:56.663096 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 999/1989] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:56 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:19:56.664796 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde448b-9593-4dd9-a276-722a73acf659 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:56.692515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313dae2-44fa-40cf-9ebd-977209fca5ac admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:56.745064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:56.873985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde448b-9593-4dd9-a276-722a73acf659 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:56.890643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea6433-3715-4b9a-ab41-aacab1969d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:56.892850 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea6433-3715-4b9a-ab41-aacab1969d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:56.894962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea6433-3715-4b9a-ab41-aacab1969d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:56.895542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea6433-3715-4b9a-ab41-aacab1969d05 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:56.897753 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea6433-3715-4b9a-ab41-aacab1969d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:56.899125 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247351c-2ff4-49e8-a398-374dc6d61eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:56.902096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247351c-2ff4-49e8-a398-374dc6d61eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:56.902506 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247351c-2ff4-49e8-a398-374dc6d61eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:56.902859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247351c-2ff4-49e8-a398-374dc6d61eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:56.903107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea6433-3715-4b9a-ab41-aacab1969d05 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:56.903933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247351c-2ff4-49e8-a398-374dc6d61eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:56.907978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247351c-2ff4-49e8-a398-374dc6d61eb5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:56.942794 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 991/1990] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:56.947530 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247351c-2ff4-49e8-a398-374dc6d61eb5 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:56.968511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1000/1991] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:56 2022] POST /identity/v3/users => generated 299 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:56.976176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea6433-3715-4b9a-ab41-aacab1969d05 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:56.994776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247351c-2ff4-49e8-a398-374dc6d61eb5 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:57.004271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea6433-3715-4b9a-ab41-aacab1969d05 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:57.011686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa2603-f182-418c-9a30-55de877ab87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:57.012634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a6fdb-ff54-4c47-911a-b964f2df3328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:57.013340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa2603-f182-418c-9a30-55de877ab87d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:57.014849 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa2603-f182-418c-9a30-55de877ab87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:57.015376 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa2603-f182-418c-9a30-55de877ab87d admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:57.015913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a6fdb-ff54-4c47-911a-b964f2df3328 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:57.016221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a6fdb-ff54-4c47-911a-b964f2df3328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:57.016551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a6fdb-ff54-4c47-911a-b964f2df3328 admin admin] PATH_INFO: `/v3/projects/69bba75f8913464e89da1e4f5a850681/users/0a8166869a7440bcbee83ff7aeb00b0f/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:57.016932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa2603-f182-418c-9a30-55de877ab87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:57.019026 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa2603-f182-418c-9a30-55de877ab87d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:57.037940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1001/1992] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:57.044077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa2603-f182-418c-9a30-55de877ab87d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:57.060749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a6fdb-ff54-4c47-911a-b964f2df3328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69bba75f8913464e89da1e4f5a850681, user_id=0a8166869a7440bcbee83ff7aeb00b0f, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:57.063707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a6fdb-ff54-4c47-911a-b964f2df3328 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:57.073745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa2603-f182-418c-9a30-55de877ab87d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:57.116802 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada7fb9-2c6e-468d-9851-7b17532d663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:57.117730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada7fb9-2c6e-468d-9851-7b17532d663a admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:57.118018 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada7fb9-2c6e-468d-9851-7b17532d663a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:57.118354 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada7fb9-2c6e-468d-9851-7b17532d663a admin admin] PATH_INFO: `/v3/projects/208253d7ad0f433fb0212c420a55618c/users/2e0e81b3121d477794c0bd706fcfecde/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:57.122279 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 992/1993] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:56 2022] PUT /identity/v3/projects/69bba75f8913464e89da1e4f5a850681/users/0a8166869a7440bcbee83ff7aeb00b0f/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:57.136915 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f207c21-d336-4967-82a8-fa6910e0788e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:57.137158 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f207c21-d336-4967-82a8-fa6910e0788e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:57.137769 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f207c21-d336-4967-82a8-fa6910e0788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:57.184733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada7fb9-2c6e-468d-9851-7b17532d663a admin admin] RBAC: Authorizing `identity:create_grant(project_id=208253d7ad0f433fb0212c420a55618c, user_id=2e0e81b3121d477794c0bd706fcfecde, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:57.196868 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada7fb9-2c6e-468d-9851-7b17532d663a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:57.243255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1002/1994] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:57 2022] PUT /identity/v3/projects/208253d7ad0f433fb0212c420a55618c/users/2e0e81b3121d477794c0bd706fcfecde/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:57.245752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-4f207c21-d336-4967-82a8-fa6910e0788e None None] MFA Rules not processed for user `0a8166869a7440bcbee83ff7aeb00b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:57.248312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada7fb9-2c6e-468d-9851-7b17532d663a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:57.257771 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4f207c21-d336-4967-82a8-fa6910e0788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:57.381376 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada7fb9-2c6e-468d-9851-7b17532d663a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:57.387312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7126f8-0d6e-4446-a407-598fc1fd399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:57.388131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7126f8-0d6e-4446-a407-598fc1fd399d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:57.388405 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7126f8-0d6e-4446-a407-598fc1fd399d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:57.388683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7126f8-0d6e-4446-a407-598fc1fd399d admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:57.389561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7126f8-0d6e-4446-a407-598fc1fd399d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:57.391375 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7126f8-0d6e-4446-a407-598fc1fd399d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:57.397184 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 993/1995] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:57.402357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f207c21-d336-4967-82a8-fa6910e0788e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:57.414825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1003/1996] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:19:57.417811 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7126f8-0d6e-4446-a407-598fc1fd399d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:57.419325 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f207c21-d336-4967-82a8-fa6910e0788e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:57.432696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee138a9f-f313-44fe-a6da-c22e88685c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:57.433381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee138a9f-f313-44fe-a6da-c22e88685c45 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:57.433661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee138a9f-f313-44fe-a6da-c22e88685c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:57.433932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee138a9f-f313-44fe-a6da-c22e88685c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:57.434048 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7126f8-0d6e-4446-a407-598fc1fd399d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:57.434631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee138a9f-f313-44fe-a6da-c22e88685c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:57.436560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee138a9f-f313-44fe-a6da-c22e88685c45 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:57.442051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4041b5-1e51-4e00-9136-f0b21252f7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:57.443949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4041b5-1e51-4e00-9136-f0b21252f7a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:57.444439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4041b5-1e51-4e00-9136-f0b21252f7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:57.444933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4041b5-1e51-4e00-9136-f0b21252f7a1 admin admin] PATH_INFO: `/v3/projects/208253d7ad0f433fb0212c420a55618c/users/2e0e81b3121d477794c0bd706fcfecde/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:57.449778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4041b5-1e51-4e00-9136-f0b21252f7a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=208253d7ad0f433fb0212c420a55618c, user_id=2e0e81b3121d477794c0bd706fcfecde, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:57.455241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4041b5-1e51-4e00-9136-f0b21252f7a1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:57.469000 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 994/1997] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:19:57 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:19:57.469909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1004/1998] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:57 2022] PUT /identity/v3/projects/208253d7ad0f433fb0212c420a55618c/users/2e0e81b3121d477794c0bd706fcfecde/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:57.472746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee138a9f-f313-44fe-a6da-c22e88685c45 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:57.483333 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee36e9-6945-4dc6-8470-271045b04c4d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:57.484066 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee36e9-6945-4dc6-8470-271045b04c4d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:57.484306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee36e9-6945-4dc6-8470-271045b04c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:57.513322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8cee36e9-6945-4dc6-8470-271045b04c4d None None] MFA Rules not processed for user `2e0e81b3121d477794c0bd706fcfecde`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:57.514586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8cee36e9-6945-4dc6-8470-271045b04c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:57.528386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:57.548193 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee138a9f-f313-44fe-a6da-c22e88685c45 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:57.552816 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718584c0-fe56-4cb7-b609-c3b1eb3e9c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:57.553594 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718584c0-fe56-4cb7-b609-c3b1eb3e9c68 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:57.553886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718584c0-fe56-4cb7-b609-c3b1eb3e9c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:57.554169 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718584c0-fe56-4cb7-b609-c3b1eb3e9c68 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:57.555026 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718584c0-fe56-4cb7-b609-c3b1eb3e9c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:57.557038 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718584c0-fe56-4cb7-b609-c3b1eb3e9c68 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:57.560746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:57.579514 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 995/1999] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:19:57 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:19:57.583350 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718584c0-fe56-4cb7-b609-c3b1eb3e9c68 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:57.588698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1005/2000] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:19:57.594146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718584c0-fe56-4cb7-b609-c3b1eb3e9c68 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:57.598858 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba777846-bd18-4566-afe8-04f06122020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:57.599524 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba777846-bd18-4566-afe8-04f06122020a admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:57.599808 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba777846-bd18-4566-afe8-04f06122020a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:57.600087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba777846-bd18-4566-afe8-04f06122020a admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:57.600305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee36e9-6945-4dc6-8470-271045b04c4d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:57.600993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba777846-bd18-4566-afe8-04f06122020a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:57.601710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8cee36e9-6945-4dc6-8470-271045b04c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:57.603349 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba777846-bd18-4566-afe8-04f06122020a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:57.614156 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 996/2001] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:19:57.619431 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba777846-bd18-4566-afe8-04f06122020a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:57.629946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba777846-bd18-4566-afe8-04f06122020a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:57.637437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f309d7-3258-42c8-9a8a-eac8a12e6f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:57.638342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f309d7-3258-42c8-9a8a-eac8a12e6f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:57.638622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f309d7-3258-42c8-9a8a-eac8a12e6f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:57.638912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f309d7-3258-42c8-9a8a-eac8a12e6f33 admin admin] PATH_INFO: `/v3/projects/5831fb69c34b422e8fca963c05993538/users/96831838ed494415a168e144364643d8/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:57.655847 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f309d7-3258-42c8-9a8a-eac8a12e6f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5831fb69c34b422e8fca963c05993538, user_id=96831838ed494415a168e144364643d8, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:57.658946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f309d7-3258-42c8-9a8a-eac8a12e6f33 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:57.667805 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee36e9-6945-4dc6-8470-271045b04c4d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:57.672621 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 997/2002] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:57 2022] PUT /identity/v3/projects/5831fb69c34b422e8fca963c05993538/users/96831838ed494415a168e144364643d8/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:57.676458 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f309d7-3258-42c8-9a8a-eac8a12e6f33 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:57.719766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737ddb4-4e3b-4614-8610-1dfd405e77e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:57.720493 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737ddb4-4e3b-4614-8610-1dfd405e77e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:57.720802 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737ddb4-4e3b-4614-8610-1dfd405e77e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:57.721079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737ddb4-4e3b-4614-8610-1dfd405e77e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:57.742724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f309d7-3258-42c8-9a8a-eac8a12e6f33 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:57.748731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f2944-b518-47b9-925d-c34c9e804013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:57.749456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f2944-b518-47b9-925d-c34c9e804013 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:57.749742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f2944-b518-47b9-925d-c34c9e804013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:57.750029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f2944-b518-47b9-925d-c34c9e804013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:57.750774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f2944-b518-47b9-925d-c34c9e804013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:57.752444 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f2944-b518-47b9-925d-c34c9e804013 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:57.763431 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 998/2003] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:19:57.767644 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f2944-b518-47b9-925d-c34c9e804013 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:57.778168 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f2944-b518-47b9-925d-c34c9e804013 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:57.784234 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d055c-9f66-4922-b821-6246be6638e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:57.785160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d055c-9f66-4922-b821-6246be6638e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:57.785474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d055c-9f66-4922-b821-6246be6638e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:57.785757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d055c-9f66-4922-b821-6246be6638e4 admin admin] PATH_INFO: `/v3/projects/5831fb69c34b422e8fca963c05993538/users/96831838ed494415a168e144364643d8/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:57.785922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737ddb4-4e3b-4614-8610-1dfd405e77e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:57.787368 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737ddb4-4e3b-4614-8610-1dfd405e77e6 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:57.787762 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d055c-9f66-4922-b821-6246be6638e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5831fb69c34b422e8fca963c05993538, user_id=96831838ed494415a168e144364643d8, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:57.790577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d055c-9f66-4922-b821-6246be6638e4 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:57.796580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1006/2004] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:19:57.801672 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 999/2005] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:19:57 2022] PUT /identity/v3/projects/5831fb69c34b422e8fca963c05993538/users/96831838ed494415a168e144364643d8/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:19:57.812897 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881630b-6561-4f45-a1dd-caacd641f310 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:57.813192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881630b-6561-4f45-a1dd-caacd641f310 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:57.813483 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881630b-6561-4f45-a1dd-caacd641f310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:57.877572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3881630b-6561-4f45-a1dd-caacd641f310 None None] MFA Rules not processed for user `96831838ed494415a168e144364643d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:57.879067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3881630b-6561-4f45-a1dd-caacd641f310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:57.938162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:57.986352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1007/2006] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:19:58.163617 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d055c-9f66-4922-b821-6246be6638e4 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:58.248117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d055c-9f66-4922-b821-6246be6638e4 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:58.252281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4e5e1-69df-438c-add3-0231204c8716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:58.252941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4e5e1-69df-438c-add3-0231204c8716 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:58.253228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4e5e1-69df-438c-add3-0231204c8716 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:58.253507 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4e5e1-69df-438c-add3-0231204c8716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:58.271415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4e5e1-69df-438c-add3-0231204c8716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:58.274386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4e5e1-69df-438c-add3-0231204c8716 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:58.286240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1000/2007] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:58.499600 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881630b-6561-4f45-a1dd-caacd641f310 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:58.650312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881630b-6561-4f45-a1dd-caacd641f310 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:58.656228 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988cb35-3b8d-4a5b-a400-2d8260835067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:58.658214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988cb35-3b8d-4a5b-a400-2d8260835067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:58.658924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988cb35-3b8d-4a5b-a400-2d8260835067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:58.659101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988cb35-3b8d-4a5b-a400-2d8260835067 admin admin] PATH_INFO: `/v3/users/0a8166869a7440bcbee83ff7aeb00b0f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:58.660477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988cb35-3b8d-4a5b-a400-2d8260835067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8166869a7440bcbee83ff7aeb00b0f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:58.662427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988cb35-3b8d-4a5b-a400-2d8260835067 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:58.724053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d988cb35-3b8d-4a5b-a400-2d8260835067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8166869a7440bcbee83ff7aeb00b0f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:58.725061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d988cb35-3b8d-4a5b-a400-2d8260835067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8166869a7440bcbee83ff7aeb00b0f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:58.725794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d988cb35-3b8d-4a5b-a400-2d8260835067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8166869a7440bcbee83ff7aeb00b0f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:58.736952 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d988cb35-3b8d-4a5b-a400-2d8260835067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8166869a7440bcbee83ff7aeb00b0f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:58.742963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4e5e1-69df-438c-add3-0231204c8716 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:58.748683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d988cb35-3b8d-4a5b-a400-2d8260835067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8166869a7440bcbee83ff7aeb00b0f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:58.753192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4e5e1-69df-438c-add3-0231204c8716 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:58.757117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce2e55-26a7-4b00-965f-376e12d4bac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:58.757863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2e55-26a7-4b00-965f-376e12d4bac2 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:58.758539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2e55-26a7-4b00-965f-376e12d4bac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:58.758724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2e55-26a7-4b00-965f-376e12d4bac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:58.761143 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-75ce2e55-26a7-4b00-965f-376e12d4bac2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:58.771167 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1008/2008] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:58 2022] DELETE /identity/v3/users/0a8166869a7440bcbee83ff7aeb00b0f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:58.777825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a1214-1ccb-4d52-ad8f-52b80d069ef6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:58.777825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a1214-1ccb-4d52-ad8f-52b80d069ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:58.777825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a1214-1ccb-4d52-ad8f-52b80d069ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:58.796830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:58.812417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7e6a1214-1ccb-4d52-ad8f-52b80d069ef6 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:19:58.813945 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7e6a1214-1ccb-4d52-ad8f-52b80d069ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:58.850996 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce2e55-26a7-4b00-965f-376e12d4bac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:58.852135 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce2e55-26a7-4b00-965f-376e12d4bac2 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:58.876659 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1001/2009] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:58.897699 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:19:58.915028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1009/2010] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:19:58.925056 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce2e55-26a7-4b00-965f-376e12d4bac2 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:58.926874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-75ce2e55-26a7-4b00-965f-376e12d4bac2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:59.046654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce2e55-26a7-4b00-965f-376e12d4bac2 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:59.160336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff4f0e-067d-476f-ae28-9fd57b8de4de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:59.161030 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff4f0e-067d-476f-ae28-9fd57b8de4de service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:59.161383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff4f0e-067d-476f-ae28-9fd57b8de4de service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:59.161656 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff4f0e-067d-476f-ae28-9fd57b8de4de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:59.173445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff4f0e-067d-476f-ae28-9fd57b8de4de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:59.175234 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff4f0e-067d-476f-ae28-9fd57b8de4de service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:59.187368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1002/2011] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:19:59.536890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a1214-1ccb-4d52-ad8f-52b80d069ef6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:59.538262 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7e6a1214-1ccb-4d52-ad8f-52b80d069ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:19:59.558300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a1214-1ccb-4d52-ad8f-52b80d069ef6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:59.566399 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f475668-be6c-437e-ba7f-310097f35bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:59.567791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f475668-be6c-437e-ba7f-310097f35bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:59.568078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f475668-be6c-437e-ba7f-310097f35bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:59.569879 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f475668-be6c-437e-ba7f-310097f35bf1 admin admin] PATH_INFO: `/v3/projects/69bba75f8913464e89da1e4f5a850681` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:59.571709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f475668-be6c-437e-ba7f-310097f35bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69bba75f8913464e89da1e4f5a850681)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:59.574006 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f475668-be6c-437e-ba7f-310097f35bf1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:59.656033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2f475668-be6c-437e-ba7f-310097f35bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69bba75f8913464e89da1e4f5a850681', 'request_id': 'req-2f475668-be6c-437e-ba7f-310097f35bf1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:59.663258 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2f475668-be6c-437e-ba7f-310097f35bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69bba75f8913464e89da1e4f5a850681', 'request_id': 'req-2f475668-be6c-437e-ba7f-310097f35bf1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:59.670955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2f475668-be6c-437e-ba7f-310097f35bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69bba75f8913464e89da1e4f5a850681', 'request_id': 'req-2f475668-be6c-437e-ba7f-310097f35bf1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:59.691008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2f475668-be6c-437e-ba7f-310097f35bf1 admin admin] The token cache is being invalidate because project 69bba75f8913464e89da1e4f5a850681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:19:59.691467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2f475668-be6c-437e-ba7f-310097f35bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:59.704298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2f475668-be6c-437e-ba7f-310097f35bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:19:59.712384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff4f0e-067d-476f-ae28-9fd57b8de4de service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:19:59.717111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1010/2012] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:19:59 2022] DELETE /identity/v3/projects/69bba75f8913464e89da1e4f5a850681 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:19:59.726104 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff4f0e-067d-476f-ae28-9fd57b8de4de service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:19:59.892956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e489e-a942-47cc-9feb-3d6915236fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:19:59.898779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e489e-a942-47cc-9feb-3d6915236fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:19:59.904739 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e489e-a942-47cc-9feb-3d6915236fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:19:59.905246 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e489e-a942-47cc-9feb-3d6915236fad admin admin] PATH_INFO: `/v3/users/96831838ed494415a168e144364643d8` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:19:59.908608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e489e-a942-47cc-9feb-3d6915236fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=96831838ed494415a168e144364643d8)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:19:59.914705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e489e-a942-47cc-9feb-3d6915236fad admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:19:59.983463 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:00.027947 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-aa9e489e-a942-47cc-9feb-3d6915236fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96831838ed494415a168e144364643d8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:00.044008 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-aa9e489e-a942-47cc-9feb-3d6915236fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96831838ed494415a168e144364643d8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:00.044706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-aa9e489e-a942-47cc-9feb-3d6915236fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96831838ed494415a168e144364643d8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:00.045556 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-aa9e489e-a942-47cc-9feb-3d6915236fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96831838ed494415a168e144364643d8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:00.063395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-aa9e489e-a942-47cc-9feb-3d6915236fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96831838ed494415a168e144364643d8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:00.080552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1003/2013] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:19:59 2022] DELETE /identity/v3/users/96831838ed494415a168e144364643d8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:00.416837 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f475668-be6c-437e-ba7f-310097f35bf1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:00.418448 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2f475668-be6c-437e-ba7f-310097f35bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:00.446639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f475668-be6c-437e-ba7f-310097f35bf1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:00.504823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d753192-1a08-4964-80bf-80d5acff7d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:00.505696 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d753192-1a08-4964-80bf-80d5acff7d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:00.505979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d753192-1a08-4964-80bf-80d5acff7d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:00.506256 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d753192-1a08-4964-80bf-80d5acff7d4d admin admin] PATH_INFO: `/v3/projects/5831fb69c34b422e8fca963c05993538` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:00.507437 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d753192-1a08-4964-80bf-80d5acff7d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5831fb69c34b422e8fca963c05993538)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:00.509459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d753192-1a08-4964-80bf-80d5acff7d4d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:00.555342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1d753192-1a08-4964-80bf-80d5acff7d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5831fb69c34b422e8fca963c05993538', 'request_id': 'req-1d753192-1a08-4964-80bf-80d5acff7d4d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:00.561855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1d753192-1a08-4964-80bf-80d5acff7d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5831fb69c34b422e8fca963c05993538', 'request_id': 'req-1d753192-1a08-4964-80bf-80d5acff7d4d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:00.568443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1d753192-1a08-4964-80bf-80d5acff7d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5831fb69c34b422e8fca963c05993538', 'request_id': 'req-1d753192-1a08-4964-80bf-80d5acff7d4d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:00.581039 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1d753192-1a08-4964-80bf-80d5acff7d4d admin admin] The token cache is being invalidate because project 5831fb69c34b422e8fca963c05993538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:00.581332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1d753192-1a08-4964-80bf-80d5acff7d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:00.581970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1d753192-1a08-4964-80bf-80d5acff7d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:00.583538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1011/2014] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:00 2022] DELETE /identity/v3/projects/5831fb69c34b422e8fca963c05993538 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:00.590090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30537a88-6c50-4153-97fd-b52303896e2b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:00.590383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30537a88-6c50-4153-97fd-b52303896e2b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:00.590665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30537a88-6c50-4153-97fd-b52303896e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:00.616403 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-30537a88-6c50-4153-97fd-b52303896e2b None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:00.617658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-30537a88-6c50-4153-97fd-b52303896e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:00.691850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1004/2015] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:00.692858 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1b14e-d640-4236-854d-9a34d1bac320 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:00.693154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1b14e-d640-4236-854d-9a34d1bac320 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:00.693668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1b14e-d640-4236-854d-9a34d1bac320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:00.728919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-47e1b14e-d640-4236-854d-9a34d1bac320 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:00.730719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-47e1b14e-d640-4236-854d-9a34d1bac320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:00.744383 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1012/2016] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:20:00.746783 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30537a88-6c50-4153-97fd-b52303896e2b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:00.760156 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30537a88-6c50-4153-97fd-b52303896e2b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:00.765028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315f1d7-83d6-4572-ac7b-9a28bb7972b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:00.766194 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315f1d7-83d6-4572-ac7b-9a28bb7972b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:00.766194 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315f1d7-83d6-4572-ac7b-9a28bb7972b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:00.766391 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315f1d7-83d6-4572-ac7b-9a28bb7972b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:00.767158 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315f1d7-83d6-4572-ac7b-9a28bb7972b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:20:00.767468 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315f1d7-83d6-4572-ac7b-9a28bb7972b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:00.769179 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315f1d7-83d6-4572-ac7b-9a28bb7972b9 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:00.789731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1005/2017] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:20:00.789926 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1b14e-d640-4236-854d-9a34d1bac320 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:00.794529 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:00.807246 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1b14e-d640-4236-854d-9a34d1bac320 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:00.812539 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123bc7a-adc7-4424-9f8e-41cba09fd036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:00.813204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123bc7a-adc7-4424-9f8e-41cba09fd036 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:00.813486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123bc7a-adc7-4424-9f8e-41cba09fd036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:00.813761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123bc7a-adc7-4424-9f8e-41cba09fd036 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:00.814473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123bc7a-adc7-4424-9f8e-41cba09fd036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:00.816477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123bc7a-adc7-4424-9f8e-41cba09fd036 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:00.851953 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1013/2018] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:00 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:20:00.856315 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315f1d7-83d6-4572-ac7b-9a28bb7972b9 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:00.866952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315f1d7-83d6-4572-ac7b-9a28bb7972b9 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:00.954106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f23e3d-2510-4026-bc8a-80be96d5ba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:00.955029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f23e3d-2510-4026-bc8a-80be96d5ba0f admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:00.955406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f23e3d-2510-4026-bc8a-80be96d5ba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:00.956198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f23e3d-2510-4026-bc8a-80be96d5ba0f admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:00.957043 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f23e3d-2510-4026-bc8a-80be96d5ba0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:00.959010 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f23e3d-2510-4026-bc8a-80be96d5ba0f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:00.988890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1006/2019] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:00 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:20:00.993572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123bc7a-adc7-4424-9f8e-41cba09fd036 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:01.014940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123bc7a-adc7-4424-9f8e-41cba09fd036 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:01.022096 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41359b17-35c4-4065-aae9-196e25a19623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:01.022839 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41359b17-35c4-4065-aae9-196e25a19623 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:01.023056 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41359b17-35c4-4065-aae9-196e25a19623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:01.023339 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41359b17-35c4-4065-aae9-196e25a19623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:01.027176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41359b17-35c4-4065-aae9-196e25a19623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:01.027176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41359b17-35c4-4065-aae9-196e25a19623 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:01.042251 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1014/2020] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:01.043081 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f23e3d-2510-4026-bc8a-80be96d5ba0f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:01.054620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f23e3d-2510-4026-bc8a-80be96d5ba0f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:01.065446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60904932-7941-4fb3-babb-0ba6d14036a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:01.066350 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60904932-7941-4fb3-babb-0ba6d14036a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:01.066791 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60904932-7941-4fb3-babb-0ba6d14036a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:01.067219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60904932-7941-4fb3-babb-0ba6d14036a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:01.068309 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60904932-7941-4fb3-babb-0ba6d14036a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:01.070455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60904932-7941-4fb3-babb-0ba6d14036a7 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:01.084152 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1007/2021] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:01.088229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41359b17-35c4-4065-aae9-196e25a19623 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:01.099763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41359b17-35c4-4065-aae9-196e25a19623 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:01.112690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae163c-ce00-4f22-9f65-d6768be60059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:01.120348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae163c-ce00-4f22-9f65-d6768be60059 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:01.120860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae163c-ce00-4f22-9f65-d6768be60059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:01.121439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae163c-ce00-4f22-9f65-d6768be60059 admin admin] PATH_INFO: `/v3/projects/934bf53ca23b4f5eb2a84c24e18521ac/users/d9636cb42425425990e5881f2dfc9687/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:01.161170 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae163c-ce00-4f22-9f65-d6768be60059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=934bf53ca23b4f5eb2a84c24e18521ac, user_id=d9636cb42425425990e5881f2dfc9687, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:01.167050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae163c-ce00-4f22-9f65-d6768be60059 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:01.172998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60904932-7941-4fb3-babb-0ba6d14036a7 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:01.174896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-60904932-7941-4fb3-babb-0ba6d14036a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:01.188747 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:01.197671 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60904932-7941-4fb3-babb-0ba6d14036a7 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:01.232591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1015/2022] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:01 2022] PUT /identity/v3/projects/934bf53ca23b4f5eb2a84c24e18521ac/users/d9636cb42425425990e5881f2dfc9687/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:20:01.247522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dcb87-98c4-4697-ad2b-d24dc34005f7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:01.247826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dcb87-98c4-4697-ad2b-d24dc34005f7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:01.248740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dcb87-98c4-4697-ad2b-d24dc34005f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:01.345990 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b47dcb87-98c4-4697-ad2b-d24dc34005f7 None None] MFA Rules not processed for user `d9636cb42425425990e5881f2dfc9687`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:01.349364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b47dcb87-98c4-4697-ad2b-d24dc34005f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:01.380464 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372ae13-ae76-4cf2-a4ad-0fb7f9d6dd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:01.381412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372ae13-ae76-4cf2-a4ad-0fb7f9d6dd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:01.381683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372ae13-ae76-4cf2-a4ad-0fb7f9d6dd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:01.381967 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372ae13-ae76-4cf2-a4ad-0fb7f9d6dd05 admin admin] PATH_INFO: `/v3/users/67da8d9d155e4d14be7827b146073c72` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:01.386366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372ae13-ae76-4cf2-a4ad-0fb7f9d6dd05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67da8d9d155e4d14be7827b146073c72)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:01.395707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372ae13-ae76-4cf2-a4ad-0fb7f9d6dd05 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:01.508660 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7372ae13-ae76-4cf2-a4ad-0fb7f9d6dd05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67da8d9d155e4d14be7827b146073c72'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:01.514982 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1016/2023] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:01.518372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dcb87-98c4-4697-ad2b-d24dc34005f7 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:01.531945 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7372ae13-ae76-4cf2-a4ad-0fb7f9d6dd05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67da8d9d155e4d14be7827b146073c72'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:01.532998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7372ae13-ae76-4cf2-a4ad-0fb7f9d6dd05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67da8d9d155e4d14be7827b146073c72'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:01.535425 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7372ae13-ae76-4cf2-a4ad-0fb7f9d6dd05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67da8d9d155e4d14be7827b146073c72'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:01.546445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dcb87-98c4-4697-ad2b-d24dc34005f7 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:01.560091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f5bcc-984b-446c-86e2-5def01090dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:01.560825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f5bcc-984b-446c-86e2-5def01090dad admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:01.561119 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f5bcc-984b-446c-86e2-5def01090dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:01.561403 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f5bcc-984b-446c-86e2-5def01090dad admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:01.562106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f5bcc-984b-446c-86e2-5def01090dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:01.569925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7372ae13-ae76-4cf2-a4ad-0fb7f9d6dd05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67da8d9d155e4d14be7827b146073c72'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:01.580161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f5bcc-984b-446c-86e2-5def01090dad admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:01.598288 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1008/2024] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:01 2022] DELETE /identity/v3/users/67da8d9d155e4d14be7827b146073c72 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:01.608756 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e99e5-d66f-4999-b69f-6312c0eda5d3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:01.609669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e99e5-d66f-4999-b69f-6312c0eda5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:01.610790 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e99e5-d66f-4999-b69f-6312c0eda5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:01.654787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1017/2025] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:01 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:01.656102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f5bcc-984b-446c-86e2-5def01090dad admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:01.659919 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-374e99e5-d66f-4999-b69f-6312c0eda5d3 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:01.660478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ec5f5bcc-984b-446c-86e2-5def01090dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:01.661186 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-374e99e5-d66f-4999-b69f-6312c0eda5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:01.808775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f5bcc-984b-446c-86e2-5def01090dad admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:01.820116 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1009/2026] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:01.831382 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e99e5-d66f-4999-b69f-6312c0eda5d3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:01.832805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-374e99e5-d66f-4999-b69f-6312c0eda5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:01.836743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4ad27-56e6-4b4f-ade1-aeab2fdd0002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:01.837936 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4ad27-56e6-4b4f-ade1-aeab2fdd0002 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:01.838296 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4ad27-56e6-4b4f-ade1-aeab2fdd0002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:01.839061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4ad27-56e6-4b4f-ade1-aeab2fdd0002 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:01.840427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4ad27-56e6-4b4f-ade1-aeab2fdd0002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:01.845406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4ad27-56e6-4b4f-ade1-aeab2fdd0002 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:01.880230 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1018/2027] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:01 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:20:01.881951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4ad27-56e6-4b4f-ade1-aeab2fdd0002 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:01.890585 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:01.901475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4ad27-56e6-4b4f-ade1-aeab2fdd0002 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:01.903449 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:01.913579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713d0bc-1641-4188-b41c-2777318dd8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:01.915556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713d0bc-1641-4188-b41c-2777318dd8bd admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:01.918420 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713d0bc-1641-4188-b41c-2777318dd8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:01.919266 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713d0bc-1641-4188-b41c-2777318dd8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:01.922123 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713d0bc-1641-4188-b41c-2777318dd8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:01.940870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713d0bc-1641-4188-b41c-2777318dd8bd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:01.956298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1019/2028] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:20:01.960477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713d0bc-1641-4188-b41c-2777318dd8bd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:01.974341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713d0bc-1641-4188-b41c-2777318dd8bd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:01.977392 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e99e5-d66f-4999-b69f-6312c0eda5d3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:01.980057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96297caa-64e7-42ec-835c-3e2d58876c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:01.980914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96297caa-64e7-42ec-835c-3e2d58876c5b admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:01.981204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96297caa-64e7-42ec-835c-3e2d58876c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:01.981418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd02f4-2558-4b08-8886-5d3ecf69d061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:01.981545 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96297caa-64e7-42ec-835c-3e2d58876c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:01.982076 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd02f4-2558-4b08-8886-5d3ecf69d061 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:01.982198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96297caa-64e7-42ec-835c-3e2d58876c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:01.982405 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd02f4-2558-4b08-8886-5d3ecf69d061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:01.982738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd02f4-2558-4b08-8886-5d3ecf69d061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:01.983897 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96297caa-64e7-42ec-835c-3e2d58876c5b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:01.994947 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd02f4-2558-4b08-8886-5d3ecf69d061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:01.996764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd02f4-2558-4b08-8886-5d3ecf69d061 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:02.001266 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1020/2029] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:02.008740 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1010/2030] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:20:02.011047 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96297caa-64e7-42ec-835c-3e2d58876c5b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:02.031686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96297caa-64e7-42ec-835c-3e2d58876c5b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:02.048041 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bb4f0-8838-4222-863f-4d0918a1bf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:02.049068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bb4f0-8838-4222-863f-4d0918a1bf1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:02.049364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bb4f0-8838-4222-863f-4d0918a1bf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:02.049645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bb4f0-8838-4222-863f-4d0918a1bf1d admin admin] PATH_INFO: `/v3/projects/533bf2eb6324425f9569f858801a728b/users/d311c49eb26b45cc92a3396afdf6481f/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:02.056718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd02f4-2558-4b08-8886-5d3ecf69d061 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:02.058390 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-eefd02f4-2558-4b08-8886-5d3ecf69d061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:02.071079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bb4f0-8838-4222-863f-4d0918a1bf1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=533bf2eb6324425f9569f858801a728b, user_id=d311c49eb26b45cc92a3396afdf6481f, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:02.075674 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bb4f0-8838-4222-863f-4d0918a1bf1d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:02.075918 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd02f4-2558-4b08-8886-5d3ecf69d061 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:02.082472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d077463-979a-48b5-bc3f-31a23f211751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:02.083323 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d077463-979a-48b5-bc3f-31a23f211751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:02.083609 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d077463-979a-48b5-bc3f-31a23f211751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:02.084090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d077463-979a-48b5-bc3f-31a23f211751 admin admin] PATH_INFO: `/v3/users/fba8cc1be5904193a5cc68963f2d1acb` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:02.085741 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d077463-979a-48b5-bc3f-31a23f211751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba8cc1be5904193a5cc68963f2d1acb)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:02.088235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d077463-979a-48b5-bc3f-31a23f211751 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:02.106035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1021/2031] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:02 2022] PUT /identity/v3/projects/533bf2eb6324425f9569f858801a728b/users/d311c49eb26b45cc92a3396afdf6481f/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:02.108167 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901465bf-8482-4db6-81c2-401e2e8b893b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:02.108465 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901465bf-8482-4db6-81c2-401e2e8b893b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:02.109970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901465bf-8482-4db6-81c2-401e2e8b893b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:02.147129 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-901465bf-8482-4db6-81c2-401e2e8b893b None None] MFA Rules not processed for user `d311c49eb26b45cc92a3396afdf6481f`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:02.148891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-901465bf-8482-4db6-81c2-401e2e8b893b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:02.156557 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1d077463-979a-48b5-bc3f-31a23f211751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba8cc1be5904193a5cc68963f2d1acb'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:02.167235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1d077463-979a-48b5-bc3f-31a23f211751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba8cc1be5904193a5cc68963f2d1acb'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:02.167907 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1d077463-979a-48b5-bc3f-31a23f211751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba8cc1be5904193a5cc68963f2d1acb'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:02.168752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1d077463-979a-48b5-bc3f-31a23f211751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba8cc1be5904193a5cc68963f2d1acb'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:02.187281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1d077463-979a-48b5-bc3f-31a23f211751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba8cc1be5904193a5cc68963f2d1acb'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:02.208439 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1011/2032] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:02 2022] DELETE /identity/v3/users/fba8cc1be5904193a5cc68963f2d1acb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:20:02.210485 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2becf-69dc-4ef5-8eaa-618f50dd79e0 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:02.210760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2becf-69dc-4ef5-8eaa-618f50dd79e0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:02.212539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2becf-69dc-4ef5-8eaa-618f50dd79e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:02.240748 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-cdd2becf-69dc-4ef5-8eaa-618f50dd79e0 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:02.242188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-cdd2becf-69dc-4ef5-8eaa-618f50dd79e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:02.260974 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1022/2033] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:02.266571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901465bf-8482-4db6-81c2-401e2e8b893b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:02.268619 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-901465bf-8482-4db6-81c2-401e2e8b893b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:02.339836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1012/2034] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:20:02.346411 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2becf-69dc-4ef5-8eaa-618f50dd79e0 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:02.348440 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-cdd2becf-69dc-4ef5-8eaa-618f50dd79e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:02.351321 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901465bf-8482-4db6-81c2-401e2e8b893b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:02.359269 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28060a-ffc6-401f-9b2a-600d12b66a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:02.360048 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28060a-ffc6-401f-9b2a-600d12b66a08 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:02.360446 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28060a-ffc6-401f-9b2a-600d12b66a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:02.360783 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28060a-ffc6-401f-9b2a-600d12b66a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:02.361546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28060a-ffc6-401f-9b2a-600d12b66a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:02.363631 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28060a-ffc6-401f-9b2a-600d12b66a08 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:02.407849 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1023/2035] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:02 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:02.412355 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28060a-ffc6-401f-9b2a-600d12b66a08 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:02.414918 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:02.437563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2becf-69dc-4ef5-8eaa-618f50dd79e0 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:02.461269 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:02.498656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28060a-ffc6-401f-9b2a-600d12b66a08 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:02.501178 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8cdc0-f494-45ac-924b-4d9d6d7c50d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:02.501817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8cdc0-f494-45ac-924b-4d9d6d7c50d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:02.502101 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8cdc0-f494-45ac-924b-4d9d6d7c50d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:02.502430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8cdc0-f494-45ac-924b-4d9d6d7c50d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:02.503514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f9e19-f5d4-4450-b3e9-be04d2094a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:02.504201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f9e19-f5d4-4450-b3e9-be04d2094a14 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:02.504516 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f9e19-f5d4-4450-b3e9-be04d2094a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:02.504798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f9e19-f5d4-4450-b3e9-be04d2094a14 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:02.505499 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f9e19-f5d4-4450-b3e9-be04d2094a14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:02.507435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f9e19-f5d4-4450-b3e9-be04d2094a14 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:02.512442 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8cdc0-f494-45ac-924b-4d9d6d7c50d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:02.513894 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8cdc0-f494-45ac-924b-4d9d6d7c50d5 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:02.525103 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1013/2036] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:20:02.526560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8cdc0-f494-45ac-924b-4d9d6d7c50d5 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:02.527876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c4d8cdc0-f494-45ac-924b-4d9d6d7c50d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:02.530390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1024/2037] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:02 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:20:02.534560 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f9e19-f5d4-4450-b3e9-be04d2094a14 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:02.546044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8cdc0-f494-45ac-924b-4d9d6d7c50d5 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:02.548488 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f9e19-f5d4-4450-b3e9-be04d2094a14 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:02.552514 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0570220-77c8-4f5e-a4cc-a6a250953753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:02.553429 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0570220-77c8-4f5e-a4cc-a6a250953753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:02.553688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0570220-77c8-4f5e-a4cc-a6a250953753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:02.553951 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0570220-77c8-4f5e-a4cc-a6a250953753 admin admin] PATH_INFO: `/v3/projects/a900df2ea0c345aba4deebf9bf39c816` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:02.554533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fd0bd-d63c-407e-ad2b-07fa1a0149c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:02.555212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0570220-77c8-4f5e-a4cc-a6a250953753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a900df2ea0c345aba4deebf9bf39c816)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:02.556972 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fd0bd-d63c-407e-ad2b-07fa1a0149c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:02.557379 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fd0bd-d63c-407e-ad2b-07fa1a0149c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:02.557847 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0570220-77c8-4f5e-a4cc-a6a250953753 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:02.557958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fd0bd-d63c-407e-ad2b-07fa1a0149c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:02.559073 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234fd0bd-d63c-407e-ad2b-07fa1a0149c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:02.561135 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234fd0bd-d63c-407e-ad2b-07fa1a0149c2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:02.577014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1025/2038] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:20:02.592452 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fd0bd-d63c-407e-ad2b-07fa1a0149c2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:02.615277 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b0570220-77c8-4f5e-a4cc-a6a250953753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a900df2ea0c345aba4deebf9bf39c816', 'request_id': 'req-b0570220-77c8-4f5e-a4cc-a6a250953753'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:02.619673 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fd0bd-d63c-407e-ad2b-07fa1a0149c2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:02.625415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b0570220-77c8-4f5e-a4cc-a6a250953753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a900df2ea0c345aba4deebf9bf39c816', 'request_id': 'req-b0570220-77c8-4f5e-a4cc-a6a250953753'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:02.637877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b0570220-77c8-4f5e-a4cc-a6a250953753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a900df2ea0c345aba4deebf9bf39c816', 'request_id': 'req-b0570220-77c8-4f5e-a4cc-a6a250953753'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:02.659285 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b0570220-77c8-4f5e-a4cc-a6a250953753 admin admin] The token cache is being invalidate because project a900df2ea0c345aba4deebf9bf39c816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:02.659670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b0570220-77c8-4f5e-a4cc-a6a250953753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:02.660486 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b0570220-77c8-4f5e-a4cc-a6a250953753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:02.664322 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1014/2039] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:02 2022] DELETE /identity/v3/projects/a900df2ea0c345aba4deebf9bf39c816 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:02.668795 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0570220-77c8-4f5e-a4cc-a6a250953753 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:02.670577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b0570220-77c8-4f5e-a4cc-a6a250953753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:02.737232 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21a563-bc18-4dd4-a0d7-fda77aa0594b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:02.739838 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21a563-bc18-4dd4-a0d7-fda77aa0594b admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:02.740653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21a563-bc18-4dd4-a0d7-fda77aa0594b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:02.742111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21a563-bc18-4dd4-a0d7-fda77aa0594b admin admin] PATH_INFO: `/v3/projects/26de69ea17034c929047d57f915f4ac0/users/d97afebc56e24f958d22ce3373b654d6/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:02.765169 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21a563-bc18-4dd4-a0d7-fda77aa0594b admin admin] RBAC: Authorizing `identity:create_grant(project_id=26de69ea17034c929047d57f915f4ac0, user_id=d97afebc56e24f958d22ce3373b654d6, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:02.769546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21a563-bc18-4dd4-a0d7-fda77aa0594b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:02.782941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0570220-77c8-4f5e-a4cc-a6a250953753 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:02.805962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1026/2040] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:02 2022] PUT /identity/v3/projects/26de69ea17034c929047d57f915f4ac0/users/d97afebc56e24f958d22ce3373b654d6/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:02.809820 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21a563-bc18-4dd4-a0d7-fda77aa0594b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:02.811823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fc21a563-bc18-4dd4-a0d7-fda77aa0594b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:02.816057 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:02.868545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee61dc-73f6-4548-b0db-4b175f579c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:02.869745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee61dc-73f6-4548-b0db-4b175f579c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:02.870388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee61dc-73f6-4548-b0db-4b175f579c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:02.870739 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee61dc-73f6-4548-b0db-4b175f579c40 admin admin] PATH_INFO: `/v3/users/9e31d4cffc8d4639b3ea7d175cf150d5` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:02.872495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee61dc-73f6-4548-b0db-4b175f579c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e31d4cffc8d4639b3ea7d175cf150d5)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:02.874494 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee61dc-73f6-4548-b0db-4b175f579c40 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:02.936722 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21a563-bc18-4dd4-a0d7-fda77aa0594b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:02.956957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d63be-f5c4-48ca-a9ca-f6c0beda060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:02.958375 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d63be-f5c4-48ca-a9ca-f6c0beda060c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:02.959645 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5cee61dc-73f6-4548-b0db-4b175f579c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e31d4cffc8d4639b3ea7d175cf150d5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:02.959778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d63be-f5c4-48ca-a9ca-f6c0beda060c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:02.960093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d63be-f5c4-48ca-a9ca-f6c0beda060c admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:02.965921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d63be-f5c4-48ca-a9ca-f6c0beda060c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:02.969938 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d63be-f5c4-48ca-a9ca-f6c0beda060c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:02.989921 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5cee61dc-73f6-4548-b0db-4b175f579c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e31d4cffc8d4639b3ea7d175cf150d5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:02.990597 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5cee61dc-73f6-4548-b0db-4b175f579c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e31d4cffc8d4639b3ea7d175cf150d5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:02.991365 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5cee61dc-73f6-4548-b0db-4b175f579c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e31d4cffc8d4639b3ea7d175cf150d5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:02.996392 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1027/2041] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:20:03.004029 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d63be-f5c4-48ca-a9ca-f6c0beda060c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:03.008481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-eb5d63be-f5c4-48ca-a9ca-f6c0beda060c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:03.027202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5cee61dc-73f6-4548-b0db-4b175f579c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e31d4cffc8d4639b3ea7d175cf150d5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:03.041780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d63be-f5c4-48ca-a9ca-f6c0beda060c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:03.050860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de3588-8c55-491b-a561-632ab6abceff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:03.053641 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de3588-8c55-491b-a561-632ab6abceff admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:03.053641 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de3588-8c55-491b-a561-632ab6abceff admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:03.053641 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de3588-8c55-491b-a561-632ab6abceff admin admin] PATH_INFO: `/v3/projects/26de69ea17034c929047d57f915f4ac0/users/d97afebc56e24f958d22ce3373b654d6/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:03.055957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de3588-8c55-491b-a561-632ab6abceff admin admin] RBAC: Authorizing `identity:create_grant(project_id=26de69ea17034c929047d57f915f4ac0, user_id=d97afebc56e24f958d22ce3373b654d6, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:03.060026 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de3588-8c55-491b-a561-632ab6abceff admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:03.064432 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1015/2042] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:02 2022] DELETE /identity/v3/users/9e31d4cffc8d4639b3ea7d175cf150d5 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:03.065303 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee61dc-73f6-4548-b0db-4b175f579c40 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:03.068361 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5cee61dc-73f6-4548-b0db-4b175f579c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:03.098870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1028/2043] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:03 2022] PUT /identity/v3/projects/26de69ea17034c929047d57f915f4ac0/users/d97afebc56e24f958d22ce3373b654d6/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:03.111500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51897e59-5ca5-4364-9c7a-7a0771318c13 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:03.111835 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51897e59-5ca5-4364-9c7a-7a0771318c13 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:03.113059 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51897e59-5ca5-4364-9c7a-7a0771318c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:03.169004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee61dc-73f6-4548-b0db-4b175f579c40 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:03.220626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-51897e59-5ca5-4364-9c7a-7a0771318c13 None None] MFA Rules not processed for user `d97afebc56e24f958d22ce3373b654d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:03.223628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-51897e59-5ca5-4364-9c7a-7a0771318c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:03.250036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:03.283405 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:03.300164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:03.301201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:03.301561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:03.301909 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2 admin admin] PATH_INFO: `/v3/projects/c93a5ac407204a26a54adff6e0c30d47` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:03.304183 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c93a5ac407204a26a54adff6e0c30d47)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:03.306778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:03.380155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1029/2044] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:03.381399 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51897e59-5ca5-4364-9c7a-7a0771318c13 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:03.383056 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-51897e59-5ca5-4364-9c7a-7a0771318c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:03.384852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c93a5ac407204a26a54adff6e0c30d47', 'request_id': 'req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:03.400838 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c93a5ac407204a26a54adff6e0c30d47', 'request_id': 'req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:03.414398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c93a5ac407204a26a54adff6e0c30d47', 'request_id': 'req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:03.436978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2 admin admin] The token cache is being invalidate because project c93a5ac407204a26a54adff6e0c30d47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:03.437343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:03.437967 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:03.439813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1016/2045] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:03 2022] DELETE /identity/v3/projects/c93a5ac407204a26a54adff6e0c30d47 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:03.440848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:03.442401 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:03.502337 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51897e59-5ca5-4364-9c7a-7a0771318c13 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:03.560518 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770bcf6-2137-47cf-a4ed-7e55ebdc66f2 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:03.565387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef5bda-aa7a-405e-9ff5-9939569bf667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:03.566339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef5bda-aa7a-405e-9ff5-9939569bf667 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:03.566774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef5bda-aa7a-405e-9ff5-9939569bf667 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:03.567151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef5bda-aa7a-405e-9ff5-9939569bf667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:03.569685 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-43ef5bda-aa7a-405e-9ff5-9939569bf667 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:03.609338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00169afd-5240-42f7-ad9f-4da2dd9f6df1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:03.611824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00169afd-5240-42f7-ad9f-4da2dd9f6df1 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:03.612514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00169afd-5240-42f7-ad9f-4da2dd9f6df1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:03.613270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00169afd-5240-42f7-ad9f-4da2dd9f6df1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:03.617046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-00169afd-5240-42f7-ad9f-4da2dd9f6df1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:03.729383 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00169afd-5240-42f7-ad9f-4da2dd9f6df1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:03.731951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00169afd-5240-42f7-ad9f-4da2dd9f6df1 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:03.733372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef5bda-aa7a-405e-9ff5-9939569bf667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:03.734989 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef5bda-aa7a-405e-9ff5-9939569bf667 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:03.758360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1030/2046] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:03.759895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1017/2047] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:03.762780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef5bda-aa7a-405e-9ff5-9939569bf667 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:03.764487 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-43ef5bda-aa7a-405e-9ff5-9939569bf667 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:03.772983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00169afd-5240-42f7-ad9f-4da2dd9f6df1 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:03.776742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-00169afd-5240-42f7-ad9f-4da2dd9f6df1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:03.814999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:03.851315 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:03.914370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef5bda-aa7a-405e-9ff5-9939569bf667 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:03.922447 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654eb76-4d67-49a7-b758-33352bf6f360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:03.923209 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654eb76-4d67-49a7-b758-33352bf6f360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:03.923581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654eb76-4d67-49a7-b758-33352bf6f360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:03.923947 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654eb76-4d67-49a7-b758-33352bf6f360 admin admin] PATH_INFO: `/v3/projects/6606d9f57be14e469a26326f25b42cfb` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:03.925662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654eb76-4d67-49a7-b758-33352bf6f360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6606d9f57be14e469a26326f25b42cfb)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:03.928381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654eb76-4d67-49a7-b758-33352bf6f360 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:03.954187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00169afd-5240-42f7-ad9f-4da2dd9f6df1 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:03.967611 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb1593-ee79-4f24-9d46-1517385d64ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:03.970765 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb1593-ee79-4f24-9d46-1517385d64ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:03.971159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb1593-ee79-4f24-9d46-1517385d64ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:03.971961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb1593-ee79-4f24-9d46-1517385d64ef admin admin] PATH_INFO: `/v3/users/f6981c0b8548426086f781a07f1f75e0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:03.974449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb1593-ee79-4f24-9d46-1517385d64ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6981c0b8548426086f781a07f1f75e0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:03.978895 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb1593-ee79-4f24-9d46-1517385d64ef admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:04.009993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9654eb76-4d67-49a7-b758-33352bf6f360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6606d9f57be14e469a26326f25b42cfb', 'request_id': 'req-9654eb76-4d67-49a7-b758-33352bf6f360'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:04.030888 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9654eb76-4d67-49a7-b758-33352bf6f360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6606d9f57be14e469a26326f25b42cfb', 'request_id': 'req-9654eb76-4d67-49a7-b758-33352bf6f360'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:04.041507 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9654eb76-4d67-49a7-b758-33352bf6f360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6606d9f57be14e469a26326f25b42cfb', 'request_id': 'req-9654eb76-4d67-49a7-b758-33352bf6f360'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:04.066768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9654eb76-4d67-49a7-b758-33352bf6f360 admin admin] The token cache is being invalidate because project 6606d9f57be14e469a26326f25b42cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:04.068880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9654eb76-4d67-49a7-b758-33352bf6f360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:04.070710 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9654eb76-4d67-49a7-b758-33352bf6f360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:04.073474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1018/2048] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:03 2022] DELETE /identity/v3/projects/6606d9f57be14e469a26326f25b42cfb => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:04.082012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6ae83-60d1-48f0-b708-4cad20d26b73 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:04.082936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6ae83-60d1-48f0-b708-4cad20d26b73 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:04.083316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6ae83-60d1-48f0-b708-4cad20d26b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:04.085595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-12fb1593-ee79-4f24-9d46-1517385d64ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6981c0b8548426086f781a07f1f75e0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:04.087701 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-12fb1593-ee79-4f24-9d46-1517385d64ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6981c0b8548426086f781a07f1f75e0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:04.088865 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-12fb1593-ee79-4f24-9d46-1517385d64ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6981c0b8548426086f781a07f1f75e0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:04.107254 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-12fb1593-ee79-4f24-9d46-1517385d64ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6981c0b8548426086f781a07f1f75e0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:04.123428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-12fb1593-ee79-4f24-9d46-1517385d64ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6981c0b8548426086f781a07f1f75e0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:04.131727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-87c6ae83-60d1-48f0-b708-4cad20d26b73 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:04.135344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-87c6ae83-60d1-48f0-b708-4cad20d26b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:04.168742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1031/2049] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:03 2022] DELETE /identity/v3/users/f6981c0b8548426086f781a07f1f75e0 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:04.277812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1019/2050] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:04.281324 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce50121-86be-4be7-b234-7373b93331a1 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:04.282126 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce50121-86be-4be7-b234-7373b93331a1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:04.282834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce50121-86be-4be7-b234-7373b93331a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:04.314768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1ce50121-86be-4be7-b234-7373b93331a1 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:04.315691 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1ce50121-86be-4be7-b234-7373b93331a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:04.386233 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1032/2051] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:04.390578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6ae83-60d1-48f0-b708-4cad20d26b73 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:04.403252 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6ae83-60d1-48f0-b708-4cad20d26b73 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:04.409295 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff3863-94ff-4ca9-b04b-58f859025ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:04.410109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff3863-94ff-4ca9-b04b-58f859025ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:04.410413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff3863-94ff-4ca9-b04b-58f859025ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:04.410743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff3863-94ff-4ca9-b04b-58f859025ea5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:04.411565 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff3863-94ff-4ca9-b04b-58f859025ea5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:20:04.412313 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff3863-94ff-4ca9-b04b-58f859025ea5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:04.414160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff3863-94ff-4ca9-b04b-58f859025ea5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:04.435075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce50121-86be-4be7-b234-7373b93331a1 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:04.443228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1020/2052] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:20:04.448584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce50121-86be-4be7-b234-7373b93331a1 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:04.464226 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f4ad0-920a-4496-bd61-8eb32b56cf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:04.464226 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4ad0-920a-4496-bd61-8eb32b56cf3b admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:04.464226 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4ad0-920a-4496-bd61-8eb32b56cf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:04.464226 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f4ad0-920a-4496-bd61-8eb32b56cf3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:04.465057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f4ad0-920a-4496-bd61-8eb32b56cf3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:04.465057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f4ad0-920a-4496-bd61-8eb32b56cf3b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:04.515311 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1033/2053] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:04 2022] POST /identity/v3/projects => generated 387 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:04.520831 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff3863-94ff-4ca9-b04b-58f859025ea5 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:04.535914 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff3863-94ff-4ca9-b04b-58f859025ea5 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:04.632461 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:04.641152 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d284496-be57-4f3a-a761-10bfddd4cda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:04.642469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d284496-be57-4f3a-a761-10bfddd4cda8 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:04.643389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d284496-be57-4f3a-a761-10bfddd4cda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:04.645716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d284496-be57-4f3a-a761-10bfddd4cda8 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:04.645716 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d284496-be57-4f3a-a761-10bfddd4cda8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:04.647957 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d284496-be57-4f3a-a761-10bfddd4cda8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:04.681867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1021/2054] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:04 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:04.685830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f4ad0-920a-4496-bd61-8eb32b56cf3b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:04.694654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:04.702028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f4ad0-920a-4496-bd61-8eb32b56cf3b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:04.713210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab90c2-def2-450e-90ec-b05991476606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:04.714563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab90c2-def2-450e-90ec-b05991476606 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:04.714902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab90c2-def2-450e-90ec-b05991476606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:04.715441 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab90c2-def2-450e-90ec-b05991476606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:04.716563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab90c2-def2-450e-90ec-b05991476606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:04.719452 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab90c2-def2-450e-90ec-b05991476606 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:04.736464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1034/2055] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:04.736808 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d284496-be57-4f3a-a761-10bfddd4cda8 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:04.751278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d284496-be57-4f3a-a761-10bfddd4cda8 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:04.757306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12a9a6-68da-4a19-853b-e1e3af457433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:04.758117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12a9a6-68da-4a19-853b-e1e3af457433 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:04.758452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12a9a6-68da-4a19-853b-e1e3af457433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:04.759301 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12a9a6-68da-4a19-853b-e1e3af457433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:04.760009 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12a9a6-68da-4a19-853b-e1e3af457433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:04.762300 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12a9a6-68da-4a19-853b-e1e3af457433 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:04.776761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1022/2056] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:04.781168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab90c2-def2-450e-90ec-b05991476606 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:04.793300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab90c2-def2-450e-90ec-b05991476606 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:04.799354 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9d1e6-e0c0-4af9-84eb-f9899ee35ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:04.802138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9d1e6-e0c0-4af9-84eb-f9899ee35ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:04.802138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9d1e6-e0c0-4af9-84eb-f9899ee35ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:04.802138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9d1e6-e0c0-4af9-84eb-f9899ee35ff5 admin admin] PATH_INFO: `/v3/projects/a9e2bbb4df1c4d59bc78c42929bbc124/users/a1411397eeab490caecf5f9572b2f316/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:04.820828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9d1e6-e0c0-4af9-84eb-f9899ee35ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e2bbb4df1c4d59bc78c42929bbc124, user_id=a1411397eeab490caecf5f9572b2f316, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:04.824438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9d1e6-e0c0-4af9-84eb-f9899ee35ff5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:04.842360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1035/2057] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:04 2022] PUT /identity/v3/projects/a9e2bbb4df1c4d59bc78c42929bbc124/users/a1411397eeab490caecf5f9572b2f316/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:20:04.853066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6c416-16c4-4968-9fbe-a581b9f7b3b0 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:04.853369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6c416-16c4-4968-9fbe-a581b9f7b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:04.853648 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6c416-16c4-4968-9fbe-a581b9f7b3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:04.887794 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c9d6c416-16c4-4968-9fbe-a581b9f7b3b0 None None] MFA Rules not processed for user `a1411397eeab490caecf5f9572b2f316`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:04.889047 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c9d6c416-16c4-4968-9fbe-a581b9f7b3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:04.977445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1023/2058] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:04.981955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9d1e6-e0c0-4af9-84eb-f9899ee35ff5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:05.074141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9d1e6-e0c0-4af9-84eb-f9899ee35ff5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:05.081402 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163eeca-04a6-4000-9a17-d9eb84c9d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:05.082149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163eeca-04a6-4000-9a17-d9eb84c9d120 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:05.082502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163eeca-04a6-4000-9a17-d9eb84c9d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:05.082848 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163eeca-04a6-4000-9a17-d9eb84c9d120 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:05.084134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163eeca-04a6-4000-9a17-d9eb84c9d120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:05.086777 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163eeca-04a6-4000-9a17-d9eb84c9d120 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:05.133473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6c416-16c4-4968-9fbe-a581b9f7b3b0 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:05.135221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c9d6c416-16c4-4968-9fbe-a581b9f7b3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:05.155477 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6c416-16c4-4968-9fbe-a581b9f7b3b0 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:05.162935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1036/2059] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:04 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:05.164390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163eeca-04a6-4000-9a17-d9eb84c9d120 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:05.169387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9230a-59f5-487b-a9b2-b24edf169b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:05.170289 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9230a-59f5-487b-a9b2-b24edf169b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:05.170562 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9230a-59f5-487b-a9b2-b24edf169b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:05.170858 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9230a-59f5-487b-a9b2-b24edf169b9c admin admin] PATH_INFO: `/v3/projects/731a16b29ed7435bb46c1cd4042abec6` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:05.172280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9230a-59f5-487b-a9b2-b24edf169b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=731a16b29ed7435bb46c1cd4042abec6)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:05.174140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9230a-59f5-487b-a9b2-b24edf169b9c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:05.252811 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a6f9230a-59f5-487b-a9b2-b24edf169b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731a16b29ed7435bb46c1cd4042abec6', 'request_id': 'req-a6f9230a-59f5-487b-a9b2-b24edf169b9c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:05.267330 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a6f9230a-59f5-487b-a9b2-b24edf169b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731a16b29ed7435bb46c1cd4042abec6', 'request_id': 'req-a6f9230a-59f5-487b-a9b2-b24edf169b9c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:05.272522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163eeca-04a6-4000-9a17-d9eb84c9d120 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:05.277748 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a6f9230a-59f5-487b-a9b2-b24edf169b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731a16b29ed7435bb46c1cd4042abec6', 'request_id': 'req-a6f9230a-59f5-487b-a9b2-b24edf169b9c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:05.295111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a6f9230a-59f5-487b-a9b2-b24edf169b9c admin admin] The token cache is being invalidate because project 731a16b29ed7435bb46c1cd4042abec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:05.296041 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a6f9230a-59f5-487b-a9b2-b24edf169b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:05.296729 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a6f9230a-59f5-487b-a9b2-b24edf169b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:05.298833 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1024/2060] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:05 2022] DELETE /identity/v3/projects/731a16b29ed7435bb46c1cd4042abec6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:20:05.304936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9230a-59f5-487b-a9b2-b24edf169b9c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:05.307414 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a6f9230a-59f5-487b-a9b2-b24edf169b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:05.350223 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7a2a3-6ab8-401e-83e7-ee656ad55936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:05.351790 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7a2a3-6ab8-401e-83e7-ee656ad55936 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:05.352087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7a2a3-6ab8-401e-83e7-ee656ad55936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:05.352927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7a2a3-6ab8-401e-83e7-ee656ad55936 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:05.353782 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7a2a3-6ab8-401e-83e7-ee656ad55936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:05.355760 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7a2a3-6ab8-401e-83e7-ee656ad55936 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:05.370515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:05.373505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:05.401270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1037/2061] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:05 2022] POST /identity/v3/users => generated 300 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:05.405262 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7a2a3-6ab8-401e-83e7-ee656ad55936 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:05.411009 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2fa7a2a3-6ab8-401e-83e7-ee656ad55936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:05.425652 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9230a-59f5-487b-a9b2-b24edf169b9c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:05.448344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f6c9f-e74c-441a-8c0b-616ee8bae0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:05.449286 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f6c9f-e74c-441a-8c0b-616ee8bae0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:05.449578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f6c9f-e74c-441a-8c0b-616ee8bae0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:05.450321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f6c9f-e74c-441a-8c0b-616ee8bae0fe admin admin] PATH_INFO: `/v3/users/7ef733644f0749958c55c24359709745` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:05.450899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7a2a3-6ab8-401e-83e7-ee656ad55936 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:05.452784 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f6c9f-e74c-441a-8c0b-616ee8bae0fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef733644f0749958c55c24359709745)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:05.455183 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f6c9f-e74c-441a-8c0b-616ee8bae0fe admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:05.457273 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a0aaf-2a37-47b0-ad17-7dcb3d6b3c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:05.458477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a0aaf-2a37-47b0-ad17-7dcb3d6b3c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:05.459329 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a0aaf-2a37-47b0-ad17-7dcb3d6b3c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:05.459329 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a0aaf-2a37-47b0-ad17-7dcb3d6b3c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:05.460836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a0aaf-2a37-47b0-ad17-7dcb3d6b3c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:05.462853 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a0aaf-2a37-47b0-ad17-7dcb3d6b3c03 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:05.502075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1038/2062] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:20:05.506808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a0aaf-2a37-47b0-ad17-7dcb3d6b3c03 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:05.525623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a0aaf-2a37-47b0-ad17-7dcb3d6b3c03 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:05.534752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950611fb-9340-4294-869a-e0bc27fde6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:05.536636 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950611fb-9340-4294-869a-e0bc27fde6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:05.537304 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950611fb-9340-4294-869a-e0bc27fde6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:05.537942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950611fb-9340-4294-869a-e0bc27fde6e7 admin admin] PATH_INFO: `/v3/projects/88f81c7fa20c4c1abb15e8e7fb925687/users/d5a9ead92f0b4df696007e2e4cf12d38/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:05.550396 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-694f6c9f-e74c-441a-8c0b-616ee8bae0fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef733644f0749958c55c24359709745'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:05.572309 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950611fb-9340-4294-869a-e0bc27fde6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f81c7fa20c4c1abb15e8e7fb925687, user_id=d5a9ead92f0b4df696007e2e4cf12d38, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:05.580123 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950611fb-9340-4294-869a-e0bc27fde6e7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:05.580569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-694f6c9f-e74c-441a-8c0b-616ee8bae0fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef733644f0749958c55c24359709745'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:05.582541 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-694f6c9f-e74c-441a-8c0b-616ee8bae0fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef733644f0749958c55c24359709745'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:05.584801 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-694f6c9f-e74c-441a-8c0b-616ee8bae0fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef733644f0749958c55c24359709745'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:05.613236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1039/2063] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:05 2022] PUT /identity/v3/projects/88f81c7fa20c4c1abb15e8e7fb925687/users/d5a9ead92f0b4df696007e2e4cf12d38/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:20:05.615095 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950611fb-9340-4294-869a-e0bc27fde6e7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:05.616776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-694f6c9f-e74c-441a-8c0b-616ee8bae0fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef733644f0749958c55c24359709745'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:05.617780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-950611fb-9340-4294-869a-e0bc27fde6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:05.635035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1025/2064] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:05 2022] DELETE /identity/v3/users/7ef733644f0749958c55c24359709745 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:05.725454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950611fb-9340-4294-869a-e0bc27fde6e7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:05.804297 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6219bc-5d3a-4c8a-bc29-a64117c3ab15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:05.804947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6219bc-5d3a-4c8a-bc29-a64117c3ab15 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:05.805235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6219bc-5d3a-4c8a-bc29-a64117c3ab15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:05.805564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6219bc-5d3a-4c8a-bc29-a64117c3ab15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:05.806299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6219bc-5d3a-4c8a-bc29-a64117c3ab15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:05.807901 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6219bc-5d3a-4c8a-bc29-a64117c3ab15 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:05.818361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1040/2065] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:05.822440 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f6c9f-e74c-441a-8c0b-616ee8bae0fe admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:05.832999 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f6c9f-e74c-441a-8c0b-616ee8bae0fe admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:05.839750 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf95be-00ce-4bd6-9b17-57920093367c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:05.841709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf95be-00ce-4bd6-9b17-57920093367c admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:05.842090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf95be-00ce-4bd6-9b17-57920093367c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:05.842625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf95be-00ce-4bd6-9b17-57920093367c admin admin] PATH_INFO: `/v3/projects/88f81c7fa20c4c1abb15e8e7fb925687/users/d5a9ead92f0b4df696007e2e4cf12d38/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:05.845757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf95be-00ce-4bd6-9b17-57920093367c admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f81c7fa20c4c1abb15e8e7fb925687, user_id=d5a9ead92f0b4df696007e2e4cf12d38, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:05.850243 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf95be-00ce-4bd6-9b17-57920093367c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:05.867501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1026/2066] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:05 2022] PUT /identity/v3/projects/88f81c7fa20c4c1abb15e8e7fb925687/users/d5a9ead92f0b4df696007e2e4cf12d38/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:05.886384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537011b-a624-4cba-bace-173f37919495 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:05.886704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537011b-a624-4cba-bace-173f37919495 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:05.886960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537011b-a624-4cba-bace-173f37919495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:05.923282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8537011b-a624-4cba-bace-173f37919495 None None] MFA Rules not processed for user `d5a9ead92f0b4df696007e2e4cf12d38`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:05.925038 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8537011b-a624-4cba-bace-173f37919495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:06.009672 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:06.044984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1041/2067] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:06.055812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf95be-00ce-4bd6-9b17-57920093367c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:06.058150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8caf95be-00ce-4bd6-9b17-57920093367c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:06.130721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf95be-00ce-4bd6-9b17-57920093367c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:06.135189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe10bc5-6eda-4640-9bd1-4de382cd385f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:06.135904 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe10bc5-6eda-4640-9bd1-4de382cd385f service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:06.136294 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe10bc5-6eda-4640-9bd1-4de382cd385f service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:06.136657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe10bc5-6eda-4640-9bd1-4de382cd385f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:06.146669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe10bc5-6eda-4640-9bd1-4de382cd385f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:06.148448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe10bc5-6eda-4640-9bd1-4de382cd385f service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:06.161122 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1027/2068] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:06.176076 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537011b-a624-4cba-bace-173f37919495 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:06.177823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8537011b-a624-4cba-bace-173f37919495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:06.296354 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537011b-a624-4cba-bace-173f37919495 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:06.302522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc454d-5063-418f-9d99-7cd8c4237251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:06.303444 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc454d-5063-418f-9d99-7cd8c4237251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:06.303727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc454d-5063-418f-9d99-7cd8c4237251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:06.304004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc454d-5063-418f-9d99-7cd8c4237251 admin admin] PATH_INFO: `/v3/projects/4b95efedd3a8495c92e84447ecca3248` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:06.305272 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc454d-5063-418f-9d99-7cd8c4237251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b95efedd3a8495c92e84447ecca3248)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:06.307777 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc454d-5063-418f-9d99-7cd8c4237251 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:06.364305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0fcc454d-5063-418f-9d99-7cd8c4237251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b95efedd3a8495c92e84447ecca3248', 'request_id': 'req-0fcc454d-5063-418f-9d99-7cd8c4237251'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:06.375927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0fcc454d-5063-418f-9d99-7cd8c4237251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b95efedd3a8495c92e84447ecca3248', 'request_id': 'req-0fcc454d-5063-418f-9d99-7cd8c4237251'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:06.385113 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0fcc454d-5063-418f-9d99-7cd8c4237251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b95efedd3a8495c92e84447ecca3248', 'request_id': 'req-0fcc454d-5063-418f-9d99-7cd8c4237251'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:06.402497 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0fcc454d-5063-418f-9d99-7cd8c4237251 admin admin] The token cache is being invalidate because project 4b95efedd3a8495c92e84447ecca3248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:06.402818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0fcc454d-5063-418f-9d99-7cd8c4237251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:06.403507 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0fcc454d-5063-418f-9d99-7cd8c4237251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:06.405391 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1042/2069] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:06 2022] DELETE /identity/v3/projects/4b95efedd3a8495c92e84447ecca3248 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:20:06.411968 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a835c-df1b-4b2c-8500-14944f84ce17 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:06.412278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a835c-df1b-4b2c-8500-14944f84ce17 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:06.412623 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a835c-df1b-4b2c-8500-14944f84ce17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:06.436994 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-da6a835c-df1b-4b2c-8500-14944f84ce17 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:06.438750 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-da6a835c-df1b-4b2c-8500-14944f84ce17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:06.509277 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:06.526618 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1028/2070] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:06.536540 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58c44b-4a32-4d43-b36f-0b36396576af None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:06.536858 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58c44b-4a32-4d43-b36f-0b36396576af None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:06.537143 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58c44b-4a32-4d43-b36f-0b36396576af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:06.566484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3e58c44b-4a32-4d43-b36f-0b36396576af None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:06.568450 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3e58c44b-4a32-4d43-b36f-0b36396576af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:06.583701 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1043/2071] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:06.584934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a835c-df1b-4b2c-8500-14944f84ce17 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:06.597927 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a835c-df1b-4b2c-8500-14944f84ce17 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:06.607706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248f4e9-630f-4212-82be-89d4c9d1de30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:06.608542 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248f4e9-630f-4212-82be-89d4c9d1de30 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:06.609025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248f4e9-630f-4212-82be-89d4c9d1de30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:06.609544 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248f4e9-630f-4212-82be-89d4c9d1de30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:06.610387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248f4e9-630f-4212-82be-89d4c9d1de30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:20:06.610801 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248f4e9-630f-4212-82be-89d4c9d1de30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:06.612985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248f4e9-630f-4212-82be-89d4c9d1de30 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:06.629481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1029/2072] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:20:06.633584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58c44b-4a32-4d43-b36f-0b36396576af None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:06.650038 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58c44b-4a32-4d43-b36f-0b36396576af None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:06.678674 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa19d2-aa30-41e8-9d87-1c32be0e3b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:06.680131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa19d2-aa30-41e8-9d87-1c32be0e3b66 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:06.681390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa19d2-aa30-41e8-9d87-1c32be0e3b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:06.684049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa19d2-aa30-41e8-9d87-1c32be0e3b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:06.689855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa19d2-aa30-41e8-9d87-1c32be0e3b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:06.698787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa19d2-aa30-41e8-9d87-1c32be0e3b66 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:06.776225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1044/2073] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:06 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:06.782765 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248f4e9-630f-4212-82be-89d4c9d1de30 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:06.837190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248f4e9-630f-4212-82be-89d4c9d1de30 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:07.057628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dac175-1662-4642-8f08-e1139cc40a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:07.059238 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dac175-1662-4642-8f08-e1139cc40a94 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:07.059817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dac175-1662-4642-8f08-e1139cc40a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:07.060370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dac175-1662-4642-8f08-e1139cc40a94 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:07.062009 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dac175-1662-4642-8f08-e1139cc40a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:07.068280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dac175-1662-4642-8f08-e1139cc40a94 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:07.146139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa19d2-aa30-41e8-9d87-1c32be0e3b66 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:07.148367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-26fa19d2-aa30-41e8-9d87-1c32be0e3b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:07.149774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1030/2074] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:06 2022] POST /identity/v3/users => generated 287 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:07.159151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dac175-1662-4642-8f08-e1139cc40a94 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:07.185562 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dac175-1662-4642-8f08-e1139cc40a94 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:07.201688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195ec78-99fd-4eef-9025-ff640951a324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:07.202566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195ec78-99fd-4eef-9025-ff640951a324 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:07.203175 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195ec78-99fd-4eef-9025-ff640951a324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:07.203325 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195ec78-99fd-4eef-9025-ff640951a324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:07.205933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195ec78-99fd-4eef-9025-ff640951a324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:07.209454 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195ec78-99fd-4eef-9025-ff640951a324 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:07.239890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1031/2075] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:07.244245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195ec78-99fd-4eef-9025-ff640951a324 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:07.247094 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:07.253407 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa19d2-aa30-41e8-9d87-1c32be0e3b66 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:07.259939 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195ec78-99fd-4eef-9025-ff640951a324 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:07.268467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20769a-d454-4cd9-8262-d4cb98d418b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:07.269164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20769a-d454-4cd9-8262-d4cb98d418b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:07.269527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20769a-d454-4cd9-8262-d4cb98d418b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:07.269879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20769a-d454-4cd9-8262-d4cb98d418b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:07.271129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20769a-d454-4cd9-8262-d4cb98d418b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:07.272895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20769a-d454-4cd9-8262-d4cb98d418b2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:07.277843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c972c72-dae4-4a3e-9d10-db5e2d745935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:07.278731 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972c72-dae4-4a3e-9d10-db5e2d745935 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:07.279245 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972c72-dae4-4a3e-9d10-db5e2d745935 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:07.279646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c972c72-dae4-4a3e-9d10-db5e2d745935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:07.284096 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5c972c72-dae4-4a3e-9d10-db5e2d745935 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:07.291930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1032/2076] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:20:07.299242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20769a-d454-4cd9-8262-d4cb98d418b2 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:07.318475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20769a-d454-4cd9-8262-d4cb98d418b2 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:07.332605 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0854182-2c3c-4a05-8a48-251034207420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:07.333508 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0854182-2c3c-4a05-8a48-251034207420 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:07.333787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0854182-2c3c-4a05-8a48-251034207420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:07.334063 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0854182-2c3c-4a05-8a48-251034207420 admin admin] PATH_INFO: `/v3/projects/c596a2f2006048799e388f4d8c6d908e/users/4bb8b669f6d94b10857db8458a36de2f/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:07.354682 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0854182-2c3c-4a05-8a48-251034207420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c596a2f2006048799e388f4d8c6d908e, user_id=4bb8b669f6d94b10857db8458a36de2f, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:07.358111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0854182-2c3c-4a05-8a48-251034207420 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:07.386210 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1033/2077] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:07 2022] PUT /identity/v3/projects/c596a2f2006048799e388f4d8c6d908e/users/4bb8b669f6d94b10857db8458a36de2f/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:07.392851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cc63d-dad9-4378-9bb9-3a5ced6c04e6 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:07.394160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cc63d-dad9-4378-9bb9-3a5ced6c04e6 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:07.395185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cc63d-dad9-4378-9bb9-3a5ced6c04e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:07.422491 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d59cc63d-dad9-4378-9bb9-3a5ced6c04e6 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:07.423860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d59cc63d-dad9-4378-9bb9-3a5ced6c04e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:07.430124 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c972c72-dae4-4a3e-9d10-db5e2d745935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:07.433546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c972c72-dae4-4a3e-9d10-db5e2d745935 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:07.453812 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1045/2078] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:07.539123 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1034/2079] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:20:07.552496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c972c72-dae4-4a3e-9d10-db5e2d745935 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:07.558844 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5c972c72-dae4-4a3e-9d10-db5e2d745935 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:07.672572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c972c72-dae4-4a3e-9d10-db5e2d745935 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:07.800213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cc63d-dad9-4378-9bb9-3a5ced6c04e6 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:07.802249 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d59cc63d-dad9-4378-9bb9-3a5ced6c04e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:07.824122 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cc63d-dad9-4378-9bb9-3a5ced6c04e6 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:07.833944 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602650c9-5b58-47d5-9067-fde22553855f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:07.834631 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602650c9-5b58-47d5-9067-fde22553855f service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:07.834924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602650c9-5b58-47d5-9067-fde22553855f service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:07.835197 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602650c9-5b58-47d5-9067-fde22553855f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:07.839889 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238ec25-a686-426b-a1dd-434f00843fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:07.841082 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238ec25-a686-426b-a1dd-434f00843fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:07.841370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238ec25-a686-426b-a1dd-434f00843fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:07.841675 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238ec25-a686-426b-a1dd-434f00843fc7 admin admin] PATH_INFO: `/v3/users/a1411397eeab490caecf5f9572b2f316` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:07.843387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238ec25-a686-426b-a1dd-434f00843fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1411397eeab490caecf5f9572b2f316)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:07.845891 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238ec25-a686-426b-a1dd-434f00843fc7 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:07.865699 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602650c9-5b58-47d5-9067-fde22553855f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:07.867042 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602650c9-5b58-47d5-9067-fde22553855f service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:07.890639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1046/2080] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:07.904485 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:07.948294 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3238ec25-a686-426b-a1dd-434f00843fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1411397eeab490caecf5f9572b2f316'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:07.967505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3238ec25-a686-426b-a1dd-434f00843fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1411397eeab490caecf5f9572b2f316'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:07.968368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3238ec25-a686-426b-a1dd-434f00843fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1411397eeab490caecf5f9572b2f316'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:07.969456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3238ec25-a686-426b-a1dd-434f00843fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1411397eeab490caecf5f9572b2f316'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:07.985054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3238ec25-a686-426b-a1dd-434f00843fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1411397eeab490caecf5f9572b2f316'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:08.003708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1035/2081] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:07 2022] DELETE /identity/v3/users/a1411397eeab490caecf5f9572b2f316 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:08.008521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f5c7a-057b-4f24-b29d-d34707bdaa40 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:08.008939 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f5c7a-057b-4f24-b29d-d34707bdaa40 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:08.009380 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f5c7a-057b-4f24-b29d-d34707bdaa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:08.044139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a98f5c7a-057b-4f24-b29d-d34707bdaa40 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:08.045814 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a98f5c7a-057b-4f24-b29d-d34707bdaa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:08.118673 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:08.133506 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1047/2082] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:08.145437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238ec25-a686-426b-a1dd-434f00843fc7 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:08.149008 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3238ec25-a686-426b-a1dd-434f00843fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:08.231353 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238ec25-a686-426b-a1dd-434f00843fc7 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:08.247244 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b77f45-d840-45bd-a530-e73611482a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:08.248016 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b77f45-d840-45bd-a530-e73611482a32 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:08.248505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b77f45-d840-45bd-a530-e73611482a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:08.248890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b77f45-d840-45bd-a530-e73611482a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:08.262385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b77f45-d840-45bd-a530-e73611482a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:08.264138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b77f45-d840-45bd-a530-e73611482a32 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:08.280381 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1036/2083] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:08.329240 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f5c7a-057b-4f24-b29d-d34707bdaa40 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:08.330897 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a98f5c7a-057b-4f24-b29d-d34707bdaa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:08.411454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f5c7a-057b-4f24-b29d-d34707bdaa40 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:08.416526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f57501-9f51-4107-bd89-be30edc8e938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:08.417361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f57501-9f51-4107-bd89-be30edc8e938 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:08.417736 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f57501-9f51-4107-bd89-be30edc8e938 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:08.430057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f57501-9f51-4107-bd89-be30edc8e938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:08.430057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-37f57501-9f51-4107-bd89-be30edc8e938 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:08.523066 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f57501-9f51-4107-bd89-be30edc8e938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:08.525055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f57501-9f51-4107-bd89-be30edc8e938 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:08.550427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1048/2084] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:08.856394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b77f45-d840-45bd-a530-e73611482a32 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:08.858044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c9b77f45-d840-45bd-a530-e73611482a32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:08.877552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b77f45-d840-45bd-a530-e73611482a32 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:08.886453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1555e2-624b-4492-b957-9a28f88d1450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:08.887288 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1555e2-624b-4492-b957-9a28f88d1450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:08.887639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1555e2-624b-4492-b957-9a28f88d1450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:08.888512 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1555e2-624b-4492-b957-9a28f88d1450 admin admin] PATH_INFO: `/v3/projects/a9e2bbb4df1c4d59bc78c42929bbc124` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:08.891425 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1555e2-624b-4492-b957-9a28f88d1450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e2bbb4df1c4d59bc78c42929bbc124)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:08.893836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1555e2-624b-4492-b957-9a28f88d1450 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:08.916399 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663159dc-791e-4ebc-8a02-15316795763c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:08.916940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663159dc-791e-4ebc-8a02-15316795763c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:08.917312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663159dc-791e-4ebc-8a02-15316795763c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:08.962575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-663159dc-791e-4ebc-8a02-15316795763c None None] MFA Rules not processed for user `4bb8b669f6d94b10857db8458a36de2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:08.963858 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-663159dc-791e-4ebc-8a02-15316795763c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:08.974048 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ae1555e2-624b-4492-b957-9a28f88d1450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e2bbb4df1c4d59bc78c42929bbc124', 'request_id': 'req-ae1555e2-624b-4492-b957-9a28f88d1450'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:08.987256 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ae1555e2-624b-4492-b957-9a28f88d1450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e2bbb4df1c4d59bc78c42929bbc124', 'request_id': 'req-ae1555e2-624b-4492-b957-9a28f88d1450'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:09.000062 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ae1555e2-624b-4492-b957-9a28f88d1450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e2bbb4df1c4d59bc78c42929bbc124', 'request_id': 'req-ae1555e2-624b-4492-b957-9a28f88d1450'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:09.016988 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ae1555e2-624b-4492-b957-9a28f88d1450 admin admin] The token cache is being invalidate because project a9e2bbb4df1c4d59bc78c42929bbc124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:09.017361 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ae1555e2-624b-4492-b957-9a28f88d1450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:09.018093 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ae1555e2-624b-4492-b957-9a28f88d1450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:09.022649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1037/2085] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:08 2022] DELETE /identity/v3/projects/a9e2bbb4df1c4d59bc78c42929bbc124 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:09.026144 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1555e2-624b-4492-b957-9a28f88d1450 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:09.028011 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ae1555e2-624b-4492-b957-9a28f88d1450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:09.072877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:09.078235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1049/2086] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:09.078578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663159dc-791e-4ebc-8a02-15316795763c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:09.081884 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-663159dc-791e-4ebc-8a02-15316795763c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:09.135042 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1555e2-624b-4492-b957-9a28f88d1450 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:09.141517 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7571b84-22b9-42bc-9094-610062383f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:09.142346 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571b84-22b9-42bc-9094-610062383f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:09.142640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571b84-22b9-42bc-9094-610062383f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:09.142969 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571b84-22b9-42bc-9094-610062383f5c admin admin] PATH_INFO: `/v3/users/d5a9ead92f0b4df696007e2e4cf12d38` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:09.144590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7571b84-22b9-42bc-9094-610062383f5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a9ead92f0b4df696007e2e4cf12d38)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:09.146798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7571b84-22b9-42bc-9094-610062383f5c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:09.167507 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:09.211819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663159dc-791e-4ebc-8a02-15316795763c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:09.217625 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42da2f-c4d3-480d-bf31-0f6de746f173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:09.218003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42da2f-c4d3-480d-bf31-0f6de746f173 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:09.218290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42da2f-c4d3-480d-bf31-0f6de746f173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:09.218781 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42da2f-c4d3-480d-bf31-0f6de746f173 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:09.219723 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42da2f-c4d3-480d-bf31-0f6de746f173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:09.222877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42da2f-c4d3-480d-bf31-0f6de746f173 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:09.228133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f7571b84-22b9-42bc-9094-610062383f5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a9ead92f0b4df696007e2e4cf12d38'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:09.247214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f7571b84-22b9-42bc-9094-610062383f5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a9ead92f0b4df696007e2e4cf12d38'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:09.250282 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f7571b84-22b9-42bc-9094-610062383f5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a9ead92f0b4df696007e2e4cf12d38'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:09.253394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f7571b84-22b9-42bc-9094-610062383f5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a9ead92f0b4df696007e2e4cf12d38'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:09.270921 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f7571b84-22b9-42bc-9094-610062383f5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a9ead92f0b4df696007e2e4cf12d38'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:09.292173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1050/2087] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:09 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:09.293355 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42da2f-c4d3-480d-bf31-0f6de746f173 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:09.295294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7e42da2f-c4d3-480d-bf31-0f6de746f173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:09.306456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1038/2088] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:09 2022] DELETE /identity/v3/users/d5a9ead92f0b4df696007e2e4cf12d38 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:09.423562 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42da2f-c4d3-480d-bf31-0f6de746f173 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:09.496903 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c79d74-7f28-40d5-9ab1-0462ec0e5136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:09.498090 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c79d74-7f28-40d5-9ab1-0462ec0e5136 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:09.498090 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c79d74-7f28-40d5-9ab1-0462ec0e5136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:09.498325 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c79d74-7f28-40d5-9ab1-0462ec0e5136 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:09.498847 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c79d74-7f28-40d5-9ab1-0462ec0e5136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:09.500994 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c79d74-7f28-40d5-9ab1-0462ec0e5136 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:09.531001 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1051/2089] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:09 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:09.532670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7571b84-22b9-42bc-9094-610062383f5c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:09.545088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7571b84-22b9-42bc-9094-610062383f5c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:09.549983 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e45a76-2885-4cf6-9e63-c00f5fb8e2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:09.550684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e45a76-2885-4cf6-9e63-c00f5fb8e2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:09.551062 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e45a76-2885-4cf6-9e63-c00f5fb8e2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:09.551472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e45a76-2885-4cf6-9e63-c00f5fb8e2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:09.552407 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e45a76-2885-4cf6-9e63-c00f5fb8e2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:09.554284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e45a76-2885-4cf6-9e63-c00f5fb8e2b6 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:09.566261 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1039/2090] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:09.570449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c79d74-7f28-40d5-9ab1-0462ec0e5136 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:09.582229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c79d74-7f28-40d5-9ab1-0462ec0e5136 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:09.588469 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a997b0-2564-41e9-8082-399b484dd62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:09.589362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a997b0-2564-41e9-8082-399b484dd62e admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:09.590247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a997b0-2564-41e9-8082-399b484dd62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:09.590247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a997b0-2564-41e9-8082-399b484dd62e admin admin] PATH_INFO: `/v3/projects/44d50386869f481dae1d59974e5d382e/users/eb073c97cfad4663ae4ba8ada97204d1/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:09.609697 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a997b0-2564-41e9-8082-399b484dd62e admin admin] RBAC: Authorizing `identity:create_grant(project_id=44d50386869f481dae1d59974e5d382e, user_id=eb073c97cfad4663ae4ba8ada97204d1, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:09.612840 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a997b0-2564-41e9-8082-399b484dd62e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:09.627052 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1052/2091] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:09 2022] PUT /identity/v3/projects/44d50386869f481dae1d59974e5d382e/users/eb073c97cfad4663ae4ba8ada97204d1/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:09.629120 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e45a76-2885-4cf6-9e63-c00f5fb8e2b6 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:09.630715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a997b0-2564-41e9-8082-399b484dd62e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:09.631394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-02e45a76-2885-4cf6-9e63-c00f5fb8e2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:09.652944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e45a76-2885-4cf6-9e63-c00f5fb8e2b6 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:09.692498 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:09.716906 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7eb14-0f7f-43d6-82ac-92313323aedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:09.718159 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7eb14-0f7f-43d6-82ac-92313323aedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:09.718441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7eb14-0f7f-43d6-82ac-92313323aedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:09.719579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7eb14-0f7f-43d6-82ac-92313323aedf admin admin] PATH_INFO: `/v3/projects/88f81c7fa20c4c1abb15e8e7fb925687` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:09.720897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7eb14-0f7f-43d6-82ac-92313323aedf admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f81c7fa20c4c1abb15e8e7fb925687)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:09.721780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a997b0-2564-41e9-8082-399b484dd62e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:09.722864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7eb14-0f7f-43d6-82ac-92313323aedf admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:09.728678 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6ca8e-8505-4d8d-a551-30a849788d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:09.730316 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6ca8e-8505-4d8d-a551-30a849788d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:09.730316 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6ca8e-8505-4d8d-a551-30a849788d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:09.730316 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6ca8e-8505-4d8d-a551-30a849788d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:09.730672 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6ca8e-8505-4d8d-a551-30a849788d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:09.732212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6ca8e-8505-4d8d-a551-30a849788d81 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:09.745630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1053/2092] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:20:09.749446 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6ca8e-8505-4d8d-a551-30a849788d81 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:09.767892 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6ca8e-8505-4d8d-a551-30a849788d81 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:09.773866 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b6246-63f4-45be-bd21-ff5bca8fb6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:09.775988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b6246-63f4-45be-bd21-ff5bca8fb6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:09.776553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b6246-63f4-45be-bd21-ff5bca8fb6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:09.777046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b6246-63f4-45be-bd21-ff5bca8fb6fc admin admin] PATH_INFO: `/v3/projects/44d50386869f481dae1d59974e5d382e/users/eb073c97cfad4663ae4ba8ada97204d1/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:09.779806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b6246-63f4-45be-bd21-ff5bca8fb6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=44d50386869f481dae1d59974e5d382e, user_id=eb073c97cfad4663ae4ba8ada97204d1, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:09.783196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b6246-63f4-45be-bd21-ff5bca8fb6fc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:09.783981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:09.801032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1ef7eb14-0f7f-43d6-82ac-92313323aedf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f81c7fa20c4c1abb15e8e7fb925687', 'request_id': 'req-1ef7eb14-0f7f-43d6-82ac-92313323aedf'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:09.808691 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1054/2093] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:09 2022] PUT /identity/v3/projects/44d50386869f481dae1d59974e5d382e/users/eb073c97cfad4663ae4ba8ada97204d1/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:20:09.812688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1ef7eb14-0f7f-43d6-82ac-92313323aedf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f81c7fa20c4c1abb15e8e7fb925687', 'request_id': 'req-1ef7eb14-0f7f-43d6-82ac-92313323aedf'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:09.822167 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1ef7eb14-0f7f-43d6-82ac-92313323aedf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f81c7fa20c4c1abb15e8e7fb925687', 'request_id': 'req-1ef7eb14-0f7f-43d6-82ac-92313323aedf'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:09.841801 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1ef7eb14-0f7f-43d6-82ac-92313323aedf admin admin] The token cache is being invalidate because project 88f81c7fa20c4c1abb15e8e7fb925687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:09.842730 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1ef7eb14-0f7f-43d6-82ac-92313323aedf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:09.846793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1ef7eb14-0f7f-43d6-82ac-92313323aedf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:09.854190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1040/2094] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:09 2022] DELETE /identity/v3/projects/88f81c7fa20c4c1abb15e8e7fb925687 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:20:09.856749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404c9e1-08d4-463b-93c6-ea57d7833964 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:09.857207 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404c9e1-08d4-463b-93c6-ea57d7833964 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:09.857648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404c9e1-08d4-463b-93c6-ea57d7833964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:09.904488 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4404c9e1-08d4-463b-93c6-ea57d7833964 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:09.904488 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4404c9e1-08d4-463b-93c6-ea57d7833964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:10.042210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1055/2095] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:10.050272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c5d11-38dc-42ec-bd19-73bfa0490ee2 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:10.050692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c5d11-38dc-42ec-bd19-73bfa0490ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:10.051072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c5d11-38dc-42ec-bd19-73bfa0490ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:10.077453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c45c5d11-38dc-42ec-bd19-73bfa0490ee2 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:10.079513 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c45c5d11-38dc-42ec-bd19-73bfa0490ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:10.092892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1041/2096] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:20:10.094141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404c9e1-08d4-463b-93c6-ea57d7833964 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:10.105782 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404c9e1-08d4-463b-93c6-ea57d7833964 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:10.118581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46729f0a-2142-4f5b-a718-76a3334cc4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:10.121027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46729f0a-2142-4f5b-a718-76a3334cc4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:10.121427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46729f0a-2142-4f5b-a718-76a3334cc4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:10.123622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46729f0a-2142-4f5b-a718-76a3334cc4f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:10.124974 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46729f0a-2142-4f5b-a718-76a3334cc4f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:20:10.125534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46729f0a-2142-4f5b-a718-76a3334cc4f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:10.129120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46729f0a-2142-4f5b-a718-76a3334cc4f8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:10.163823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c5d11-38dc-42ec-bd19-73bfa0490ee2 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:10.163979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1056/2097] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:20:10.174852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c5d11-38dc-42ec-bd19-73bfa0490ee2 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:10.201536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbfba4-9d75-453a-b1d1-987edbc80ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:10.217640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbfba4-9d75-453a-b1d1-987edbc80ade admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:10.217640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbfba4-9d75-453a-b1d1-987edbc80ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:10.217640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbfba4-9d75-453a-b1d1-987edbc80ade admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:10.218088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbfba4-9d75-453a-b1d1-987edbc80ade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:10.220281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbfba4-9d75-453a-b1d1-987edbc80ade admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:10.294591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1042/2098] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:10 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:10.299203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46729f0a-2142-4f5b-a718-76a3334cc4f8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:10.312942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46729f0a-2142-4f5b-a718-76a3334cc4f8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:10.414185 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75a869-39f0-43b1-9532-7f5074c1ab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:10.416227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75a869-39f0-43b1-9532-7f5074c1ab5d admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:10.417121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75a869-39f0-43b1-9532-7f5074c1ab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:10.417121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75a869-39f0-43b1-9532-7f5074c1ab5d admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:10.417822 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75a869-39f0-43b1-9532-7f5074c1ab5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:10.420582 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75a869-39f0-43b1-9532-7f5074c1ab5d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:10.446278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1057/2099] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:10 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:10.450456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbfba4-9d75-453a-b1d1-987edbc80ade admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:10.462460 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbfba4-9d75-453a-b1d1-987edbc80ade admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:10.471044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00eab4-6b24-4422-a8ee-a351a84685c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:10.472052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00eab4-6b24-4422-a8ee-a351a84685c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:10.472527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00eab4-6b24-4422-a8ee-a351a84685c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:10.472971 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00eab4-6b24-4422-a8ee-a351a84685c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:10.474121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00eab4-6b24-4422-a8ee-a351a84685c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:10.476054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00eab4-6b24-4422-a8ee-a351a84685c7 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:10.491931 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1043/2100] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:20:10.495006 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75a869-39f0-43b1-9532-7f5074c1ab5d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:10.508497 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75a869-39f0-43b1-9532-7f5074c1ab5d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:10.525839 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdd075-1fc4-4bfd-8691-f192c3905ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:10.527108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdd075-1fc4-4bfd-8691-f192c3905ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:10.528197 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdd075-1fc4-4bfd-8691-f192c3905ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:10.529259 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cdd075-1fc4-4bfd-8691-f192c3905ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:10.530256 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cdd075-1fc4-4bfd-8691-f192c3905ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:10.532168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cdd075-1fc4-4bfd-8691-f192c3905ed4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:10.548184 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1058/2101] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:10.552765 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00eab4-6b24-4422-a8ee-a351a84685c7 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:10.567580 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00eab4-6b24-4422-a8ee-a351a84685c7 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:10.575970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b87220-118e-4726-b846-259159dba963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:10.578253 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b87220-118e-4726-b846-259159dba963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:10.578548 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b87220-118e-4726-b846-259159dba963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:10.578827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b87220-118e-4726-b846-259159dba963 admin admin] PATH_INFO: `/v3/projects/e942c28342514f5ca73cf47ac89022df/users/947b842f0b1e428286893d5f9353393a/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:10.616506 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b87220-118e-4726-b846-259159dba963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e942c28342514f5ca73cf47ac89022df, user_id=947b842f0b1e428286893d5f9353393a, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:10.622164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b87220-118e-4726-b846-259159dba963 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:10.639561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdd075-1fc4-4bfd-8691-f192c3905ed4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:10.646786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1044/2102] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:10 2022] PUT /identity/v3/projects/e942c28342514f5ca73cf47ac89022df/users/947b842f0b1e428286893d5f9353393a/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:10.647404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b4cdd075-1fc4-4bfd-8691-f192c3905ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:10.648616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76f535-8356-4ef4-9e7d-61a8b777653c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:10.648905 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76f535-8356-4ef4-9e7d-61a8b777653c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:10.649257 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76f535-8356-4ef4-9e7d-61a8b777653c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:10.665724 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cdd075-1fc4-4bfd-8691-f192c3905ed4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:10.673327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-4e76f535-8356-4ef4-9e7d-61a8b777653c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:10.674832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4e76f535-8356-4ef4-9e7d-61a8b777653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:10.706143 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:10.753244 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1045/2103] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:10.763067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8a1df-61a0-43de-a89c-ecac8333d1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:10.764058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8a1df-61a0-43de-a89c-ecac8333d1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:10.764488 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8a1df-61a0-43de-a89c-ecac8333d1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:10.764773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8a1df-61a0-43de-a89c-ecac8333d1cc admin admin] PATH_INFO: `/v3/users/8e652767e363458bb9357eedce334090` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:10.766070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8a1df-61a0-43de-a89c-ecac8333d1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e652767e363458bb9357eedce334090)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:10.768090 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8a1df-61a0-43de-a89c-ecac8333d1cc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:10.802276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76f535-8356-4ef4-9e7d-61a8b777653c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:10.807550 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4e76f535-8356-4ef4-9e7d-61a8b777653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:10.835340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8da8a1df-61a0-43de-a89c-ecac8333d1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e652767e363458bb9357eedce334090'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:10.835340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8da8a1df-61a0-43de-a89c-ecac8333d1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e652767e363458bb9357eedce334090'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:10.836455 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8da8a1df-61a0-43de-a89c-ecac8333d1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e652767e363458bb9357eedce334090'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:10.851260 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8da8a1df-61a0-43de-a89c-ecac8333d1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e652767e363458bb9357eedce334090'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:10.864658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8da8a1df-61a0-43de-a89c-ecac8333d1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e652767e363458bb9357eedce334090'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:10.904860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1059/2104] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:10 2022] DELETE /identity/v3/users/8e652767e363458bb9357eedce334090 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:10.911247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65066a96-0b47-4b81-9609-ac613b84a0c5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:10.911833 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65066a96-0b47-4b81-9609-ac613b84a0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:10.912206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65066a96-0b47-4b81-9609-ac613b84a0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:10.912905 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76f535-8356-4ef4-9e7d-61a8b777653c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:10.934880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:10.937629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-65066a96-0b47-4b81-9609-ac613b84a0c5 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:10.938953 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-65066a96-0b47-4b81-9609-ac613b84a0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:10.994596 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea98ab-1bc7-4b38-8297-cdb520a0bfde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:10.995495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea98ab-1bc7-4b38-8297-cdb520a0bfde service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:10.995906 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea98ab-1bc7-4b38-8297-cdb520a0bfde service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:10.996342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea98ab-1bc7-4b38-8297-cdb520a0bfde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:10.998572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8fea98ab-1bc7-4b38-8297-cdb520a0bfde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:11.018518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1060/2105] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:20:11.029871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65066a96-0b47-4b81-9609-ac613b84a0c5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:11.031435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-65066a96-0b47-4b81-9609-ac613b84a0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:11.048106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65066a96-0b47-4b81-9609-ac613b84a0c5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:11.058596 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0984631-a05d-4885-960a-7953afe542fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:11.059846 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0984631-a05d-4885-960a-7953afe542fa service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:11.060276 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0984631-a05d-4885-960a-7953afe542fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:11.060712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0984631-a05d-4885-960a-7953afe542fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:11.074289 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0984631-a05d-4885-960a-7953afe542fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:11.076118 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0984631-a05d-4885-960a-7953afe542fa service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:11.093044 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1061/2106] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:20:11.094064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea98ab-1bc7-4b38-8297-cdb520a0bfde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:11.095686 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea98ab-1bc7-4b38-8297-cdb520a0bfde service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:11.106333 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1046/2107] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:11.283363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397966e0-b7cf-4329-bb95-a59d7d9c1861 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:11.284456 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397966e0-b7cf-4329-bb95-a59d7d9c1861 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:11.284946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397966e0-b7cf-4329-bb95-a59d7d9c1861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:11.339472 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-397966e0-b7cf-4329-bb95-a59d7d9c1861 None None] MFA Rules not processed for user `eb073c97cfad4663ae4ba8ada97204d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:11.343683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-397966e0-b7cf-4329-bb95-a59d7d9c1861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:11.418704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:11.572154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1062/2108] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:11.574296 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9c5c0-d398-4cf0-94a6-4d64b1ac773a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:11.574747 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9c5c0-d398-4cf0-94a6-4d64b1ac773a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:11.575027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9c5c0-d398-4cf0-94a6-4d64b1ac773a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:11.603862 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3fa9c5c0-d398-4cf0-94a6-4d64b1ac773a None None] MFA Rules not processed for user `4bb8b669f6d94b10857db8458a36de2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:11.605364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3fa9c5c0-d398-4cf0-94a6-4d64b1ac773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:11.738142 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1047/2109] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:11.753987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397966e0-b7cf-4329-bb95-a59d7d9c1861 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:11.756339 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-397966e0-b7cf-4329-bb95-a59d7d9c1861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:11.870252 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397966e0-b7cf-4329-bb95-a59d7d9c1861 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:11.877022 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ecb62-3364-472d-b825-5dcc0a66c968 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:11.877843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ecb62-3364-472d-b825-5dcc0a66c968 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:11.878536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ecb62-3364-472d-b825-5dcc0a66c968 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:11.878536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ecb62-3364-472d-b825-5dcc0a66c968 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:11.880487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6e3ecb62-3364-472d-b825-5dcc0a66c968 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:11.894856 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ecb62-3364-472d-b825-5dcc0a66c968 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:11.896615 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ecb62-3364-472d-b825-5dcc0a66c968 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:11.909950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1063/2110] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:12.825658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9c5c0-d398-4cf0-94a6-4d64b1ac773a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:12.827171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3fa9c5c0-d398-4cf0-94a6-4d64b1ac773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:12.850280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9c5c0-d398-4cf0-94a6-4d64b1ac773a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:12.856574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360de68d-d779-4a14-a740-91905a1e54a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:12.857457 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360de68d-d779-4a14-a740-91905a1e54a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:12.857745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360de68d-d779-4a14-a740-91905a1e54a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:12.858020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360de68d-d779-4a14-a740-91905a1e54a2 admin admin] PATH_INFO: `/v3/projects/e1ffe41cbe744954bf26fc751a2bd30d` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:12.860288 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360de68d-d779-4a14-a740-91905a1e54a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ffe41cbe744954bf26fc751a2bd30d)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:12.862365 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360de68d-d779-4a14-a740-91905a1e54a2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:12.930180 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-360de68d-d779-4a14-a740-91905a1e54a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ffe41cbe744954bf26fc751a2bd30d', 'request_id': 'req-360de68d-d779-4a14-a740-91905a1e54a2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:12.939987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-360de68d-d779-4a14-a740-91905a1e54a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ffe41cbe744954bf26fc751a2bd30d', 'request_id': 'req-360de68d-d779-4a14-a740-91905a1e54a2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:12.948442 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-360de68d-d779-4a14-a740-91905a1e54a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ffe41cbe744954bf26fc751a2bd30d', 'request_id': 'req-360de68d-d779-4a14-a740-91905a1e54a2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:12.955944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:12.969244 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-360de68d-d779-4a14-a740-91905a1e54a2 admin admin] The token cache is being invalidate because project e1ffe41cbe744954bf26fc751a2bd30d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:12.969635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-360de68d-d779-4a14-a740-91905a1e54a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:12.970418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-360de68d-d779-4a14-a740-91905a1e54a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:12.972059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1048/2111] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:12 2022] DELETE /identity/v3/projects/e1ffe41cbe744954bf26fc751a2bd30d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:12.976092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ecb62-3364-472d-b825-5dcc0a66c968 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:12.987023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ecb62-3364-472d-b825-5dcc0a66c968 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:13.053688 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602ca31-1dba-4fa6-bc94-afd22f99bcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:13.054865 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602ca31-1dba-4fa6-bc94-afd22f99bcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:13.054865 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602ca31-1dba-4fa6-bc94-afd22f99bcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:13.055173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602ca31-1dba-4fa6-bc94-afd22f99bcc8 admin admin] PATH_INFO: `/v3/users/2e0e81b3121d477794c0bd706fcfecde` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:13.061068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602ca31-1dba-4fa6-bc94-afd22f99bcc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e0e81b3121d477794c0bd706fcfecde)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:13.063225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602ca31-1dba-4fa6-bc94-afd22f99bcc8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:13.129876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360de68d-d779-4a14-a740-91905a1e54a2 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:13.130237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:13.131462 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-360de68d-d779-4a14-a740-91905a1e54a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:13.134080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c602ca31-1dba-4fa6-bc94-afd22f99bcc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e0e81b3121d477794c0bd706fcfecde'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:13.135402 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c602ca31-1dba-4fa6-bc94-afd22f99bcc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e0e81b3121d477794c0bd706fcfecde'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:13.136941 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c602ca31-1dba-4fa6-bc94-afd22f99bcc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e0e81b3121d477794c0bd706fcfecde'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:13.147549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360de68d-d779-4a14-a740-91905a1e54a2 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:13.149571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c602ca31-1dba-4fa6-bc94-afd22f99bcc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e0e81b3121d477794c0bd706fcfecde'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:13.154522 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ea05b-d569-4d03-bc8e-757dd2b937e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:13.155784 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ea05b-d569-4d03-bc8e-757dd2b937e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:13.156136 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ea05b-d569-4d03-bc8e-757dd2b937e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:13.156455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ea05b-d569-4d03-bc8e-757dd2b937e9 admin admin] PATH_INFO: `/v3/users/d9636cb42425425990e5881f2dfc9687` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:13.159166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ea05b-d569-4d03-bc8e-757dd2b937e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9636cb42425425990e5881f2dfc9687)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:13.159315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c602ca31-1dba-4fa6-bc94-afd22f99bcc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e0e81b3121d477794c0bd706fcfecde'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:13.161236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ea05b-d569-4d03-bc8e-757dd2b937e9 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:13.183946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1064/2112] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:12 2022] DELETE /identity/v3/users/2e0e81b3121d477794c0bd706fcfecde => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:13.226371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-676ea05b-d569-4d03-bc8e-757dd2b937e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9636cb42425425990e5881f2dfc9687'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:13.240958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-676ea05b-d569-4d03-bc8e-757dd2b937e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9636cb42425425990e5881f2dfc9687'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:13.245422 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-676ea05b-d569-4d03-bc8e-757dd2b937e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9636cb42425425990e5881f2dfc9687'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:13.246106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-676ea05b-d569-4d03-bc8e-757dd2b937e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9636cb42425425990e5881f2dfc9687'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:13.267474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-676ea05b-d569-4d03-bc8e-757dd2b937e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9636cb42425425990e5881f2dfc9687'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:13.309008 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1049/2113] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:13 2022] DELETE /identity/v3/users/d9636cb42425425990e5881f2dfc9687 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:13.314101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436ccda-c997-442b-a00a-5a9039da4121 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:13.314671 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436ccda-c997-442b-a00a-5a9039da4121 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:13.314843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436ccda-c997-442b-a00a-5a9039da4121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:13.378943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8436ccda-c997-442b-a00a-5a9039da4121 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:13.380198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8436ccda-c997-442b-a00a-5a9039da4121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:13.519013 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1065/2114] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:13.553442 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ea05b-d569-4d03-bc8e-757dd2b937e9 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:13.555902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-676ea05b-d569-4d03-bc8e-757dd2b937e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:13.687738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ea05b-d569-4d03-bc8e-757dd2b937e9 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:13.695856 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283184a-e3e9-44ba-b7c3-975c27f9f874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:13.696928 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283184a-e3e9-44ba-b7c3-975c27f9f874 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:13.697649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283184a-e3e9-44ba-b7c3-975c27f9f874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:13.697649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283184a-e3e9-44ba-b7c3-975c27f9f874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:13.719015 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283184a-e3e9-44ba-b7c3-975c27f9f874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:13.720614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283184a-e3e9-44ba-b7c3-975c27f9f874 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:13.745518 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1050/2115] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:14.202745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436ccda-c997-442b-a00a-5a9039da4121 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:14.204710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8436ccda-c997-442b-a00a-5a9039da4121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:14.252282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436ccda-c997-442b-a00a-5a9039da4121 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:14.269717 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c71ef-9859-46fe-ae52-f0074bc56490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:14.270624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c71ef-9859-46fe-ae52-f0074bc56490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:14.270906 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c71ef-9859-46fe-ae52-f0074bc56490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:14.271178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c71ef-9859-46fe-ae52-f0074bc56490 admin admin] PATH_INFO: `/v3/projects/208253d7ad0f433fb0212c420a55618c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:14.272558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c71ef-9859-46fe-ae52-f0074bc56490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=208253d7ad0f433fb0212c420a55618c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:14.275668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c71ef-9859-46fe-ae52-f0074bc56490 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:14.371203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8a7c71ef-9859-46fe-ae52-f0074bc56490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208253d7ad0f433fb0212c420a55618c', 'request_id': 'req-8a7c71ef-9859-46fe-ae52-f0074bc56490'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:14.391929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8a7c71ef-9859-46fe-ae52-f0074bc56490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208253d7ad0f433fb0212c420a55618c', 'request_id': 'req-8a7c71ef-9859-46fe-ae52-f0074bc56490'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:14.404486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8a7c71ef-9859-46fe-ae52-f0074bc56490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208253d7ad0f433fb0212c420a55618c', 'request_id': 'req-8a7c71ef-9859-46fe-ae52-f0074bc56490'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:14.435811 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8a7c71ef-9859-46fe-ae52-f0074bc56490 admin admin] The token cache is being invalidate because project 208253d7ad0f433fb0212c420a55618c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:14.436889 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8a7c71ef-9859-46fe-ae52-f0074bc56490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:14.439357 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8a7c71ef-9859-46fe-ae52-f0074bc56490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:14.449950 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd041efc-5663-469f-a8e0-9549a84f9024 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:14.450495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd041efc-5663-469f-a8e0-9549a84f9024 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:14.450495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd041efc-5663-469f-a8e0-9549a84f9024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:14.459279 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1066/2116] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:14 2022] DELETE /identity/v3/projects/208253d7ad0f433fb0212c420a55618c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:14.488348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-fd041efc-5663-469f-a8e0-9549a84f9024 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:14.489549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-fd041efc-5663-469f-a8e0-9549a84f9024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:14.632988 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1051/2117] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:20:14.641292 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c71ef-9859-46fe-ae52-f0074bc56490 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:14.645859 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8a7c71ef-9859-46fe-ae52-f0074bc56490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:14.652007 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d41a9-c125-4892-9edb-08d0c61e645a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:14.652326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d41a9-c125-4892-9edb-08d0c61e645a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:14.652644 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d41a9-c125-4892-9edb-08d0c61e645a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:14.720977 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c71ef-9859-46fe-ae52-f0074bc56490 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:14.738127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8584a8b-b974-4246-8aa7-40d993cee5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:14.739028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8584a8b-b974-4246-8aa7-40d993cee5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:14.739313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8584a8b-b974-4246-8aa7-40d993cee5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:14.739598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8584a8b-b974-4246-8aa7-40d993cee5fe admin admin] PATH_INFO: `/v3/projects/934bf53ca23b4f5eb2a84c24e18521ac` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:14.741888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8584a8b-b974-4246-8aa7-40d993cee5fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=934bf53ca23b4f5eb2a84c24e18521ac)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:14.759230 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-5c2d41a9-c125-4892-9edb-08d0c61e645a None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:14.761879 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8584a8b-b974-4246-8aa7-40d993cee5fe admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:14.763191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5c2d41a9-c125-4892-9edb-08d0c61e645a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:14.786881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1052/2118] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:14.789070 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d41a9-c125-4892-9edb-08d0c61e645a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:14.799369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:14.807031 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d41a9-c125-4892-9edb-08d0c61e645a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:14.824558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a64126-cdc6-4f8d-b992-a2d07262df95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:14.825418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a64126-cdc6-4f8d-b992-a2d07262df95 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:14.825832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a64126-cdc6-4f8d-b992-a2d07262df95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:14.826219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a64126-cdc6-4f8d-b992-a2d07262df95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:14.827107 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a64126-cdc6-4f8d-b992-a2d07262df95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:20:14.827524 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a64126-cdc6-4f8d-b992-a2d07262df95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:14.829681 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a64126-cdc6-4f8d-b992-a2d07262df95 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:14.850990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1053/2119] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:20:14.852529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a64126-cdc6-4f8d-b992-a2d07262df95 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:14.885169 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a64126-cdc6-4f8d-b992-a2d07262df95 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:14.918633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:14.927590 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b8584a8b-b974-4246-8aa7-40d993cee5fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934bf53ca23b4f5eb2a84c24e18521ac', 'request_id': 'req-b8584a8b-b974-4246-8aa7-40d993cee5fe'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:14.940641 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b8584a8b-b974-4246-8aa7-40d993cee5fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934bf53ca23b4f5eb2a84c24e18521ac', 'request_id': 'req-b8584a8b-b974-4246-8aa7-40d993cee5fe'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:14.959353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b8584a8b-b974-4246-8aa7-40d993cee5fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934bf53ca23b4f5eb2a84c24e18521ac', 'request_id': 'req-b8584a8b-b974-4246-8aa7-40d993cee5fe'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:14.987953 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b8584a8b-b974-4246-8aa7-40d993cee5fe admin admin] The token cache is being invalidate because project 934bf53ca23b4f5eb2a84c24e18521ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:14.988574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b8584a8b-b974-4246-8aa7-40d993cee5fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:14.989262 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b8584a8b-b974-4246-8aa7-40d993cee5fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:14.996668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1067/2120] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:14 2022] DELETE /identity/v3/projects/934bf53ca23b4f5eb2a84c24e18521ac => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:14.998113 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8584a8b-b974-4246-8aa7-40d993cee5fe admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:15.001975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b8584a8b-b974-4246-8aa7-40d993cee5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:15.063278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a8988-f058-4264-87a8-93ba83a19e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:15.063979 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a8988-f058-4264-87a8-93ba83a19e35 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:15.064301 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a8988-f058-4264-87a8-93ba83a19e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:15.064571 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a8988-f058-4264-87a8-93ba83a19e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:15.065273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a8988-f058-4264-87a8-93ba83a19e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:15.067216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a8988-f058-4264-87a8-93ba83a19e35 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:15.136015 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1054/2121] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:14 2022] POST /identity/v3/projects => generated 385 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:15.142508 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a8988-f058-4264-87a8-93ba83a19e35 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:15.144490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a18a8988-f058-4264-87a8-93ba83a19e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:15.275555 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8584a8b-b974-4246-8aa7-40d993cee5fe admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:15.309341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a8988-f058-4264-87a8-93ba83a19e35 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:15.315634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1971ae3-6574-4be6-9728-423f8da52bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:15.316601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1971ae3-6574-4be6-9728-423f8da52bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:15.316726 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1971ae3-6574-4be6-9728-423f8da52bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:15.318064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1971ae3-6574-4be6-9728-423f8da52bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:15.318936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1971ae3-6574-4be6-9728-423f8da52bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:15.321490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1971ae3-6574-4be6-9728-423f8da52bc9 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:15.362464 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1055/2122] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:15 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:15.368272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1971ae3-6574-4be6-9728-423f8da52bc9 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:15.392505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1971ae3-6574-4be6-9728-423f8da52bc9 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:15.407757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7b8c5-c2ec-41e7-a2cd-a05ae9fd77c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:15.411196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7b8c5-c2ec-41e7-a2cd-a05ae9fd77c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:15.411343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7b8c5-c2ec-41e7-a2cd-a05ae9fd77c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:15.411606 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7b8c5-c2ec-41e7-a2cd-a05ae9fd77c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:15.412799 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7b8c5-c2ec-41e7-a2cd-a05ae9fd77c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:15.415864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7b8c5-c2ec-41e7-a2cd-a05ae9fd77c0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:15.427003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a58cb-6fb4-40d1-8bfe-e16cf3840d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:15.427905 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a58cb-6fb4-40d1-8bfe-e16cf3840d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:15.428189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a58cb-6fb4-40d1-8bfe-e16cf3840d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:15.428536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a58cb-6fb4-40d1-8bfe-e16cf3840d0e admin admin] PATH_INFO: `/v3/users/d311c49eb26b45cc92a3396afdf6481f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:15.430963 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a58cb-6fb4-40d1-8bfe-e16cf3840d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d311c49eb26b45cc92a3396afdf6481f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:15.433727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a58cb-6fb4-40d1-8bfe-e16cf3840d0e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:15.439108 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1056/2123] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:15.443043 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7b8c5-c2ec-41e7-a2cd-a05ae9fd77c0 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:15.473499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7b8c5-c2ec-41e7-a2cd-a05ae9fd77c0 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:15.490805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e1834-1313-4436-ba03-9122b02c8051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:15.493038 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1834-1313-4436-ba03-9122b02c8051 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:15.493515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1834-1313-4436-ba03-9122b02c8051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:15.494828 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1834-1313-4436-ba03-9122b02c8051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:15.496153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e1834-1313-4436-ba03-9122b02c8051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:15.500755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e1834-1313-4436-ba03-9122b02c8051 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:15.525345 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1057/2124] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:15.532976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e1834-1313-4436-ba03-9122b02c8051 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:15.548113 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-aa5a58cb-6fb4-40d1-8bfe-e16cf3840d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd311c49eb26b45cc92a3396afdf6481f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:15.549767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-aa5a58cb-6fb4-40d1-8bfe-e16cf3840d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd311c49eb26b45cc92a3396afdf6481f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:15.551595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-aa5a58cb-6fb4-40d1-8bfe-e16cf3840d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd311c49eb26b45cc92a3396afdf6481f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:15.565511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e1834-1313-4436-ba03-9122b02c8051 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:15.570120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-aa5a58cb-6fb4-40d1-8bfe-e16cf3840d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd311c49eb26b45cc92a3396afdf6481f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:15.576967 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e26cc-7007-4229-a568-f686d4521d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:15.578833 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e26cc-7007-4229-a568-f686d4521d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:15.579760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e26cc-7007-4229-a568-f686d4521d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:15.580171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e26cc-7007-4229-a568-f686d4521d14 admin admin] PATH_INFO: `/v3/projects/3f91565501744ce3b34047a9a0868037/users/6d25d398fec9483cbabc217478d1a351/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:15.585415 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-aa5a58cb-6fb4-40d1-8bfe-e16cf3840d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd311c49eb26b45cc92a3396afdf6481f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:15.615827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:15.627243 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e26cc-7007-4229-a568-f686d4521d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f91565501744ce3b34047a9a0868037, user_id=6d25d398fec9483cbabc217478d1a351, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:15.636114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e26cc-7007-4229-a568-f686d4521d14 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:15.638042 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1068/2125] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:14 2022] DELETE /identity/v3/users/d311c49eb26b45cc92a3396afdf6481f => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:15.655488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1058/2126] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:15 2022] PUT /identity/v3/projects/3f91565501744ce3b34047a9a0868037/users/6d25d398fec9483cbabc217478d1a351/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:15.667822 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a5cd3-07ff-4c20-a3ec-2f05603591e9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:15.668415 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a5cd3-07ff-4c20-a3ec-2f05603591e9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:15.669180 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a5cd3-07ff-4c20-a3ec-2f05603591e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:15.735979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5f6a5cd3-07ff-4c20-a3ec-2f05603591e9 None None] MFA Rules not processed for user `6d25d398fec9483cbabc217478d1a351`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:15.740398 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5f6a5cd3-07ff-4c20-a3ec-2f05603591e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:15.855251 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1069/2127] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:15.873576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e26cc-7007-4229-a568-f686d4521d14 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:15.875772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-455e26cc-7007-4229-a568-f686d4521d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:15.920520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:15.987326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e26cc-7007-4229-a568-f686d4521d14 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:15.991280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7174928-cf5b-4ba9-98ca-e1cd3375f70c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:15.992091 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7174928-cf5b-4ba9-98ca-e1cd3375f70c service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:15.992508 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7174928-cf5b-4ba9-98ca-e1cd3375f70c service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:15.993072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7174928-cf5b-4ba9-98ca-e1cd3375f70c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:16.005455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7174928-cf5b-4ba9-98ca-e1cd3375f70c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:16.007976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7174928-cf5b-4ba9-98ca-e1cd3375f70c service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:16.020079 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1059/2128] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:16.572097 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a5cd3-07ff-4c20-a3ec-2f05603591e9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:16.574985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5f6a5cd3-07ff-4c20-a3ec-2f05603591e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:16.673109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a5cd3-07ff-4c20-a3ec-2f05603591e9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:16.681020 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:16.682368 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:16.682663 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:16.682965 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0 admin admin] PATH_INFO: `/v3/projects/533bf2eb6324425f9569f858801a728b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:16.684219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=533bf2eb6324425f9569f858801a728b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:16.686195 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:16.746450 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '533bf2eb6324425f9569f858801a728b', 'request_id': 'req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:16.758161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '533bf2eb6324425f9569f858801a728b', 'request_id': 'req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:16.764465 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '533bf2eb6324425f9569f858801a728b', 'request_id': 'req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:16.779189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0 admin admin] The token cache is being invalidate because project 533bf2eb6324425f9569f858801a728b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:16.779483 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:16.780286 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:16.783213 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1070/2129] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:16 2022] DELETE /identity/v3/projects/533bf2eb6324425f9569f858801a728b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:16.786915 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7174928-cf5b-4ba9-98ca-e1cd3375f70c service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:16.799379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7174928-cf5b-4ba9-98ca-e1cd3375f70c service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:16.862900 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564085e9-6e85-48ad-8ba9-65e4ffe3fa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:16.863866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564085e9-6e85-48ad-8ba9-65e4ffe3fa20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:16.864313 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564085e9-6e85-48ad-8ba9-65e4ffe3fa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:16.864598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564085e9-6e85-48ad-8ba9-65e4ffe3fa20 admin admin] PATH_INFO: `/v3/users/d97afebc56e24f958d22ce3373b654d6` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:16.865939 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564085e9-6e85-48ad-8ba9-65e4ffe3fa20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97afebc56e24f958d22ce3373b654d6)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:16.868003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564085e9-6e85-48ad-8ba9-65e4ffe3fa20 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:16.927993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-564085e9-6e85-48ad-8ba9-65e4ffe3fa20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97afebc56e24f958d22ce3373b654d6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:16.939379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-564085e9-6e85-48ad-8ba9-65e4ffe3fa20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97afebc56e24f958d22ce3373b654d6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:16.943805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-564085e9-6e85-48ad-8ba9-65e4ffe3fa20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97afebc56e24f958d22ce3373b654d6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:16.948755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-564085e9-6e85-48ad-8ba9-65e4ffe3fa20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97afebc56e24f958d22ce3373b654d6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:16.962895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-564085e9-6e85-48ad-8ba9-65e4ffe3fa20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97afebc56e24f958d22ce3373b654d6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:16.980297 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1060/2130] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:16 2022] DELETE /identity/v3/users/d97afebc56e24f958d22ce3373b654d6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:17.482783 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:17.484146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:17.510276 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df8d11-5fd1-40e8-9514-f774fe0a00f0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:17.525485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:17.592127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730acfb-f9c5-4cfc-a769-6de4036c82cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:17.594762 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730acfb-f9c5-4cfc-a769-6de4036c82cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:17.595290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730acfb-f9c5-4cfc-a769-6de4036c82cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:17.595776 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730acfb-f9c5-4cfc-a769-6de4036c82cc admin admin] PATH_INFO: `/v3/projects/26de69ea17034c929047d57f915f4ac0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:17.598572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730acfb-f9c5-4cfc-a769-6de4036c82cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=26de69ea17034c929047d57f915f4ac0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:17.600558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730acfb-f9c5-4cfc-a769-6de4036c82cc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:17.663040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9730acfb-f9c5-4cfc-a769-6de4036c82cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26de69ea17034c929047d57f915f4ac0', 'request_id': 'req-9730acfb-f9c5-4cfc-a769-6de4036c82cc'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:17.673250 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9730acfb-f9c5-4cfc-a769-6de4036c82cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26de69ea17034c929047d57f915f4ac0', 'request_id': 'req-9730acfb-f9c5-4cfc-a769-6de4036c82cc'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:17.700160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9730acfb-f9c5-4cfc-a769-6de4036c82cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26de69ea17034c929047d57f915f4ac0', 'request_id': 'req-9730acfb-f9c5-4cfc-a769-6de4036c82cc'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:17.735973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9730acfb-f9c5-4cfc-a769-6de4036c82cc admin admin] The token cache is being invalidate because project 26de69ea17034c929047d57f915f4ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:17.736483 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9730acfb-f9c5-4cfc-a769-6de4036c82cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:17.737209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9730acfb-f9c5-4cfc-a769-6de4036c82cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:17.740321 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1071/2131] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:17 2022] DELETE /identity/v3/projects/26de69ea17034c929047d57f915f4ac0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:17.745701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4fa3c-6ae4-45c8-8099-4703ca6553ae None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:17.746026 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4fa3c-6ae4-45c8-8099-4703ca6553ae None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:17.746300 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4fa3c-6ae4-45c8-8099-4703ca6553ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:17.769628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-f1c4fa3c-6ae4-45c8-8099-4703ca6553ae None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:17.770963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f1c4fa3c-6ae4-45c8-8099-4703ca6553ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:17.825664 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:17.859485 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1061/2132] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:17.868623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967a520-a6ba-4999-ae71-21610272ef0f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:17.869875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967a520-a6ba-4999-ae71-21610272ef0f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:17.869875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967a520-a6ba-4999-ae71-21610272ef0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:17.891817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e967a520-a6ba-4999-ae71-21610272ef0f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:17.908211 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e967a520-a6ba-4999-ae71-21610272ef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:17.919764 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1072/2133] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:17.923989 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4fa3c-6ae4-45c8-8099-4703ca6553ae None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:17.935782 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4fa3c-6ae4-45c8-8099-4703ca6553ae None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:17.943578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b67625-46d2-40bf-81b8-14dbf5687c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:17.944284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b67625-46d2-40bf-81b8-14dbf5687c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:17.944584 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b67625-46d2-40bf-81b8-14dbf5687c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:17.944863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b67625-46d2-40bf-81b8-14dbf5687c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:17.945674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b67625-46d2-40bf-81b8-14dbf5687c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:20:17.946019 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b67625-46d2-40bf-81b8-14dbf5687c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:17.947800 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b67625-46d2-40bf-81b8-14dbf5687c75 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:17.969174 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1062/2134] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:20:17.970364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967a520-a6ba-4999-ae71-21610272ef0f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:17.984610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967a520-a6ba-4999-ae71-21610272ef0f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:17.996925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b9617-1ffb-435f-b9e3-66ffbcd449bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:17.997712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b9617-1ffb-435f-b9e3-66ffbcd449bb admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:17.998011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b9617-1ffb-435f-b9e3-66ffbcd449bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:17.998341 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b9617-1ffb-435f-b9e3-66ffbcd449bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:17.999083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b9617-1ffb-435f-b9e3-66ffbcd449bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:18.001990 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b9617-1ffb-435f-b9e3-66ffbcd449bb admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:18.044439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1073/2135] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:17 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:20:18.048868 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b67625-46d2-40bf-81b8-14dbf5687c75 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:18.064489 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b67625-46d2-40bf-81b8-14dbf5687c75 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:18.152532 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3a5b2-9dde-4caa-801e-f9c7f823ada0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:18.153655 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3a5b2-9dde-4caa-801e-f9c7f823ada0 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:18.153655 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3a5b2-9dde-4caa-801e-f9c7f823ada0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:18.153853 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3a5b2-9dde-4caa-801e-f9c7f823ada0 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:18.154607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3a5b2-9dde-4caa-801e-f9c7f823ada0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:18.156953 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3a5b2-9dde-4caa-801e-f9c7f823ada0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:18.194967 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1063/2136] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:18 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:18.199488 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b9617-1ffb-435f-b9e3-66ffbcd449bb admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:18.218650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b9617-1ffb-435f-b9e3-66ffbcd449bb admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:18.224137 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce96c20-487c-463a-b320-b729933c0cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:18.229938 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce96c20-487c-463a-b320-b729933c0cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:18.229938 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce96c20-487c-463a-b320-b729933c0cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:18.229938 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce96c20-487c-463a-b320-b729933c0cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:18.229938 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce96c20-487c-463a-b320-b729933c0cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:18.229938 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce96c20-487c-463a-b320-b729933c0cb9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:18.246118 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1074/2137] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:18.246822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3a5b2-9dde-4caa-801e-f9c7f823ada0 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:18.261921 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3a5b2-9dde-4caa-801e-f9c7f823ada0 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:18.268666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16124a5-a672-48ab-89ed-aae9c4e1095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:18.269353 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16124a5-a672-48ab-89ed-aae9c4e1095d admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:18.269636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16124a5-a672-48ab-89ed-aae9c4e1095d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:18.269910 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16124a5-a672-48ab-89ed-aae9c4e1095d admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:18.270643 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16124a5-a672-48ab-89ed-aae9c4e1095d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:18.272290 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16124a5-a672-48ab-89ed-aae9c4e1095d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:18.285293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1064/2138] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:20:18.289517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce96c20-487c-463a-b320-b729933c0cb9 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:18.302137 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce96c20-487c-463a-b320-b729933c0cb9 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:18.307756 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d53a2-3dc1-404b-b43f-abfe03708977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:18.308959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d53a2-3dc1-404b-b43f-abfe03708977 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:18.309441 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d53a2-3dc1-404b-b43f-abfe03708977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:18.309655 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d53a2-3dc1-404b-b43f-abfe03708977 admin admin] PATH_INFO: `/v3/projects/68be44517dc348229448e88499a0d0c7/users/84ed12c28c1f4ef09204037223f9a5bb/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:18.335738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d53a2-3dc1-404b-b43f-abfe03708977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68be44517dc348229448e88499a0d0c7, user_id=84ed12c28c1f4ef09204037223f9a5bb, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:18.343453 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d53a2-3dc1-404b-b43f-abfe03708977 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:18.360623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1075/2139] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:18 2022] PUT /identity/v3/projects/68be44517dc348229448e88499a0d0c7/users/84ed12c28c1f4ef09204037223f9a5bb/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:20:18.372127 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4561641-c07c-40a2-bc4e-edd870b4e711 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:18.372496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4561641-c07c-40a2-bc4e-edd870b4e711 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:18.372731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4561641-c07c-40a2-bc4e-edd870b4e711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:18.425030 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c4561641-c07c-40a2-bc4e-edd870b4e711 None None] MFA Rules not processed for user `84ed12c28c1f4ef09204037223f9a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:18.427034 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c4561641-c07c-40a2-bc4e-edd870b4e711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:18.556688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1065/2140] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:20:18.569139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d53a2-3dc1-404b-b43f-abfe03708977 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:18.571242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-af3d53a2-3dc1-404b-b43f-abfe03708977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:18.627406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:18.644923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d53a2-3dc1-404b-b43f-abfe03708977 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:18.650146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb976754-9514-46b9-8a72-cd5ac2ab7225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:18.650993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb976754-9514-46b9-8a72-cd5ac2ab7225 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:18.651328 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb976754-9514-46b9-8a72-cd5ac2ab7225 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:18.651738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb976754-9514-46b9-8a72-cd5ac2ab7225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:18.661867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb976754-9514-46b9-8a72-cd5ac2ab7225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:18.663564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb976754-9514-46b9-8a72-cd5ac2ab7225 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:18.690858 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1076/2141] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:20:19.640878 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef16b17-cb50-49a2-a9c5-9ddcb7fac6f8 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:19.640878 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef16b17-cb50-49a2-a9c5-9ddcb7fac6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:19.640878 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef16b17-cb50-49a2-a9c5-9ddcb7fac6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:19.671142 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3ef16b17-cb50-49a2-a9c5-9ddcb7fac6f8 None None] MFA Rules not processed for user `947b842f0b1e428286893d5f9353393a`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:19.672384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3ef16b17-cb50-49a2-a9c5-9ddcb7fac6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:19.703372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:19.752452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1066/2142] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:19.757863 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb976754-9514-46b9-8a72-cd5ac2ab7225 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:19.759653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fb976754-9514-46b9-8a72-cd5ac2ab7225 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:19.843011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb976754-9514-46b9-8a72-cd5ac2ab7225 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:19.848562 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a6097-c84d-4385-82e3-37b861aa2cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:19.849343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a6097-c84d-4385-82e3-37b861aa2cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:19.849757 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a6097-c84d-4385-82e3-37b861aa2cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:19.850055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a6097-c84d-4385-82e3-37b861aa2cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:19.850792 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a6097-c84d-4385-82e3-37b861aa2cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:19.853768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a6097-c84d-4385-82e3-37b861aa2cd9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:19.889568 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1077/2143] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:19 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:20:19.893885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef16b17-cb50-49a2-a9c5-9ddcb7fac6f8 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:19.914331 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef16b17-cb50-49a2-a9c5-9ddcb7fac6f8 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:19.982890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48832fc1-f247-4759-8a04-38bc28e37ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:19.983879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48832fc1-f247-4759-8a04-38bc28e37ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:19.984295 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48832fc1-f247-4759-8a04-38bc28e37ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:19.985219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48832fc1-f247-4759-8a04-38bc28e37ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:19.986043 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48832fc1-f247-4759-8a04-38bc28e37ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:19.988862 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48832fc1-f247-4759-8a04-38bc28e37ed2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:20.038255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a6097-c84d-4385-82e3-37b861aa2cd9 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:20.041816 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1067/2144] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:19 2022] POST /identity/v3/users => generated 299 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:20.059961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a6097-c84d-4385-82e3-37b861aa2cd9 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:20.077067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1562ec7-9fd2-4549-8473-81d3ad405f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:20.078020 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1562ec7-9fd2-4549-8473-81d3ad405f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:20.078486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1562ec7-9fd2-4549-8473-81d3ad405f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:20.079087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1562ec7-9fd2-4549-8473-81d3ad405f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:20.080047 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1562ec7-9fd2-4549-8473-81d3ad405f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:20.084151 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1562ec7-9fd2-4549-8473-81d3ad405f4b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:20.114415 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1078/2145] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:20.118643 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48832fc1-f247-4759-8a04-38bc28e37ed2 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:20.134025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48832fc1-f247-4759-8a04-38bc28e37ed2 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:20.144676 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab769ee-82b3-423f-9d7e-4581d0b93dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:20.146779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab769ee-82b3-423f-9d7e-4581d0b93dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:20.147146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab769ee-82b3-423f-9d7e-4581d0b93dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:20.149845 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab769ee-82b3-423f-9d7e-4581d0b93dbe admin admin] PATH_INFO: `/v3/projects/177c2add29e249f7b9b48afdee52ee72/users/eee03ed1e2144e5fa451a2f16da21bf2/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:20.170745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab769ee-82b3-423f-9d7e-4581d0b93dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=177c2add29e249f7b9b48afdee52ee72, user_id=eee03ed1e2144e5fa451a2f16da21bf2, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:20.173731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab769ee-82b3-423f-9d7e-4581d0b93dbe admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:20.220480 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1068/2146] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:20 2022] PUT /identity/v3/projects/177c2add29e249f7b9b48afdee52ee72/users/eee03ed1e2144e5fa451a2f16da21bf2/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:20.221381 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1562ec7-9fd2-4549-8473-81d3ad405f4b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:20.242386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1562ec7-9fd2-4549-8473-81d3ad405f4b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:20.420576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4df27-70a3-4150-b796-044f2b4ad2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:20.421270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4df27-70a3-4150-b796-044f2b4ad2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:20.421611 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4df27-70a3-4150-b796-044f2b4ad2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:20.421891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4df27-70a3-4150-b796-044f2b4ad2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:20.423282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4df27-70a3-4150-b796-044f2b4ad2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:20.425184 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4df27-70a3-4150-b796-044f2b4ad2bc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:20.441196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1079/2147] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:20.442497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab769ee-82b3-423f-9d7e-4581d0b93dbe admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:20.459168 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab769ee-82b3-423f-9d7e-4581d0b93dbe admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:20.481383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24453a-7fe0-40ee-bb5f-22bcd16a10ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:20.482738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24453a-7fe0-40ee-bb5f-22bcd16a10ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:20.484703 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24453a-7fe0-40ee-bb5f-22bcd16a10ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:20.485778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24453a-7fe0-40ee-bb5f-22bcd16a10ca admin admin] PATH_INFO: `/v3/projects/177c2add29e249f7b9b48afdee52ee72/users/eee03ed1e2144e5fa451a2f16da21bf2/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:20.503519 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24453a-7fe0-40ee-bb5f-22bcd16a10ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=177c2add29e249f7b9b48afdee52ee72, user_id=eee03ed1e2144e5fa451a2f16da21bf2, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:20.509915 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24453a-7fe0-40ee-bb5f-22bcd16a10ca admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:20.530257 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1069/2148] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:20 2022] PUT /identity/v3/projects/177c2add29e249f7b9b48afdee52ee72/users/eee03ed1e2144e5fa451a2f16da21bf2/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:24.921310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4df27-70a3-4150-b796-044f2b4ad2bc admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:24.923846 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d4b4df27-70a3-4150-b796-044f2b4ad2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:24.940313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4df27-70a3-4150-b796-044f2b4ad2bc admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:25.004803 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:25.016636 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419e64e-a697-4b56-827c-fb3ea69fadf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:25.017761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419e64e-a697-4b56-827c-fb3ea69fadf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:25.018277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419e64e-a697-4b56-827c-fb3ea69fadf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:25.018914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419e64e-a697-4b56-827c-fb3ea69fadf2 admin admin] PATH_INFO: `/v3/users/6d25d398fec9483cbabc217478d1a351` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:25.021287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419e64e-a697-4b56-827c-fb3ea69fadf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d25d398fec9483cbabc217478d1a351)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:25.037381 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419e64e-a697-4b56-827c-fb3ea69fadf2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:25.199364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2419e64e-a697-4b56-827c-fb3ea69fadf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d25d398fec9483cbabc217478d1a351'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:25.200614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2419e64e-a697-4b56-827c-fb3ea69fadf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d25d398fec9483cbabc217478d1a351'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:25.202803 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2419e64e-a697-4b56-827c-fb3ea69fadf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d25d398fec9483cbabc217478d1a351'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:25.234690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2419e64e-a697-4b56-827c-fb3ea69fadf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d25d398fec9483cbabc217478d1a351'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:25.256610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2419e64e-a697-4b56-827c-fb3ea69fadf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d25d398fec9483cbabc217478d1a351'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:25.330626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1080/2149] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:24 2022] DELETE /identity/v3/users/6d25d398fec9483cbabc217478d1a351 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:25.334965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eb60a-c565-4056-af67-88bc54508eee None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:25.335817 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eb60a-c565-4056-af67-88bc54508eee None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:25.336850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39eb60a-c565-4056-af67-88bc54508eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:25.375634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b39eb60a-c565-4056-af67-88bc54508eee None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:25.377276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b39eb60a-c565-4056-af67-88bc54508eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:25.645658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1070/2150] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:25.717523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419e64e-a697-4b56-827c-fb3ea69fadf2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:25.721389 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2419e64e-a697-4b56-827c-fb3ea69fadf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:25.869345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419e64e-a697-4b56-827c-fb3ea69fadf2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:25.881624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db13627-5450-475e-af8f-cea8af5f1018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:25.882626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db13627-5450-475e-af8f-cea8af5f1018 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:25.883209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db13627-5450-475e-af8f-cea8af5f1018 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:25.884411 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db13627-5450-475e-af8f-cea8af5f1018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:25.912100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db13627-5450-475e-af8f-cea8af5f1018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:25.913885 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db13627-5450-475e-af8f-cea8af5f1018 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:25.937502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1081/2151] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:26.726320 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39eb60a-c565-4056-af67-88bc54508eee None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:26.728498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b39eb60a-c565-4056-af67-88bc54508eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:26.741453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39eb60a-c565-4056-af67-88bc54508eee None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:26.747746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6837dc-0394-45dc-8adb-b7d708bf88f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:26.749148 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6837dc-0394-45dc-8adb-b7d708bf88f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:26.749662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6837dc-0394-45dc-8adb-b7d708bf88f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:26.750155 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6837dc-0394-45dc-8adb-b7d708bf88f3 admin admin] PATH_INFO: `/v3/projects/3f91565501744ce3b34047a9a0868037` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:26.751596 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6837dc-0394-45dc-8adb-b7d708bf88f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f91565501744ce3b34047a9a0868037)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:26.754100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6837dc-0394-45dc-8adb-b7d708bf88f3 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:26.773577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:26.842442 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3a6837dc-0394-45dc-8adb-b7d708bf88f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f91565501744ce3b34047a9a0868037', 'request_id': 'req-3a6837dc-0394-45dc-8adb-b7d708bf88f3'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:26.856886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3a6837dc-0394-45dc-8adb-b7d708bf88f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f91565501744ce3b34047a9a0868037', 'request_id': 'req-3a6837dc-0394-45dc-8adb-b7d708bf88f3'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:26.865481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3a6837dc-0394-45dc-8adb-b7d708bf88f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f91565501744ce3b34047a9a0868037', 'request_id': 'req-3a6837dc-0394-45dc-8adb-b7d708bf88f3'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:26.894343 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3a6837dc-0394-45dc-8adb-b7d708bf88f3 admin admin] The token cache is being invalidate because project 3f91565501744ce3b34047a9a0868037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:26.894644 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3a6837dc-0394-45dc-8adb-b7d708bf88f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:26.896658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3a6837dc-0394-45dc-8adb-b7d708bf88f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:26.906561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1071/2152] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:26 2022] DELETE /identity/v3/projects/3f91565501744ce3b34047a9a0868037 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:26.911902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c373c-da23-4f4e-8208-502c4c704610 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:26.912394 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c373c-da23-4f4e-8208-502c4c704610 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:26.912837 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c373c-da23-4f4e-8208-502c4c704610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:26.974136 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2e7c373c-da23-4f4e-8208-502c4c704610 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:26.975576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2e7c373c-da23-4f4e-8208-502c4c704610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:27.111953 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1082/2153] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:20:27.120820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a1a48-5bdf-488f-997e-5100d83b7673 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:27.121218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a1a48-5bdf-488f-997e-5100d83b7673 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:27.121414 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a1a48-5bdf-488f-997e-5100d83b7673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:27.162168 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-5e9a1a48-5bdf-488f-997e-5100d83b7673 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:27.163681 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5e9a1a48-5bdf-488f-997e-5100d83b7673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:27.181081 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1072/2154] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:27.183080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c373c-da23-4f4e-8208-502c4c704610 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:27.215883 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c373c-da23-4f4e-8208-502c4c704610 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:27.221478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146870d-258f-431f-84bc-7202e81d2ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:27.222160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146870d-258f-431f-84bc-7202e81d2ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:27.222445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146870d-258f-431f-84bc-7202e81d2ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:27.222724 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146870d-258f-431f-84bc-7202e81d2ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:27.223454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146870d-258f-431f-84bc-7202e81d2ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:20:27.223764 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146870d-258f-431f-84bc-7202e81d2ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:27.229251 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146870d-258f-431f-84bc-7202e81d2ed6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:27.253583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1083/2155] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:20:27.257985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a1a48-5bdf-488f-997e-5100d83b7673 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:27.272965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a1a48-5bdf-488f-997e-5100d83b7673 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:27.286560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae5407-3c9b-48d8-8ba5-31e6f35cfa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:27.290284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae5407-3c9b-48d8-8ba5-31e6f35cfa02 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:27.290691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae5407-3c9b-48d8-8ba5-31e6f35cfa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:27.291059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae5407-3c9b-48d8-8ba5-31e6f35cfa02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:27.292065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae5407-3c9b-48d8-8ba5-31e6f35cfa02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:27.295853 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae5407-3c9b-48d8-8ba5-31e6f35cfa02 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:27.392981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1073/2156] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:27 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:27.397531 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146870d-258f-431f-84bc-7202e81d2ed6 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:27.409405 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:27.416763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146870d-258f-431f-84bc-7202e81d2ed6 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:27.568443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758cd23-d499-46d6-8379-f3a7df44d633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:27.568443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758cd23-d499-46d6-8379-f3a7df44d633 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:27.568443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758cd23-d499-46d6-8379-f3a7df44d633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:27.568443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758cd23-d499-46d6-8379-f3a7df44d633 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:27.569249 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758cd23-d499-46d6-8379-f3a7df44d633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:27.579659 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758cd23-d499-46d6-8379-f3a7df44d633 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:27.663005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1084/2157] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:27 2022] POST /identity/v3/users => generated 288 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:27.663201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae5407-3c9b-48d8-8ba5-31e6f35cfa02 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:27.686940 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae5407-3c9b-48d8-8ba5-31e6f35cfa02 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:27.692932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0315885-6012-4aad-80e9-fe25535ba457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:27.693618 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0315885-6012-4aad-80e9-fe25535ba457 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:27.693891 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0315885-6012-4aad-80e9-fe25535ba457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:27.694173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0315885-6012-4aad-80e9-fe25535ba457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:27.694911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0315885-6012-4aad-80e9-fe25535ba457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:27.697938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0315885-6012-4aad-80e9-fe25535ba457 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:27.723899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758cd23-d499-46d6-8379-f3a7df44d633 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:27.735029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1074/2158] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:27.737572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758cd23-d499-46d6-8379-f3a7df44d633 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:27.743674 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34b81d-5140-4d16-bd7a-ed21ea2788b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:27.744957 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34b81d-5140-4d16-bd7a-ed21ea2788b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:27.745413 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34b81d-5140-4d16-bd7a-ed21ea2788b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:27.745834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34b81d-5140-4d16-bd7a-ed21ea2788b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:27.746734 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34b81d-5140-4d16-bd7a-ed21ea2788b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:27.748627 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34b81d-5140-4d16-bd7a-ed21ea2788b7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:27.765922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0315885-6012-4aad-80e9-fe25535ba457 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:27.778178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1085/2159] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:27.780969 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0315885-6012-4aad-80e9-fe25535ba457 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:27.792208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c42b8-3a52-4144-92ff-cb1dfe132d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:27.793162 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c42b8-3a52-4144-92ff-cb1dfe132d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:27.794235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c42b8-3a52-4144-92ff-cb1dfe132d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:27.794688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c42b8-3a52-4144-92ff-cb1dfe132d76 admin admin] PATH_INFO: `/v3/projects/1b9cde0738624ecfa304ec26446d78bc/users/6d7d2140ee124446b7184f4fb0d5eee3/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:27.827569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c42b8-3a52-4144-92ff-cb1dfe132d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9cde0738624ecfa304ec26446d78bc, user_id=6d7d2140ee124446b7184f4fb0d5eee3, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:27.832694 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c42b8-3a52-4144-92ff-cb1dfe132d76 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:27.870474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5afa5-4216-4838-968a-bceecf573e16 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:27.870887 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5afa5-4216-4838-968a-bceecf573e16 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:27.871164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5afa5-4216-4838-968a-bceecf573e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:27.874871 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1075/2160] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:27 2022] PUT /identity/v3/projects/1b9cde0738624ecfa304ec26446d78bc/users/6d7d2140ee124446b7184f4fb0d5eee3/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:27.909477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-68d5afa5-4216-4838-968a-bceecf573e16 None None] MFA Rules not processed for user `6d7d2140ee124446b7184f4fb0d5eee3`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:27.916468 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-68d5afa5-4216-4838-968a-bceecf573e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:28.014276 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1086/2161] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:28.020165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c42b8-3a52-4144-92ff-cb1dfe132d76 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:28.099302 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c42b8-3a52-4144-92ff-cb1dfe132d76 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:28.105552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a8298-065b-4d07-b9bc-76a060c6f14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:28.107066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a8298-065b-4d07-b9bc-76a060c6f14a admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:28.107066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a8298-065b-4d07-b9bc-76a060c6f14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:28.107066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a8298-065b-4d07-b9bc-76a060c6f14a admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:28.108006 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a8298-065b-4d07-b9bc-76a060c6f14a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:28.110096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a8298-065b-4d07-b9bc-76a060c6f14a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:28.194243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5afa5-4216-4838-968a-bceecf573e16 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:28.203025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1076/2162] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:28 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:28.209517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5afa5-4216-4838-968a-bceecf573e16 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:28.345325 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f923c-f2c0-49a4-b455-4d122b2368d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:28.346039 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f923c-f2c0-49a4-b455-4d122b2368d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:28.346329 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f923c-f2c0-49a4-b455-4d122b2368d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:28.346615 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f923c-f2c0-49a4-b455-4d122b2368d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:28.347323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f923c-f2c0-49a4-b455-4d122b2368d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:28.349390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f923c-f2c0-49a4-b455-4d122b2368d8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:28.400115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1087/2163] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:28 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:28.404913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a8298-065b-4d07-b9bc-76a060c6f14a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:28.422221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a8298-065b-4d07-b9bc-76a060c6f14a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:28.443013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48835d1d-70e4-423c-82da-66582d59d880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:28.444125 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48835d1d-70e4-423c-82da-66582d59d880 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:28.444813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48835d1d-70e4-423c-82da-66582d59d880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:28.445105 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48835d1d-70e4-423c-82da-66582d59d880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:28.446390 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48835d1d-70e4-423c-82da-66582d59d880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:28.449162 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48835d1d-70e4-423c-82da-66582d59d880 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:28.485955 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1077/2164] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:28.487062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f923c-f2c0-49a4-b455-4d122b2368d8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:28.493724 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:28.502646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f923c-f2c0-49a4-b455-4d122b2368d8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:28.545020 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e115e-c887-4796-a717-9e0da8651ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:28.545954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e115e-c887-4796-a717-9e0da8651ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:28.546242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e115e-c887-4796-a717-9e0da8651ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:28.547430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e115e-c887-4796-a717-9e0da8651ac3 admin admin] PATH_INFO: `/v3/projects/a22b8c0b4a9343fd9cee92c8b80b4854/users/e18b096c8397402299387c5ad1b0fa4b/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:28.583991 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e115e-c887-4796-a717-9e0da8651ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22b8c0b4a9343fd9cee92c8b80b4854, user_id=e18b096c8397402299387c5ad1b0fa4b, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:28.590962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e115e-c887-4796-a717-9e0da8651ac3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:28.630100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48835d1d-70e4-423c-82da-66582d59d880 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:28.633332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1088/2165] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:28 2022] PUT /identity/v3/projects/a22b8c0b4a9343fd9cee92c8b80b4854/users/e18b096c8397402299387c5ad1b0fa4b/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:28.647901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48835d1d-70e4-423c-82da-66582d59d880 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:28.660813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:28.685804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72a60c-016b-463e-887f-b7f84a38ec8e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:28.686358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72a60c-016b-463e-887f-b7f84a38ec8e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:28.686821 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72a60c-016b-463e-887f-b7f84a38ec8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:28.739083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1f72a60c-016b-463e-887f-b7f84a38ec8e None None] MFA Rules not processed for user `eee03ed1e2144e5fa451a2f16da21bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:28.740416 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1f72a60c-016b-463e-887f-b7f84a38ec8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:28.778352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d0e51-6cc0-4300-9b56-c7c41773b05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:28.779337 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d0e51-6cc0-4300-9b56-c7c41773b05e admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:28.779702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d0e51-6cc0-4300-9b56-c7c41773b05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:28.780215 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d0e51-6cc0-4300-9b56-c7c41773b05e admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:28.781064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d0e51-6cc0-4300-9b56-c7c41773b05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:28.783936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d0e51-6cc0-4300-9b56-c7c41773b05e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:28.799746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1078/2166] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:28.806403 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d0e51-6cc0-4300-9b56-c7c41773b05e admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:28.817627 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d0e51-6cc0-4300-9b56-c7c41773b05e admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:28.823154 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f83696-7dcd-4e71-955a-f97d95c1897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:28.824221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f83696-7dcd-4e71-955a-f97d95c1897d admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:28.824582 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f83696-7dcd-4e71-955a-f97d95c1897d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:28.824801 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f83696-7dcd-4e71-955a-f97d95c1897d admin admin] PATH_INFO: `/v3/projects/a22b8c0b4a9343fd9cee92c8b80b4854/users/e18b096c8397402299387c5ad1b0fa4b/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:28.834763 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f83696-7dcd-4e71-955a-f97d95c1897d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22b8c0b4a9343fd9cee92c8b80b4854, user_id=e18b096c8397402299387c5ad1b0fa4b, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:28.837540 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f83696-7dcd-4e71-955a-f97d95c1897d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:28.849348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1079/2167] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:28 2022] PUT /identity/v3/projects/a22b8c0b4a9343fd9cee92c8b80b4854/users/e18b096c8397402299387c5ad1b0fa4b/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:28.858506 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1089/2168] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:28.873525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f83696-7dcd-4e71-955a-f97d95c1897d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:28.876156 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-39f83696-7dcd-4e71-955a-f97d95c1897d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:28.924916 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320da1ae-c5e5-4d68-8cdf-19c7b3b85b58 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:28.925218 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320da1ae-c5e5-4d68-8cdf-19c7b3b85b58 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:28.925506 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320da1ae-c5e5-4d68-8cdf-19c7b3b85b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:29.048066 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-320da1ae-c5e5-4d68-8cdf-19c7b3b85b58 None None] MFA Rules not processed for user `e18b096c8397402299387c5ad1b0fa4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:29.049354 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-320da1ae-c5e5-4d68-8cdf-19c7b3b85b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:29.057349 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f83696-7dcd-4e71-955a-f97d95c1897d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:29.061168 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bee71e-b70f-4ac7-b35c-3dad42526109 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '623c97746d304c6ba971e79e4dbeb730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:29.061814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee71e-b70f-4ac7-b35c-3dad42526109 service glance] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:29.062098 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee71e-b70f-4ac7-b35c-3dad42526109 service glance] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:29.062374 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee71e-b70f-4ac7-b35c-3dad42526109 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:29.065018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-15bee71e-b70f-4ac7-b35c-3dad42526109 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:29.151082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1090/2169] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:20:29.151345 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bee71e-b70f-4ac7-b35c-3dad42526109 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:29.158805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bee71e-b70f-4ac7-b35c-3dad42526109 service glance] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:29.170775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320da1ae-c5e5-4d68-8cdf-19c7b3b85b58 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:29.173715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-320da1ae-c5e5-4d68-8cdf-19c7b3b85b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:29.178589 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1080/2170] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:29.393256 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:29.420287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320da1ae-c5e5-4d68-8cdf-19c7b3b85b58 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:29.445113 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c197d-8288-41d8-9dcd-f5d6d0cea83a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:29.446078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c197d-8288-41d8-9dcd-f5d6d0cea83a service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:29.446371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c197d-8288-41d8-9dcd-f5d6d0cea83a service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:29.446645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c197d-8288-41d8-9dcd-f5d6d0cea83a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:29.521168 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058c818-cabc-4089-ad2b-060e97829fd9 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:29.534328 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058c818-cabc-4089-ad2b-060e97829fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:29.534481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058c818-cabc-4089-ad2b-060e97829fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:29.565968 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-9058c818-cabc-4089-ad2b-060e97829fd9 None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:29.567172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9058c818-cabc-4089-ad2b-060e97829fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:29.613179 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c197d-8288-41d8-9dcd-f5d6d0cea83a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:29.614725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c197d-8288-41d8-9dcd-f5d6d0cea83a service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:29.627762 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:29.644684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1091/2171] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:20:29.674618 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1081/2172] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 25 16:20:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:20:29.772394 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c197d-8288-41d8-9dcd-f5d6d0cea83a service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:29.780835 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ac3c197d-8288-41d8-9dcd-f5d6d0cea83a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:29.901205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c197d-8288-41d8-9dcd-f5d6d0cea83a service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:29.907625 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e5702-4e64-43d8-afdc-7c5b76f7536e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:29.908541 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e5702-4e64-43d8-afdc-7c5b76f7536e service swift] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:29.909020 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e5702-4e64-43d8-afdc-7c5b76f7536e service swift] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:29.909412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e5702-4e64-43d8-afdc-7c5b76f7536e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:29.922711 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e5702-4e64-43d8-afdc-7c5b76f7536e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:29.924616 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e5702-4e64-43d8-afdc-7c5b76f7536e service swift] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:29.939544 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1092/2173] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:20:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 16:20:32.617932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88944e-5666-4c32-b137-d00e69cc4f72 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:32.618520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88944e-5666-4c32-b137-d00e69cc4f72 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:32.618520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88944e-5666-4c32-b137-d00e69cc4f72 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:32.621640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1082/2174] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 25 16:20:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:20:32.692564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005d09e-d8d3-497c-8962-5a466e79b90c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:32.693193 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005d09e-d8d3-497c-8962-5a466e79b90c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:32.693193 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005d09e-d8d3-497c-8962-5a466e79b90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:32.711283 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88944e-5666-4c32-b137-d00e69cc4f72 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:32.754978 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f005d09e-d8d3-497c-8962-5a466e79b90c None None] MFA Rules not processed for user `ba3474e40117440498f0fe99f743df50`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:32.754978 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f005d09e-d8d3-497c-8962-5a466e79b90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:32.860549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88944e-5666-4c32-b137-d00e69cc4f72 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:32.873105 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0eac3e-57d1-4c1e-9cee-68b20d745750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:32.874356 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eac3e-57d1-4c1e-9cee-68b20d745750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:32.874764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eac3e-57d1-4c1e-9cee-68b20d745750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:32.875146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eac3e-57d1-4c1e-9cee-68b20d745750 admin admin] PATH_INFO: `/v3/users/6d7d2140ee124446b7184f4fb0d5eee3` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:32.876994 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0eac3e-57d1-4c1e-9cee-68b20d745750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7d2140ee124446b7184f4fb0d5eee3)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:32.879118 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0eac3e-57d1-4c1e-9cee-68b20d745750 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:32.926318 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1093/2175] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 25 16:20:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:32.927261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005d09e-d8d3-497c-8962-5a466e79b90c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:32.928779 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f005d09e-d8d3-497c-8962-5a466e79b90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:32.953224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005d09e-d8d3-497c-8962-5a466e79b90c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:32.969049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291eafbe-1ddf-4c3e-9a24-599b890539f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:32.970049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eafbe-1ddf-4c3e-9a24-599b890539f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:32.976088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eafbe-1ddf-4c3e-9a24-599b890539f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:32.977154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eafbe-1ddf-4c3e-9a24-599b890539f8 admin admin] PATH_INFO: `/v3/users/139716cccc014f2398791641de0d414c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:32.979074 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ca0eac3e-57d1-4c1e-9cee-68b20d745750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7d2140ee124446b7184f4fb0d5eee3'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:32.979247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291eafbe-1ddf-4c3e-9a24-599b890539f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139716cccc014f2398791641de0d414c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:32.981752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291eafbe-1ddf-4c3e-9a24-599b890539f8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:32.988038 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ca0eac3e-57d1-4c1e-9cee-68b20d745750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7d2140ee124446b7184f4fb0d5eee3'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:32.989061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ca0eac3e-57d1-4c1e-9cee-68b20d745750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7d2140ee124446b7184f4fb0d5eee3'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:32.989789 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ca0eac3e-57d1-4c1e-9cee-68b20d745750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7d2140ee124446b7184f4fb0d5eee3'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:33.014044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ca0eac3e-57d1-4c1e-9cee-68b20d745750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7d2140ee124446b7184f4fb0d5eee3'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:33.032094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1083/2176] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:32 2022] DELETE /identity/v3/users/6d7d2140ee124446b7184f4fb0d5eee3 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:33.036240 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:33.040500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0eac3e-57d1-4c1e-9cee-68b20d745750 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:33.045356 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ca0eac3e-57d1-4c1e-9cee-68b20d745750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:33.080347 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-291eafbe-1ddf-4c3e-9a24-599b890539f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139716cccc014f2398791641de0d414c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:33.080954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-291eafbe-1ddf-4c3e-9a24-599b890539f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139716cccc014f2398791641de0d414c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:33.081964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-291eafbe-1ddf-4c3e-9a24-599b890539f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139716cccc014f2398791641de0d414c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:33.100578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-291eafbe-1ddf-4c3e-9a24-599b890539f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139716cccc014f2398791641de0d414c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:33.113191 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-291eafbe-1ddf-4c3e-9a24-599b890539f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139716cccc014f2398791641de0d414c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:33.145291 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:33.151594 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1094/2177] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:32 2022] DELETE /identity/v3/users/139716cccc014f2398791641de0d414c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:33.155894 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751bc26-b13a-443f-a361-9cbba32a3300 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:33.156191 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751bc26-b13a-443f-a361-9cbba32a3300 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:33.157133 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751bc26-b13a-443f-a361-9cbba32a3300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:33.183316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0eac3e-57d1-4c1e-9cee-68b20d745750 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:33.186492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e751bc26-b13a-443f-a361-9cbba32a3300 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:33.199369 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e751bc26-b13a-443f-a361-9cbba32a3300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:33.300743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d827b5-cd25-48e0-ad53-ca70a4bd02cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3474e40117440498f0fe99f743df50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:33.301990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d827b5-cd25-48e0-ad53-ca70a4bd02cc service placement] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:33.302500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d827b5-cd25-48e0-ad53-ca70a4bd02cc service placement] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:33.302870 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d827b5-cd25-48e0-ad53-ca70a4bd02cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:33.306744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d4d827b5-cd25-48e0-ad53-ca70a4bd02cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:33.323367 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d827b5-cd25-48e0-ad53-ca70a4bd02cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:33.327369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d827b5-cd25-48e0-ad53-ca70a4bd02cc service placement] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:33.343943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1084/2178] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:33.344983 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d827b5-cd25-48e0-ad53-ca70a4bd02cc service placement] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:33.348706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d4d827b5-cd25-48e0-ad53-ca70a4bd02cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:33.359821 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1095/2179] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:33.368735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d827b5-cd25-48e0-ad53-ca70a4bd02cc service placement] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:33.374001 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62beab5e-de69-4f29-b9b7-ec71df6d583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:33.374996 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beab5e-de69-4f29-b9b7-ec71df6d583e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:33.375373 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beab5e-de69-4f29-b9b7-ec71df6d583e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:33.375743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62beab5e-de69-4f29-b9b7-ec71df6d583e admin admin] PATH_INFO: `/v3/users/84ed12c28c1f4ef09204037223f9a5bb` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:33.377777 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62beab5e-de69-4f29-b9b7-ec71df6d583e admin admin] RBAC: Authorizing `identity:delete_user(user_id=84ed12c28c1f4ef09204037223f9a5bb)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:33.379981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62beab5e-de69-4f29-b9b7-ec71df6d583e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:33.386882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751bc26-b13a-443f-a361-9cbba32a3300 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:33.388506 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e751bc26-b13a-443f-a361-9cbba32a3300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:33.471458 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-62beab5e-de69-4f29-b9b7-ec71df6d583e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ed12c28c1f4ef09204037223f9a5bb'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:33.491126 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-62beab5e-de69-4f29-b9b7-ec71df6d583e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ed12c28c1f4ef09204037223f9a5bb'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:33.495698 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-62beab5e-de69-4f29-b9b7-ec71df6d583e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ed12c28c1f4ef09204037223f9a5bb'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:33.501919 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-62beab5e-de69-4f29-b9b7-ec71df6d583e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ed12c28c1f4ef09204037223f9a5bb'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:33.551157 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751bc26-b13a-443f-a361-9cbba32a3300 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:33.561539 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36314eb-798e-48f3-8226-2d61aec82ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:33.562218 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36314eb-798e-48f3-8226-2d61aec82ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:33.562507 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36314eb-798e-48f3-8226-2d61aec82ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:33.562788 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36314eb-798e-48f3-8226-2d61aec82ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:33.565879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-62beab5e-de69-4f29-b9b7-ec71df6d583e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ed12c28c1f4ef09204037223f9a5bb'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:33.567495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f36314eb-798e-48f3-8226-2d61aec82ce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:33.622322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36314eb-798e-48f3-8226-2d61aec82ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:33.622322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36314eb-798e-48f3-8226-2d61aec82ce6 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:33.623649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1085/2180] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:33 2022] DELETE /identity/v3/users/84ed12c28c1f4ef09204037223f9a5bb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:33.623649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b52c4-8cec-4e3f-ba5b-f827121d3353 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:33.623649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b52c4-8cec-4e3f-ba5b-f827121d3353 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:33.623649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b52c4-8cec-4e3f-ba5b-f827121d3353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:33.638231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1096/2181] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:20:33.674529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-1c8b52c4-8cec-4e3f-ba5b-f827121d3353 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:33.675836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1c8b52c4-8cec-4e3f-ba5b-f827121d3353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:33.799674 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36314eb-798e-48f3-8226-2d61aec82ce6 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:33.801212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f36314eb-798e-48f3-8226-2d61aec82ce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:33.810507 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:33.823759 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36314eb-798e-48f3-8226-2d61aec82ce6 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:33.830651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb295631-a669-471b-8ed9-d34790c8bab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:33.832433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1086/2182] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:33.832704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb295631-a669-471b-8ed9-d34790c8bab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:33.833310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb295631-a669-471b-8ed9-d34790c8bab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:33.833805 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb295631-a669-471b-8ed9-d34790c8bab9 admin admin] PATH_INFO: `/v3/projects/c349fe56f64e4377ae674b60d36afc91` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:33.835407 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb295631-a669-471b-8ed9-d34790c8bab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c349fe56f64e4377ae674b60d36afc91)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:33.839538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb295631-a669-471b-8ed9-d34790c8bab9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:33.849332 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b52c4-8cec-4e3f-ba5b-f827121d3353 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:33.853457 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1c8b52c4-8cec-4e3f-ba5b-f827121d3353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:33.965065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:33.980580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fb295631-a669-471b-8ed9-d34790c8bab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c349fe56f64e4377ae674b60d36afc91', 'request_id': 'req-fb295631-a669-471b-8ed9-d34790c8bab9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:33.995842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fb295631-a669-471b-8ed9-d34790c8bab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c349fe56f64e4377ae674b60d36afc91', 'request_id': 'req-fb295631-a669-471b-8ed9-d34790c8bab9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:34.017818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fb295631-a669-471b-8ed9-d34790c8bab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c349fe56f64e4377ae674b60d36afc91', 'request_id': 'req-fb295631-a669-471b-8ed9-d34790c8bab9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:34.050976 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fb295631-a669-471b-8ed9-d34790c8bab9 admin admin] The token cache is being invalidate because project c349fe56f64e4377ae674b60d36afc91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:34.051238 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fb295631-a669-471b-8ed9-d34790c8bab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:34.052408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fb295631-a669-471b-8ed9-d34790c8bab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:34.058363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1097/2183] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:33 2022] DELETE /identity/v3/projects/c349fe56f64e4377ae674b60d36afc91 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:34.063043 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fe2ae-0318-4868-9595-7725c2a7f1d4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:34.063473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fe2ae-0318-4868-9595-7725c2a7f1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:34.063823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fe2ae-0318-4868-9595-7725c2a7f1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:34.092785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b52c4-8cec-4e3f-ba5b-f827121d3353 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:34.113794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-cc1fe2ae-0318-4868-9595-7725c2a7f1d4 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:34.120647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cc1fe2ae-0318-4868-9595-7725c2a7f1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:34.224088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1230f64-29dd-435f-8373-5ff0cd03098d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:34.224904 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1230f64-29dd-435f-8373-5ff0cd03098d service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:34.225320 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1230f64-29dd-435f-8373-5ff0cd03098d service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:34.228905 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1230f64-29dd-435f-8373-5ff0cd03098d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:34.234815 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c1230f64-29dd-435f-8373-5ff0cd03098d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:34.297240 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1098/2184] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:20:34.306509 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0a4d1-6a02-42c1-a434-dde68690db3f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:34.307506 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0a4d1-6a02-42c1-a434-dde68690db3f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:34.307927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0a4d1-6a02-42c1-a434-dde68690db3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:34.358289 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1fd0a4d1-6a02-42c1-a434-dde68690db3f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:34.359712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1fd0a4d1-6a02-42c1-a434-dde68690db3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:34.375345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1099/2185] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:20:34.375345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0a4d1-6a02-42c1-a434-dde68690db3f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:34.378100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1fd0a4d1-6a02-42c1-a434-dde68690db3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:34.391942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0a4d1-6a02-42c1-a434-dde68690db3f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:34.407956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:34.409193 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:34.409632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:34.410016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69 admin admin] PATH_INFO: `/v3/projects/1b9cde0738624ecfa304ec26446d78bc` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:34.412950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b9cde0738624ecfa304ec26446d78bc)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:34.418820 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:34.440218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1230f64-29dd-435f-8373-5ff0cd03098d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:34.443624 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1230f64-29dd-435f-8373-5ff0cd03098d service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:34.477035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1087/2186] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:34.478721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1230f64-29dd-435f-8373-5ff0cd03098d service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:34.504329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1230f64-29dd-435f-8373-5ff0cd03098d service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:34.532708 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b9cde0738624ecfa304ec26446d78bc', 'request_id': 'req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:34.544918 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b9cde0738624ecfa304ec26446d78bc', 'request_id': 'req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:34.561782 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b9cde0738624ecfa304ec26446d78bc', 'request_id': 'req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:34.587191 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69 admin admin] The token cache is being invalidate because project 1b9cde0738624ecfa304ec26446d78bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:34.588202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:34.590408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:34.593017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1100/2187] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:34 2022] DELETE /identity/v3/projects/1b9cde0738624ecfa304ec26446d78bc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:34.606481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:34.613528 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:34.623394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca8d16-4b04-4768-96b3-aa37f89c8e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:34.624974 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca8d16-4b04-4768-96b3-aa37f89c8e8f admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:34.625553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca8d16-4b04-4768-96b3-aa37f89c8e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:34.625553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca8d16-4b04-4768-96b3-aa37f89c8e8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:34.626669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca8d16-4b04-4768-96b3-aa37f89c8e8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:20:34.627097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca8d16-4b04-4768-96b3-aa37f89c8e8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:34.630375 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca8d16-4b04-4768-96b3-aa37f89c8e8f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:34.632433 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9a8f5-fc37-4d98-95ff-632dbd8dde69 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:34.637593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba7b4d-bc31-4371-8930-1888d16a913c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:34.638577 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba7b4d-bc31-4371-8930-1888d16a913c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:34.638928 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba7b4d-bc31-4371-8930-1888d16a913c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:34.639298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba7b4d-bc31-4371-8930-1888d16a913c admin admin] PATH_INFO: `/v3/users/e18b096c8397402299387c5ad1b0fa4b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:34.640657 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba7b4d-bc31-4371-8930-1888d16a913c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e18b096c8397402299387c5ad1b0fa4b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:34.642719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba7b4d-bc31-4371-8930-1888d16a913c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:34.644643 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:34.659433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1088/2188] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:20:34.665355 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca8d16-4b04-4768-96b3-aa37f89c8e8f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:34.667453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-94ca8d16-4b04-4768-96b3-aa37f89c8e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:34.682086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca8d16-4b04-4768-96b3-aa37f89c8e8f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:34.700429 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac9f64-814c-4639-99b8-8c386ff43744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:34.701119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac9f64-814c-4639-99b8-8c386ff43744 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:34.701696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac9f64-814c-4639-99b8-8c386ff43744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:34.701977 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac9f64-814c-4639-99b8-8c386ff43744 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:34.703527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac9f64-814c-4639-99b8-8c386ff43744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:34.706417 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac9f64-814c-4639-99b8-8c386ff43744 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:34.720115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:34.731545 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-25ba7b4d-bc31-4371-8930-1888d16a913c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e18b096c8397402299387c5ad1b0fa4b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:34.732404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-25ba7b4d-bc31-4371-8930-1888d16a913c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e18b096c8397402299387c5ad1b0fa4b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:34.733178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-25ba7b4d-bc31-4371-8930-1888d16a913c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e18b096c8397402299387c5ad1b0fa4b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:34.746458 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-25ba7b4d-bc31-4371-8930-1888d16a913c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e18b096c8397402299387c5ad1b0fa4b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:34.770577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1089/2189] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:34 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:34.773433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac9f64-814c-4639-99b8-8c386ff43744 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:34.774564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-25ba7b4d-bc31-4371-8930-1888d16a913c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e18b096c8397402299387c5ad1b0fa4b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:34.775986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-87ac9f64-814c-4639-99b8-8c386ff43744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:34.806089 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1101/2190] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:34 2022] DELETE /identity/v3/users/e18b096c8397402299387c5ad1b0fa4b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:34.950276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac9f64-814c-4639-99b8-8c386ff43744 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:35.054555 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11857b5b-beab-45d9-bd70-a1ccb904a9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:35.055573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11857b5b-beab-45d9-bd70-a1ccb904a9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:35.055883 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11857b5b-beab-45d9-bd70-a1ccb904a9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:35.056297 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11857b5b-beab-45d9-bd70-a1ccb904a9e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:35.057064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11857b5b-beab-45d9-bd70-a1ccb904a9e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:35.059203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11857b5b-beab-45d9-bd70-a1ccb904a9e1 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:35.101936 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba7b4d-bc31-4371-8930-1888d16a913c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:35.102142 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1090/2191] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:34 2022] POST /identity/v3/users => generated 292 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:35.102247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-25ba7b4d-bc31-4371-8930-1888d16a913c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:35.103353 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11857b5b-beab-45d9-bd70-a1ccb904a9e1 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:35.115572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11857b5b-beab-45d9-bd70-a1ccb904a9e1 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:35.122876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7621f-6476-4b7c-b8db-8be55ad01fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:35.123809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7621f-6476-4b7c-b8db-8be55ad01fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:35.124194 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7621f-6476-4b7c-b8db-8be55ad01fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:35.124637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7621f-6476-4b7c-b8db-8be55ad01fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:35.125583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7621f-6476-4b7c-b8db-8be55ad01fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:35.127932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7621f-6476-4b7c-b8db-8be55ad01fe4 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:35.146247 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1091/2192] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:35.147264 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba7b4d-bc31-4371-8930-1888d16a913c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:35.148035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7621f-6476-4b7c-b8db-8be55ad01fe4 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:35.158647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea638d51-8147-48e0-b7bc-da001a6701b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:35.159802 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea638d51-8147-48e0-b7bc-da001a6701b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:35.159802 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea638d51-8147-48e0-b7bc-da001a6701b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:35.160916 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea638d51-8147-48e0-b7bc-da001a6701b5 admin admin] PATH_INFO: `/v3/projects/68be44517dc348229448e88499a0d0c7` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:35.161410 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea638d51-8147-48e0-b7bc-da001a6701b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68be44517dc348229448e88499a0d0c7)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:35.164485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea638d51-8147-48e0-b7bc-da001a6701b5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:35.202066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7621f-6476-4b7c-b8db-8be55ad01fe4 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:35.217286 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab11df-9c1b-4c05-a5f0-71b414dc65ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:35.218079 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab11df-9c1b-4c05-a5f0-71b414dc65ae admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:35.218456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab11df-9c1b-4c05-a5f0-71b414dc65ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:35.218904 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab11df-9c1b-4c05-a5f0-71b414dc65ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:35.220764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab11df-9c1b-4c05-a5f0-71b414dc65ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:35.232832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab11df-9c1b-4c05-a5f0-71b414dc65ae admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:35.240518 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1092/2193] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:35.248145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab11df-9c1b-4c05-a5f0-71b414dc65ae admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:35.287690 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab11df-9c1b-4c05-a5f0-71b414dc65ae admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:35.330903 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ea638d51-8147-48e0-b7bc-da001a6701b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68be44517dc348229448e88499a0d0c7', 'request_id': 'req-ea638d51-8147-48e0-b7bc-da001a6701b5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:35.357443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ea638d51-8147-48e0-b7bc-da001a6701b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68be44517dc348229448e88499a0d0c7', 'request_id': 'req-ea638d51-8147-48e0-b7bc-da001a6701b5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:35.372374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ea638d51-8147-48e0-b7bc-da001a6701b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68be44517dc348229448e88499a0d0c7', 'request_id': 'req-ea638d51-8147-48e0-b7bc-da001a6701b5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:35.378875 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:35.392950 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77970537-5b68-4fec-9b99-9335c13b6e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:35.395258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77970537-5b68-4fec-9b99-9335c13b6e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:35.395555 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77970537-5b68-4fec-9b99-9335c13b6e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:35.395899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77970537-5b68-4fec-9b99-9335c13b6e7a admin admin] PATH_INFO: `/v3/projects/7246e06afcd841b9a0805cf0d61e2f39/users/10c3b4f5766449c19198efc35dc80429/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:35.400778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ea638d51-8147-48e0-b7bc-da001a6701b5 admin admin] The token cache is being invalidate because project 68be44517dc348229448e88499a0d0c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:35.401110 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ea638d51-8147-48e0-b7bc-da001a6701b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:35.406980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ea638d51-8147-48e0-b7bc-da001a6701b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:35.416449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1102/2194] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:35 2022] DELETE /identity/v3/projects/68be44517dc348229448e88499a0d0c7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:35.419688 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a3523-95b9-487d-a156-c19efb40df9e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:35.419898 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a3523-95b9-487d-a156-c19efb40df9e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:35.420182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a3523-95b9-487d-a156-c19efb40df9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:35.440444 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77970537-5b68-4fec-9b99-9335c13b6e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7246e06afcd841b9a0805cf0d61e2f39, user_id=10c3b4f5766449c19198efc35dc80429, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:35.443212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77970537-5b68-4fec-9b99-9335c13b6e7a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:35.473731 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-be4a3523-95b9-487d-a156-c19efb40df9e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:35.475163 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-be4a3523-95b9-487d-a156-c19efb40df9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:35.488917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1093/2195] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:35 2022] PUT /identity/v3/projects/7246e06afcd841b9a0805cf0d61e2f39/users/10c3b4f5766449c19198efc35dc80429/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:35.495174 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60013dda-2138-4f30-877e-4f110a72d589 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:35.495174 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60013dda-2138-4f30-877e-4f110a72d589 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:35.495912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60013dda-2138-4f30-877e-4f110a72d589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:35.535315 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-60013dda-2138-4f30-877e-4f110a72d589 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:35.536919 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-60013dda-2138-4f30-877e-4f110a72d589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:35.596947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1103/2196] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:35.606794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eee8e4-e96f-4009-aade-d2b5f46a0e3d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:35.607266 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eee8e4-e96f-4009-aade-d2b5f46a0e3d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:35.607543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eee8e4-e96f-4009-aade-d2b5f46a0e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:35.631974 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-91eee8e4-e96f-4009-aade-d2b5f46a0e3d None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:35.633641 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-91eee8e4-e96f-4009-aade-d2b5f46a0e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:35.646154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1104/2197] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:35.650308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1094/2198] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:35.651084 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60013dda-2138-4f30-877e-4f110a72d589 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:35.662192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eee8e4-e96f-4009-aade-d2b5f46a0e3d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:35.664653 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60013dda-2138-4f30-877e-4f110a72d589 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:35.665451 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-91eee8e4-e96f-4009-aade-d2b5f46a0e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:35.674654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a601a-6d23-42ae-bb12-c8d8b39ec5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:35.675847 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a601a-6d23-42ae-bb12-c8d8b39ec5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:35.676341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a601a-6d23-42ae-bb12-c8d8b39ec5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:35.677338 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a601a-6d23-42ae-bb12-c8d8b39ec5b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:35.678252 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a601a-6d23-42ae-bb12-c8d8b39ec5b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:20:35.678729 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a601a-6d23-42ae-bb12-c8d8b39ec5b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:35.689787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a601a-6d23-42ae-bb12-c8d8b39ec5b7 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:35.727164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1095/2199] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:20:35.729189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a601a-6d23-42ae-bb12-c8d8b39ec5b7 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:35.741826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:35.760657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a601a-6d23-42ae-bb12-c8d8b39ec5b7 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:35.771451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075fcbd-625d-44a5-a02b-5915579a76c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:35.772166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075fcbd-625d-44a5-a02b-5915579a76c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:35.772541 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075fcbd-625d-44a5-a02b-5915579a76c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:35.772883 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075fcbd-625d-44a5-a02b-5915579a76c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:35.773693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075fcbd-625d-44a5-a02b-5915579a76c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:35.775671 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075fcbd-625d-44a5-a02b-5915579a76c7 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:35.781263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eee8e4-e96f-4009-aade-d2b5f46a0e3d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:35.786635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd180a8-0b41-43c6-ac55-9c8d2dc0e720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:35.787241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd180a8-0b41-43c6-ac55-9c8d2dc0e720 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:35.787591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd180a8-0b41-43c6-ac55-9c8d2dc0e720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:35.787937 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd180a8-0b41-43c6-ac55-9c8d2dc0e720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:35.802980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd180a8-0b41-43c6-ac55-9c8d2dc0e720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:35.805702 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd180a8-0b41-43c6-ac55-9c8d2dc0e720 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:35.835933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1105/2200] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:35.838761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd180a8-0b41-43c6-ac55-9c8d2dc0e720 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:35.841671 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bcd180a8-0b41-43c6-ac55-9c8d2dc0e720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:35.867021 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd180a8-0b41-43c6-ac55-9c8d2dc0e720 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:35.884569 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3c501-72e1-4b0b-b947-a1f582e0c2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:35.885644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3c501-72e1-4b0b-b947-a1f582e0c2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:35.885999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3c501-72e1-4b0b-b947-a1f582e0c2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:35.886419 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3c501-72e1-4b0b-b947-a1f582e0c2e1 admin admin] PATH_INFO: `/v3/projects/a22b8c0b4a9343fd9cee92c8b80b4854` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:35.888599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3c501-72e1-4b0b-b947-a1f582e0c2e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22b8c0b4a9343fd9cee92c8b80b4854)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:35.893287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3c501-72e1-4b0b-b947-a1f582e0c2e1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:35.921246 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1096/2201] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:35 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:35.922516 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075fcbd-625d-44a5-a02b-5915579a76c7 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:36.024295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a2d3c501-72e1-4b0b-b947-a1f582e0c2e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22b8c0b4a9343fd9cee92c8b80b4854', 'request_id': 'req-a2d3c501-72e1-4b0b-b947-a1f582e0c2e1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:36.043179 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a2d3c501-72e1-4b0b-b947-a1f582e0c2e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22b8c0b4a9343fd9cee92c8b80b4854', 'request_id': 'req-a2d3c501-72e1-4b0b-b947-a1f582e0c2e1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:36.047659 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a2d3c501-72e1-4b0b-b947-a1f582e0c2e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22b8c0b4a9343fd9cee92c8b80b4854', 'request_id': 'req-a2d3c501-72e1-4b0b-b947-a1f582e0c2e1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:36.067306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075fcbd-625d-44a5-a02b-5915579a76c7 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:36.073669 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a2d3c501-72e1-4b0b-b947-a1f582e0c2e1 admin admin] The token cache is being invalidate because project a22b8c0b4a9343fd9cee92c8b80b4854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:36.074278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a2d3c501-72e1-4b0b-b947-a1f582e0c2e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:36.075198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a2d3c501-72e1-4b0b-b947-a1f582e0c2e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:36.078834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1106/2202] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:35 2022] DELETE /identity/v3/projects/a22b8c0b4a9343fd9cee92c8b80b4854 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:36.093086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae4c14-6ed8-4795-b24b-57bfbc054fea None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:36.093410 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae4c14-6ed8-4795-b24b-57bfbc054fea None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:36.093707 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae4c14-6ed8-4795-b24b-57bfbc054fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:36.126215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0cae4c14-6ed8-4795-b24b-57bfbc054fea None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:36.127508 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0cae4c14-6ed8-4795-b24b-57bfbc054fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:36.152680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:36.171704 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769df4ed-4d68-4f83-a43e-e00e83d2389d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:36.172420 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769df4ed-4d68-4f83-a43e-e00e83d2389d admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:36.172745 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769df4ed-4d68-4f83-a43e-e00e83d2389d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:36.173021 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769df4ed-4d68-4f83-a43e-e00e83d2389d admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:36.173711 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769df4ed-4d68-4f83-a43e-e00e83d2389d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:36.175687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769df4ed-4d68-4f83-a43e-e00e83d2389d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:36.212556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1107/2203] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:36.214600 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba00e8b-6383-4b6b-a436-6c177ee0cf4b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:36.214600 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba00e8b-6383-4b6b-a436-6c177ee0cf4b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:36.214896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba00e8b-6383-4b6b-a436-6c177ee0cf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:36.233561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1097/2204] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:35 2022] POST /identity/v3/users => generated 287 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:36.242337 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2ba00e8b-6383-4b6b-a436-6c177ee0cf4b None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:36.243584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2ba00e8b-6383-4b6b-a436-6c177ee0cf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:36.246881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769df4ed-4d68-4f83-a43e-e00e83d2389d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:36.249100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-769df4ed-4d68-4f83-a43e-e00e83d2389d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:36.254160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1108/2205] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:36.259753 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba00e8b-6383-4b6b-a436-6c177ee0cf4b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:36.279796 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769df4ed-4d68-4f83-a43e-e00e83d2389d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:36.281457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba00e8b-6383-4b6b-a436-6c177ee0cf4b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:36.287154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beb8c3-e93a-4dc2-b009-212f8b35b209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:36.288072 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb8c3-e93a-4dc2-b009-212f8b35b209 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:36.288382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb8c3-e93a-4dc2-b009-212f8b35b209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:36.288673 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb8c3-e93a-4dc2-b009-212f8b35b209 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:36.290519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beb8c3-e93a-4dc2-b009-212f8b35b209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:20:36.290826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beb8c3-e93a-4dc2-b009-212f8b35b209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:36.292530 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beb8c3-e93a-4dc2-b009-212f8b35b209 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:36.294928 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa8601-9c1d-4a2f-a403-58bac400929a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:36.298077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa8601-9c1d-4a2f-a403-58bac400929a admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:36.298369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa8601-9c1d-4a2f-a403-58bac400929a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:36.298646 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa8601-9c1d-4a2f-a403-58bac400929a admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:36.299418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa8601-9c1d-4a2f-a403-58bac400929a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:36.301869 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa8601-9c1d-4a2f-a403-58bac400929a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:36.307097 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1109/2206] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:20:36.311394 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beb8c3-e93a-4dc2-b009-212f8b35b209 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:36.323601 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beb8c3-e93a-4dc2-b009-212f8b35b209 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:36.331581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297deada-4894-4b24-915a-5104c1ef1271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:36.332439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297deada-4894-4b24-915a-5104c1ef1271 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:36.332856 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297deada-4894-4b24-915a-5104c1ef1271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:36.333641 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297deada-4894-4b24-915a-5104c1ef1271 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:36.337218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1098/2207] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:36.337473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297deada-4894-4b24-915a-5104c1ef1271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:36.338582 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297deada-4894-4b24-915a-5104c1ef1271 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:36.339993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa8601-9c1d-4a2f-a403-58bac400929a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:36.372300 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa8601-9c1d-4a2f-a403-58bac400929a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:36.384215 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ce6cb-66fc-472e-9fee-006d20381483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:36.385602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ce6cb-66fc-472e-9fee-006d20381483 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:36.387342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ce6cb-66fc-472e-9fee-006d20381483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:36.387342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ce6cb-66fc-472e-9fee-006d20381483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:36.390012 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ce6cb-66fc-472e-9fee-006d20381483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:36.392855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ce6cb-66fc-472e-9fee-006d20381483 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:36.396383 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1110/2208] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:36 2022] POST /identity/v3/projects => generated 395 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:36.402840 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297deada-4894-4b24-915a-5104c1ef1271 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:36.430602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1099/2209] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:36.432463 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ce6cb-66fc-472e-9fee-006d20381483 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:36.449730 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:36.472145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ce6cb-66fc-472e-9fee-006d20381483 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:36.585495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297deada-4894-4b24-915a-5104c1ef1271 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:36.599092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010cea1-a45f-4d27-925a-4a326489ad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:36.599764 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010cea1-a45f-4d27-925a-4a326489ad61 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:36.600167 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010cea1-a45f-4d27-925a-4a326489ad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:36.601014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010cea1-a45f-4d27-925a-4a326489ad61 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:36.601239 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010cea1-a45f-4d27-925a-4a326489ad61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:36.603713 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010cea1-a45f-4d27-925a-4a326489ad61 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:36.649417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1111/2210] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:36 2022] POST /identity/v3/users => generated 298 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:36.650975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69e008-d2b9-4c97-a16f-040a2fdada7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:36.651882 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69e008-d2b9-4c97-a16f-040a2fdada7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:36.652154 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69e008-d2b9-4c97-a16f-040a2fdada7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:36.652463 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69e008-d2b9-4c97-a16f-040a2fdada7d admin admin] PATH_INFO: `/v3/projects/da8d69531b814363bf338262397fc5e9/users/1f570f01d2cf4ec782fd28ffdbad8a0d/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:36.654067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010cea1-a45f-4d27-925a-4a326489ad61 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:36.678666 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010cea1-a45f-4d27-925a-4a326489ad61 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:36.689132 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d501fa5-b124-4785-9a2e-c9ce1e3dcc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:36.690698 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69e008-d2b9-4c97-a16f-040a2fdada7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8d69531b814363bf338262397fc5e9, user_id=1f570f01d2cf4ec782fd28ffdbad8a0d, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:36.692761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d501fa5-b124-4785-9a2e-c9ce1e3dcc81 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:36.693048 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d501fa5-b124-4785-9a2e-c9ce1e3dcc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:36.693386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d501fa5-b124-4785-9a2e-c9ce1e3dcc81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:36.694141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d501fa5-b124-4785-9a2e-c9ce1e3dcc81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:36.695802 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d501fa5-b124-4785-9a2e-c9ce1e3dcc81 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:36.697849 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69e008-d2b9-4c97-a16f-040a2fdada7d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:36.722718 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1112/2211] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:36.724056 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d501fa5-b124-4785-9a2e-c9ce1e3dcc81 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:36.731698 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1100/2212] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:36 2022] PUT /identity/v3/projects/da8d69531b814363bf338262397fc5e9/users/1f570f01d2cf4ec782fd28ffdbad8a0d/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:36.733701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276366c-0621-4822-baff-945a1e8a0eeb None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:36.734611 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276366c-0621-4822-baff-945a1e8a0eeb None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:36.734611 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276366c-0621-4822-baff-945a1e8a0eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:36.757662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d501fa5-b124-4785-9a2e-c9ce1e3dcc81 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:36.765570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-1276366c-0621-4822-baff-945a1e8a0eeb None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:36.769623 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1276366c-0621-4822-baff-945a1e8a0eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:36.856472 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178eb81-cd7a-4266-a26a-080a502ff405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:36.857574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178eb81-cd7a-4266-a26a-080a502ff405 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:36.857869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178eb81-cd7a-4266-a26a-080a502ff405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:36.858150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178eb81-cd7a-4266-a26a-080a502ff405 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:36.859501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178eb81-cd7a-4266-a26a-080a502ff405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:36.861986 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178eb81-cd7a-4266-a26a-080a502ff405 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:36.889646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1113/2213] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:36.892483 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178eb81-cd7a-4266-a26a-080a502ff405 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:36.926915 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1101/2214] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:36.937771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178eb81-cd7a-4266-a26a-080a502ff405 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:36.939675 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276366c-0621-4822-baff-945a1e8a0eeb None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:36.942628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1276366c-0621-4822-baff-945a1e8a0eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:36.947150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff6ba2-0ba3-4088-a61b-41d29a7cdadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:36.961471 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff6ba2-0ba3-4088-a61b-41d29a7cdadb admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:36.962071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff6ba2-0ba3-4088-a61b-41d29a7cdadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:36.962198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff6ba2-0ba3-4088-a61b-41d29a7cdadb admin admin] PATH_INFO: `/v3/projects/7458a1b461d54c20b2aa33e9a2e05e80/users/73fd61deff7a491ab9bcc85c6fdbcf9d/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:37.014601 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff6ba2-0ba3-4088-a61b-41d29a7cdadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7458a1b461d54c20b2aa33e9a2e05e80, user_id=73fd61deff7a491ab9bcc85c6fdbcf9d, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:37.017400 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff6ba2-0ba3-4088-a61b-41d29a7cdadb admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:37.042794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1114/2215] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:36 2022] PUT /identity/v3/projects/7458a1b461d54c20b2aa33e9a2e05e80/users/73fd61deff7a491ab9bcc85c6fdbcf9d/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:37.052416 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:37.053606 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865bc6d-31d2-4f78-92d3-ab0216013540 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:37.053886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865bc6d-31d2-4f78-92d3-ab0216013540 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:37.054160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865bc6d-31d2-4f78-92d3-ab0216013540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:37.086961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276366c-0621-4822-baff-945a1e8a0eeb None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:37.115572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9865bc6d-31d2-4f78-92d3-ab0216013540 None None] MFA Rules not processed for user `73fd61deff7a491ab9bcc85c6fdbcf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:37.116881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9865bc6d-31d2-4f78-92d3-ab0216013540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:37.170874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ff57b-54a1-4225-899d-91d856bf2add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:37.172037 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ff57b-54a1-4225-899d-91d856bf2add service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:37.172037 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ff57b-54a1-4225-899d-91d856bf2add service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:37.172203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ff57b-54a1-4225-899d-91d856bf2add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:37.255558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:37.264033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1115/2216] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:37.278212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865bc6d-31d2-4f78-92d3-ab0216013540 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:37.280054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9865bc6d-31d2-4f78-92d3-ab0216013540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:37.354858 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ff57b-54a1-4225-899d-91d856bf2add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:37.357561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ff57b-54a1-4225-899d-91d856bf2add service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:37.386573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1102/2217] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:20:37.412340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865bc6d-31d2-4f78-92d3-ab0216013540 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:37.416870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81572ab-63b5-4833-ac5d-caa115ef8cc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:37.418361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81572ab-63b5-4833-ac5d-caa115ef8cc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:37.418904 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81572ab-63b5-4833-ac5d-caa115ef8cc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:37.419389 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81572ab-63b5-4833-ac5d-caa115ef8cc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:37.435018 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81572ab-63b5-4833-ac5d-caa115ef8cc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:37.447684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81572ab-63b5-4833-ac5d-caa115ef8cc1 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:37.464702 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1116/2218] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:20:41.035014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ff57b-54a1-4225-899d-91d856bf2add service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:41.037969 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-921ff57b-54a1-4225-899d-91d856bf2add service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:41.075405 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ff57b-54a1-4225-899d-91d856bf2add service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:41.097582 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b982be-2fce-4c6c-b6bd-c47e9b9f156d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:41.098166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b982be-2fce-4c6c-b6bd-c47e9b9f156d service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:41.098460 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b982be-2fce-4c6c-b6bd-c47e9b9f156d service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:41.098741 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b982be-2fce-4c6c-b6bd-c47e9b9f156d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:41.109925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c9b982be-2fce-4c6c-b6bd-c47e9b9f156d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:41.255692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b982be-2fce-4c6c-b6bd-c47e9b9f156d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:41.258260 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b982be-2fce-4c6c-b6bd-c47e9b9f156d service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:41.283955 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1103/2219] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:20:45.079454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3b2c0-3974-404b-9be1-0bc1fc8f6d8c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:45.081427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3b2c0-3974-404b-9be1-0bc1fc8f6d8c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:45.081882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3b2c0-3974-404b-9be1-0bc1fc8f6d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:45.136118 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a9e3b2c0-3974-404b-9be1-0bc1fc8f6d8c None None] MFA Rules not processed for user `10c3b4f5766449c19198efc35dc80429`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:45.139035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a9e3b2c0-3974-404b-9be1-0bc1fc8f6d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:45.242458 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b982be-2fce-4c6c-b6bd-c47e9b9f156d service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:45.256604 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b982be-2fce-4c6c-b6bd-c47e9b9f156d service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:45.269924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0f621-9c1f-4719-b9a4-2462cbe39c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:45.272628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0f621-9c1f-4719-b9a4-2462cbe39c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:45.276025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0f621-9c1f-4719-b9a4-2462cbe39c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:45.276822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0f621-9c1f-4719-b9a4-2462cbe39c80 admin admin] PATH_INFO: `/v3/users/73fd61deff7a491ab9bcc85c6fdbcf9d` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:45.278308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0f621-9c1f-4719-b9a4-2462cbe39c80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73fd61deff7a491ab9bcc85c6fdbcf9d)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:45.280583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0f621-9c1f-4719-b9a4-2462cbe39c80 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:45.362845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1117/2220] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:45.376550 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:45.379787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3b2c0-3974-404b-9be1-0bc1fc8f6d8c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:45.382127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a9e3b2c0-3974-404b-9be1-0bc1fc8f6d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:45.396498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-fce0f621-9c1f-4719-b9a4-2462cbe39c80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73fd61deff7a491ab9bcc85c6fdbcf9d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:45.433414 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-fce0f621-9c1f-4719-b9a4-2462cbe39c80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73fd61deff7a491ab9bcc85c6fdbcf9d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:45.434878 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-fce0f621-9c1f-4719-b9a4-2462cbe39c80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73fd61deff7a491ab9bcc85c6fdbcf9d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:45.439034 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-fce0f621-9c1f-4719-b9a4-2462cbe39c80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73fd61deff7a491ab9bcc85c6fdbcf9d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:45.498135 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-fce0f621-9c1f-4719-b9a4-2462cbe39c80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73fd61deff7a491ab9bcc85c6fdbcf9d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:45.533617 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1104/2221] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:20:45 2022] DELETE /identity/v3/users/73fd61deff7a491ab9bcc85c6fdbcf9d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:45.538188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d2bac-87af-48e4-baf0-cc1dddd3fe60 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:45.539802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d2bac-87af-48e4-baf0-cc1dddd3fe60 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:45.540467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d2bac-87af-48e4-baf0-cc1dddd3fe60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:45.624778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-252d2bac-87af-48e4-baf0-cc1dddd3fe60 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:45.629890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-252d2bac-87af-48e4-baf0-cc1dddd3fe60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:45.699186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3b2c0-3974-404b-9be1-0bc1fc8f6d8c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:45.805190 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:45.851584 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1105/2222] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:20:45.891767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b226129-cd92-4b6b-8546-0a7d35425256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:45.893062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b226129-cd92-4b6b-8546-0a7d35425256 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:45.893457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b226129-cd92-4b6b-8546-0a7d35425256 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:45.893842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b226129-cd92-4b6b-8546-0a7d35425256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:45.900239 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4b226129-cd92-4b6b-8546-0a7d35425256 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:45.901281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d2bac-87af-48e4-baf0-cc1dddd3fe60 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:45.902741 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-252d2bac-87af-48e4-baf0-cc1dddd3fe60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:45.994749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b226129-cd92-4b6b-8546-0a7d35425256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:45.996440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b226129-cd92-4b6b-8546-0a7d35425256 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:46.020674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d2bac-87af-48e4-baf0-cc1dddd3fe60 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:46.032171 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1118/2223] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:20:46.035590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b90da9-f772-4a09-bf5f-ecf497e5713a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:46.036065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b90da9-f772-4a09-bf5f-ecf497e5713a service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:46.037033 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b90da9-f772-4a09-bf5f-ecf497e5713a service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:46.037328 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b90da9-f772-4a09-bf5f-ecf497e5713a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:46.064649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b90da9-f772-4a09-bf5f-ecf497e5713a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:46.066139 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b90da9-f772-4a09-bf5f-ecf497e5713a service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:46.108151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1106/2224] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:20:47.009232 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f092d0-09af-4845-a045-ece4564db74d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:47.010129 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f092d0-09af-4845-a045-ece4564db74d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:47.010580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f092d0-09af-4845-a045-ece4564db74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:47.071128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-56f092d0-09af-4845-a045-ece4564db74d None None] MFA Rules not processed for user `1f570f01d2cf4ec782fd28ffdbad8a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:47.072535 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-56f092d0-09af-4845-a045-ece4564db74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:47.230834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1119/2225] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:47.237538 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b90da9-f772-4a09-bf5f-ecf497e5713a service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:47.239551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-15b90da9-f772-4a09-bf5f-ecf497e5713a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:47.261196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f092d0-09af-4845-a045-ece4564db74d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:47.262725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-56f092d0-09af-4845-a045-ece4564db74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:47.267096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b90da9-f772-4a09-bf5f-ecf497e5713a service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:47.279344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb56154-daa5-4ee9-8ae1-2cd291cea4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:47.280025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb56154-daa5-4ee9-8ae1-2cd291cea4ea admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:47.280490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb56154-daa5-4ee9-8ae1-2cd291cea4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:47.280643 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb56154-daa5-4ee9-8ae1-2cd291cea4ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:47.281323 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb56154-daa5-4ee9-8ae1-2cd291cea4ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:47.283520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb56154-daa5-4ee9-8ae1-2cd291cea4ea admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:47.285089 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f092d0-09af-4845-a045-ece4564db74d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:47.298252 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4954d-1712-42f2-aac4-54a07a8e1be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:47.299430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4954d-1712-42f2-aac4-54a07a8e1be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:47.299823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4954d-1712-42f2-aac4-54a07a8e1be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:47.300203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4954d-1712-42f2-aac4-54a07a8e1be4 admin admin] PATH_INFO: `/v3/projects/7458a1b461d54c20b2aa33e9a2e05e80` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:47.301700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4954d-1712-42f2-aac4-54a07a8e1be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7458a1b461d54c20b2aa33e9a2e05e80)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:47.306652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4954d-1712-42f2-aac4-54a07a8e1be4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:47.379764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1107/2226] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:20:47 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:47.380658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb56154-daa5-4ee9-8ae1-2cd291cea4ea admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:47.452108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a8f4954d-1712-42f2-aac4-54a07a8e1be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7458a1b461d54c20b2aa33e9a2e05e80', 'request_id': 'req-a8f4954d-1712-42f2-aac4-54a07a8e1be4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:47.454876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:47.463305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a8f4954d-1712-42f2-aac4-54a07a8e1be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7458a1b461d54c20b2aa33e9a2e05e80', 'request_id': 'req-a8f4954d-1712-42f2-aac4-54a07a8e1be4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:47.480202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:47.502372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a8f4954d-1712-42f2-aac4-54a07a8e1be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7458a1b461d54c20b2aa33e9a2e05e80', 'request_id': 'req-a8f4954d-1712-42f2-aac4-54a07a8e1be4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:47.530987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a8f4954d-1712-42f2-aac4-54a07a8e1be4 admin admin] The token cache is being invalidate because project 7458a1b461d54c20b2aa33e9a2e05e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:20:47.531886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a8f4954d-1712-42f2-aac4-54a07a8e1be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:47.534403 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a8f4954d-1712-42f2-aac4-54a07a8e1be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:20:47.542094 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1120/2227] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:20:47 2022] DELETE /identity/v3/projects/7458a1b461d54c20b2aa33e9a2e05e80 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:47.566747 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb56154-daa5-4ee9-8ae1-2cd291cea4ea admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:47.807088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963901a-a3ab-4c3e-8c1d-1481887209ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:47.807829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963901a-a3ab-4c3e-8c1d-1481887209ed admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:47.808117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963901a-a3ab-4c3e-8c1d-1481887209ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:47.808423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963901a-a3ab-4c3e-8c1d-1481887209ed admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:47.809127 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963901a-a3ab-4c3e-8c1d-1481887209ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:47.811537 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2963901a-a3ab-4c3e-8c1d-1481887209ed admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:47.897111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1108/2228] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:20:47 2022] POST /identity/v3/users => generated 292 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:20:47.901688 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4954d-1712-42f2-aac4-54a07a8e1be4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:47.903421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a8f4954d-1712-42f2-aac4-54a07a8e1be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:47.925205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4954d-1712-42f2-aac4-54a07a8e1be4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:47.948772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f7cba-515e-44b3-be1f-75203d649ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:47.949477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f7cba-515e-44b3-be1f-75203d649ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:47.950201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f7cba-515e-44b3-be1f-75203d649ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:47.950201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f7cba-515e-44b3-be1f-75203d649ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:47.952465 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f7cba-515e-44b3-be1f-75203d649ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:47.954114 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f7cba-515e-44b3-be1f-75203d649ed9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:48.011446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963901a-a3ab-4c3e-8c1d-1481887209ed admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:48.024532 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2963901a-a3ab-4c3e-8c1d-1481887209ed admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:48.027805 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1121/2229] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:48.070991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c2244-2b1f-427f-b494-10a10a15d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:48.070991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c2244-2b1f-427f-b494-10a10a15d948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:48.070991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c2244-2b1f-427f-b494-10a10a15d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:48.070991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c2244-2b1f-427f-b494-10a10a15d948 admin admin] PATH_INFO: `/v3/projects/c2911299b1e746fdb8395c18e134aa6d/users/e12395eba04842aba77235ea43b89c32/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:48.147528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c2244-2b1f-427f-b494-10a10a15d948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2911299b1e746fdb8395c18e134aa6d, user_id=e12395eba04842aba77235ea43b89c32, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:48.156998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c2244-2b1f-427f-b494-10a10a15d948 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:48.198519 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1109/2230] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:48 2022] PUT /identity/v3/projects/c2911299b1e746fdb8395c18e134aa6d/users/e12395eba04842aba77235ea43b89c32/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:48.199588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f7cba-515e-44b3-be1f-75203d649ed9 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:48.211345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f7cba-515e-44b3-be1f-75203d649ed9 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:48.423337 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb6a7d-3f66-4f87-ad1e-a8dfd2a64c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:48.424599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb6a7d-3f66-4f87-ad1e-a8dfd2a64c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:48.424889 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb6a7d-3f66-4f87-ad1e-a8dfd2a64c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:48.425167 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb6a7d-3f66-4f87-ad1e-a8dfd2a64c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:48.425918 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb6a7d-3f66-4f87-ad1e-a8dfd2a64c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:48.429216 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb6a7d-3f66-4f87-ad1e-a8dfd2a64c22 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:48.453997 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c2244-2b1f-427f-b494-10a10a15d948 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:48.456031 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1122/2231] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:20:48.481588 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c2244-2b1f-427f-b494-10a10a15d948 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:48.490864 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bed8b0-bb0d-4c96-8486-819199940af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:48.493252 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed8b0-bb0d-4c96-8486-819199940af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:48.494037 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed8b0-bb0d-4c96-8486-819199940af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:48.494731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed8b0-bb0d-4c96-8486-819199940af1 admin admin] PATH_INFO: `/v3/projects/c2911299b1e746fdb8395c18e134aa6d/users/e12395eba04842aba77235ea43b89c32/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:48.498878 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bed8b0-bb0d-4c96-8486-819199940af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2911299b1e746fdb8395c18e134aa6d, user_id=e12395eba04842aba77235ea43b89c32, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:48.508519 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bed8b0-bb0d-4c96-8486-819199940af1 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:48.525565 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1110/2232] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:20:48 2022] PUT /identity/v3/projects/c2911299b1e746fdb8395c18e134aa6d/users/e12395eba04842aba77235ea43b89c32/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:20:49.725526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264b3c8-e94f-4bd0-b766-a9ec0b6a677f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:49.725526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264b3c8-e94f-4bd0-b766-a9ec0b6a677f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:49.726039 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264b3c8-e94f-4bd0-b766-a9ec0b6a677f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:49.753787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6264b3c8-e94f-4bd0-b766-a9ec0b6a677f None None] MFA Rules not processed for user `10c3b4f5766449c19198efc35dc80429`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:49.755084 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6264b3c8-e94f-4bd0-b766-a9ec0b6a677f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:49.863187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1123/2233] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:55.414460 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7690c58-abaf-4613-87f1-1352376f5f8d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:55.415421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7690c58-abaf-4613-87f1-1352376f5f8d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:55.415906 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7690c58-abaf-4613-87f1-1352376f5f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:55.462842 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b7690c58-abaf-4613-87f1-1352376f5f8d None None] MFA Rules not processed for user `947b842f0b1e428286893d5f9353393a`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:55.464399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b7690c58-abaf-4613-87f1-1352376f5f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:55.575776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1111/2234] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:20:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:58.718775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764878fd-586b-47dc-97fa-3288aea05fcc None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:58.719379 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764878fd-586b-47dc-97fa-3288aea05fcc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:58.719622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764878fd-586b-47dc-97fa-3288aea05fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:58.748165 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-764878fd-586b-47dc-97fa-3288aea05fcc None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:20:58.749745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-764878fd-586b-47dc-97fa-3288aea05fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:58.841512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1124/2235] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 25 16:20:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:20:58.860841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7690c58-abaf-4613-87f1-1352376f5f8d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:20:58.862443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b7690c58-abaf-4613-87f1-1352376f5f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:20:58.945083 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:20:58.993161 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7690c58-abaf-4613-87f1-1352376f5f8d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:20:58.999788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585a6e6-f6a1-4cf1-9648-159549c935a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:20:59.000813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585a6e6-f6a1-4cf1-9648-159549c935a2 service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:20:59.001254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585a6e6-f6a1-4cf1-9648-159549c935a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:20:59.001692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585a6e6-f6a1-4cf1-9648-159549c935a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:20:59.014646 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585a6e6-f6a1-4cf1-9648-159549c935a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:20:59.016334 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585a6e6-f6a1-4cf1-9648-159549c935a2 service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:20:59.046090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1112/2236] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:20:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 16:21:01.305185 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d0225-15ac-442f-93ef-0a4bc8987680 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:01.306079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d0225-15ac-442f-93ef-0a4bc8987680 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:01.306533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d0225-15ac-442f-93ef-0a4bc8987680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:01.391849 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:01.409330 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a10d0225-15ac-442f-93ef-0a4bc8987680 None None] MFA Rules not processed for user `e12395eba04842aba77235ea43b89c32`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:21:01.411520 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a10d0225-15ac-442f-93ef-0a4bc8987680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:01.681273 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1125/2237] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:21:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:21:01.689150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585a6e6-f6a1-4cf1-9648-159549c935a2 service swift] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:01.690803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6585a6e6-f6a1-4cf1-9648-159549c935a2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:02.019491 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585a6e6-f6a1-4cf1-9648-159549c935a2 service swift] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:02.043727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5a288-d398-4320-b503-3dd50fac6c43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:02.045015 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5a288-d398-4320-b503-3dd50fac6c43 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:02.047195 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5a288-d398-4320-b503-3dd50fac6c43 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:02.047687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5a288-d398-4320-b503-3dd50fac6c43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:02.052471 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-abb5a288-d398-4320-b503-3dd50fac6c43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:02.362221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5a288-d398-4320-b503-3dd50fac6c43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:02.367163 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5a288-d398-4320-b503-3dd50fac6c43 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:02.396504 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1113/2238] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:21:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:21:04.594035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c005287-32c2-45ca-8679-c7fa29381339 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:04.594639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c005287-32c2-45ca-8679-c7fa29381339 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:04.594639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c005287-32c2-45ca-8679-c7fa29381339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:04.633504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2c005287-32c2-45ca-8679-c7fa29381339 None None] MFA Rules not processed for user `1f570f01d2cf4ec782fd28ffdbad8a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:21:04.634740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2c005287-32c2-45ca-8679-c7fa29381339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:04.670477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1126/2239] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:21:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:21:11.180147 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ca58c-06a9-460b-b19b-b7c305adec67 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:11.180820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ca58c-06a9-460b-b19b-b7c305adec67 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:11.180820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ca58c-06a9-460b-b19b-b7c305adec67 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:11.182189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1114/2240] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 25 16:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 16:21:11.196035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20ffb7-bc03-4e70-8804-9c23ad7fa0f9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:11.196623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20ffb7-bc03-4e70-8804-9c23ad7fa0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:11.196623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20ffb7-bc03-4e70-8804-9c23ad7fa0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:11.221742 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-eb20ffb7-bc03-4e70-8804-9c23ad7fa0f9 None None] MFA Rules not processed for user `ba3474e40117440498f0fe99f743df50`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:21:11.223098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-eb20ffb7-bc03-4e70-8804-9c23ad7fa0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:11.300152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1127/2241] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 25 16:21:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:21:11.313648 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ca58c-06a9-460b-b19b-b7c305adec67 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:11.315477 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0c2ca58c-06a9-460b-b19b-b7c305adec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:11.335591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ca58c-06a9-460b-b19b-b7c305adec67 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:11.341050 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79d178-443b-40ec-8955-27bf1cc779dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3474e40117440498f0fe99f743df50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:11.341705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79d178-443b-40ec-8955-27bf1cc779dd service placement] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:11.341996 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79d178-443b-40ec-8955-27bf1cc779dd service placement] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:11.342369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79d178-443b-40ec-8955-27bf1cc779dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:11.353442 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79d178-443b-40ec-8955-27bf1cc779dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:11.355050 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79d178-443b-40ec-8955-27bf1cc779dd service placement] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:11.366285 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1115/2242] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:21:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:21:11.904435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20ffb7-bc03-4e70-8804-9c23ad7fa0f9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:11.906038 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-eb20ffb7-bc03-4e70-8804-9c23ad7fa0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:11.977283 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20ffb7-bc03-4e70-8804-9c23ad7fa0f9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:11.982022 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b80db0-6e64-47da-a22f-a556bdb802b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:11.982896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b80db0-6e64-47da-a22f-a556bdb802b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:11.983190 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b80db0-6e64-47da-a22f-a556bdb802b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:11.983463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b80db0-6e64-47da-a22f-a556bdb802b1 admin admin] PATH_INFO: `/v3/users/4bb8b669f6d94b10857db8458a36de2f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:11.984719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b80db0-6e64-47da-a22f-a556bdb802b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb8b669f6d94b10857db8458a36de2f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:11.986669 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b80db0-6e64-47da-a22f-a556bdb802b1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:12.027599 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:12.045490 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-01b80db0-6e64-47da-a22f-a556bdb802b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb8b669f6d94b10857db8458a36de2f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:12.046152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-01b80db0-6e64-47da-a22f-a556bdb802b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb8b669f6d94b10857db8458a36de2f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:12.046756 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-01b80db0-6e64-47da-a22f-a556bdb802b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb8b669f6d94b10857db8458a36de2f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:12.054618 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-01b80db0-6e64-47da-a22f-a556bdb802b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb8b669f6d94b10857db8458a36de2f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:12.066989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-01b80db0-6e64-47da-a22f-a556bdb802b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb8b669f6d94b10857db8458a36de2f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:12.086186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1128/2243] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:21:11 2022] DELETE /identity/v3/users/4bb8b669f6d94b10857db8458a36de2f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:21:12.406138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79d178-443b-40ec-8955-27bf1cc779dd service placement] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:12.420054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79d178-443b-40ec-8955-27bf1cc779dd service placement] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:12.469548 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:12.480214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd160aa-a245-4f8e-aa8f-665f9944f980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:12.481112 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd160aa-a245-4f8e-aa8f-665f9944f980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:12.481398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd160aa-a245-4f8e-aa8f-665f9944f980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:12.481677 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd160aa-a245-4f8e-aa8f-665f9944f980 admin admin] PATH_INFO: `/v3/projects/c596a2f2006048799e388f4d8c6d908e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:12.482855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd160aa-a245-4f8e-aa8f-665f9944f980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c596a2f2006048799e388f4d8c6d908e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:12.484812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd160aa-a245-4f8e-aa8f-665f9944f980 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:12.532937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9bd160aa-a245-4f8e-aa8f-665f9944f980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c596a2f2006048799e388f4d8c6d908e', 'request_id': 'req-9bd160aa-a245-4f8e-aa8f-665f9944f980'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:12.541084 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9bd160aa-a245-4f8e-aa8f-665f9944f980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c596a2f2006048799e388f4d8c6d908e', 'request_id': 'req-9bd160aa-a245-4f8e-aa8f-665f9944f980'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:12.549912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9bd160aa-a245-4f8e-aa8f-665f9944f980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c596a2f2006048799e388f4d8c6d908e', 'request_id': 'req-9bd160aa-a245-4f8e-aa8f-665f9944f980'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:12.561342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9bd160aa-a245-4f8e-aa8f-665f9944f980 admin admin] The token cache is being invalidate because project c596a2f2006048799e388f4d8c6d908e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:21:12.561628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9bd160aa-a245-4f8e-aa8f-665f9944f980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:12.562283 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-9bd160aa-a245-4f8e-aa8f-665f9944f980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:12.563809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1116/2244] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:21:12 2022] DELETE /identity/v3/projects/c596a2f2006048799e388f4d8c6d908e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:21:12.567776 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b80db0-6e64-47da-a22f-a556bdb802b1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:12.569257 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-01b80db0-6e64-47da-a22f-a556bdb802b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:12.582323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b80db0-6e64-47da-a22f-a556bdb802b1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:12.645601 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a698b49-8d29-476d-a4ed-5081b54c43df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:12.646515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a698b49-8d29-476d-a4ed-5081b54c43df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:12.646797 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a698b49-8d29-476d-a4ed-5081b54c43df admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:12.647567 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a698b49-8d29-476d-a4ed-5081b54c43df admin admin] PATH_INFO: `/v3/users/eb073c97cfad4663ae4ba8ada97204d1` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:12.648857 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a698b49-8d29-476d-a4ed-5081b54c43df admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb073c97cfad4663ae4ba8ada97204d1)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:12.650768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a698b49-8d29-476d-a4ed-5081b54c43df admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:12.700280 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8a698b49-8d29-476d-a4ed-5081b54c43df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb073c97cfad4663ae4ba8ada97204d1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:12.700949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8a698b49-8d29-476d-a4ed-5081b54c43df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb073c97cfad4663ae4ba8ada97204d1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:12.701564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8a698b49-8d29-476d-a4ed-5081b54c43df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb073c97cfad4663ae4ba8ada97204d1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:12.709102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8a698b49-8d29-476d-a4ed-5081b54c43df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb073c97cfad4663ae4ba8ada97204d1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:12.717194 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8a698b49-8d29-476d-a4ed-5081b54c43df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb073c97cfad4663ae4ba8ada97204d1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:12.735469 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1129/2245] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:21:12 2022] DELETE /identity/v3/users/eb073c97cfad4663ae4ba8ada97204d1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:21:12.919661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd160aa-a245-4f8e-aa8f-665f9944f980 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:12.921352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9bd160aa-a245-4f8e-aa8f-665f9944f980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:12.958055 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd160aa-a245-4f8e-aa8f-665f9944f980 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:13.028048 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474dbb4-b5f2-4baf-ba91-9328af30a029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:13.028983 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474dbb4-b5f2-4baf-ba91-9328af30a029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:13.029271 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474dbb4-b5f2-4baf-ba91-9328af30a029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:13.029558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474dbb4-b5f2-4baf-ba91-9328af30a029 admin admin] PATH_INFO: `/v3/projects/44d50386869f481dae1d59974e5d382e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:13.030785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474dbb4-b5f2-4baf-ba91-9328af30a029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44d50386869f481dae1d59974e5d382e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:13.033082 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474dbb4-b5f2-4baf-ba91-9328af30a029 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:13.088309 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b474dbb4-b5f2-4baf-ba91-9328af30a029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44d50386869f481dae1d59974e5d382e', 'request_id': 'req-b474dbb4-b5f2-4baf-ba91-9328af30a029'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:13.095682 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b474dbb4-b5f2-4baf-ba91-9328af30a029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44d50386869f481dae1d59974e5d382e', 'request_id': 'req-b474dbb4-b5f2-4baf-ba91-9328af30a029'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:13.102179 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b474dbb4-b5f2-4baf-ba91-9328af30a029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44d50386869f481dae1d59974e5d382e', 'request_id': 'req-b474dbb4-b5f2-4baf-ba91-9328af30a029'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:13.113275 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b474dbb4-b5f2-4baf-ba91-9328af30a029 admin admin] The token cache is being invalidate because project 44d50386869f481dae1d59974e5d382e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:21:13.113566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b474dbb4-b5f2-4baf-ba91-9328af30a029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:13.114221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b474dbb4-b5f2-4baf-ba91-9328af30a029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:13.115824 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1117/2246] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:21:12 2022] DELETE /identity/v3/projects/44d50386869f481dae1d59974e5d382e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:21:13.121046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacd10b-d804-47ca-87e6-144691245e0c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:13.121335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacd10b-d804-47ca-87e6-144691245e0c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:13.121608 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacd10b-d804-47ca-87e6-144691245e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:13.142199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-acacd10b-d804-47ca-87e6-144691245e0c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:21:13.143402 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-acacd10b-d804-47ca-87e6-144691245e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:13.166580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:13.206744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1130/2247] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:21:13.215701 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a23c9-8a30-44a5-a1ba-f1f891087710 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:13.216034 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a23c9-8a30-44a5-a1ba-f1f891087710 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:13.216346 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a23c9-8a30-44a5-a1ba-f1f891087710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:13.235905 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-713a23c9-8a30-44a5-a1ba-f1f891087710 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:21:13.237162 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-713a23c9-8a30-44a5-a1ba-f1f891087710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:13.245241 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1118/2248] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:21:13.249479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacd10b-d804-47ca-87e6-144691245e0c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:13.260076 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacd10b-d804-47ca-87e6-144691245e0c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:13.265521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac2f39-924d-4f6b-828c-4f8863abce66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:13.266432 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac2f39-924d-4f6b-828c-4f8863abce66 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:13.266726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac2f39-924d-4f6b-828c-4f8863abce66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:13.268497 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac2f39-924d-4f6b-828c-4f8863abce66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:13.268497 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac2f39-924d-4f6b-828c-4f8863abce66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:21:13.268497 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac2f39-924d-4f6b-828c-4f8863abce66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:13.269987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac2f39-924d-4f6b-828c-4f8863abce66 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:13.283979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1131/2249] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:21:13.288454 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a23c9-8a30-44a5-a1ba-f1f891087710 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:13.294248 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:13.298254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a23c9-8a30-44a5-a1ba-f1f891087710 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:13.304399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd9b6f-a519-45eb-adf6-45f1ac4c53ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:13.305428 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd9b6f-a519-45eb-adf6-45f1ac4c53ad admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:13.306033 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd9b6f-a519-45eb-adf6-45f1ac4c53ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:13.306706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd9b6f-a519-45eb-adf6-45f1ac4c53ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:13.307829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd9b6f-a519-45eb-adf6-45f1ac4c53ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:13.310138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd9b6f-a519-45eb-adf6-45f1ac4c53ad admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:13.340401 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1119/2250] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:21:13 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:21:13.344503 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac2f39-924d-4f6b-828c-4f8863abce66 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:13.357763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac2f39-924d-4f6b-828c-4f8863abce66 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:13.436828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465f300-9b2b-4041-83bb-48f1268e0acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:13.437522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465f300-9b2b-4041-83bb-48f1268e0acb admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:13.437803 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465f300-9b2b-4041-83bb-48f1268e0acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:13.438082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465f300-9b2b-4041-83bb-48f1268e0acb admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:13.438813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465f300-9b2b-4041-83bb-48f1268e0acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:13.440778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465f300-9b2b-4041-83bb-48f1268e0acb admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:13.469319 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1132/2251] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:21:13 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:21:13.470590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd9b6f-a519-45eb-adf6-45f1ac4c53ad admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:13.482040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd9b6f-a519-45eb-adf6-45f1ac4c53ad admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:13.486909 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871ef0c-79ce-4fdc-be1a-2671b0b67f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:13.487591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871ef0c-79ce-4fdc-be1a-2671b0b67f47 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:13.487880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871ef0c-79ce-4fdc-be1a-2671b0b67f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:13.488161 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871ef0c-79ce-4fdc-be1a-2671b0b67f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:13.489151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871ef0c-79ce-4fdc-be1a-2671b0b67f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:13.491374 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871ef0c-79ce-4fdc-be1a-2671b0b67f47 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:13.508503 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1120/2252] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:21:13.512754 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465f300-9b2b-4041-83bb-48f1268e0acb admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:13.523570 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465f300-9b2b-4041-83bb-48f1268e0acb admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:13.530474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086d01b-9129-4c06-a12c-60ee26c6df75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:13.531240 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086d01b-9129-4c06-a12c-60ee26c6df75 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:13.531531 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086d01b-9129-4c06-a12c-60ee26c6df75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:13.531859 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086d01b-9129-4c06-a12c-60ee26c6df75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:13.534607 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086d01b-9129-4c06-a12c-60ee26c6df75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:13.536768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086d01b-9129-4c06-a12c-60ee26c6df75 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:13.549208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1133/2253] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:21:13.553029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871ef0c-79ce-4fdc-be1a-2671b0b67f47 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:13.564034 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871ef0c-79ce-4fdc-be1a-2671b0b67f47 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:13.568763 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de560ae-9f86-47f7-adc3-a1388b0c336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:13.570263 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de560ae-9f86-47f7-adc3-a1388b0c336f admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:13.570610 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de560ae-9f86-47f7-adc3-a1388b0c336f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:13.570946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de560ae-9f86-47f7-adc3-a1388b0c336f admin admin] PATH_INFO: `/v3/projects/3776e0479ceb49cb96386d5d4a329cbe/users/885afe2d7a684febb228c5a318264aec/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:13.586367 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de560ae-9f86-47f7-adc3-a1388b0c336f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3776e0479ceb49cb96386d5d4a329cbe, user_id=885afe2d7a684febb228c5a318264aec, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:13.589226 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de560ae-9f86-47f7-adc3-a1388b0c336f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:13.602781 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1121/2254] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:21:13 2022] PUT /identity/v3/projects/3776e0479ceb49cb96386d5d4a329cbe/users/885afe2d7a684febb228c5a318264aec/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:21:13.612930 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e37940-833c-4477-bfe2-94b07cbeeda9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:13.613404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e37940-833c-4477-bfe2-94b07cbeeda9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:13.613512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e37940-833c-4477-bfe2-94b07cbeeda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:13.641542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-05e37940-833c-4477-bfe2-94b07cbeeda9 None None] MFA Rules not processed for user `885afe2d7a684febb228c5a318264aec`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:21:13.643092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-05e37940-833c-4477-bfe2-94b07cbeeda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:13.712028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1134/2255] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:21:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:21:13.723349 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de560ae-9f86-47f7-adc3-a1388b0c336f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:13.725099 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0de560ae-9f86-47f7-adc3-a1388b0c336f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:13.785197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de560ae-9f86-47f7-adc3-a1388b0c336f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:13.789332 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40016c-34f3-44c0-bd8f-b8633b247ca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:13.789983 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40016c-34f3-44c0-bd8f-b8633b247ca2 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:13.790269 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40016c-34f3-44c0-bd8f-b8633b247ca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:13.790546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40016c-34f3-44c0-bd8f-b8633b247ca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:13.799326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40016c-34f3-44c0-bd8f-b8633b247ca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:13.800825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40016c-34f3-44c0-bd8f-b8633b247ca2 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:13.811733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1122/2256] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:21:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:21:13.830918 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e37940-833c-4477-bfe2-94b07cbeeda9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:13.857637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:13.896152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e37940-833c-4477-bfe2-94b07cbeeda9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:13.900758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cefc2-daad-48e4-8b5f-851cfbf2b48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:13.901620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cefc2-daad-48e4-8b5f-851cfbf2b48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:13.901916 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cefc2-daad-48e4-8b5f-851cfbf2b48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:13.902174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cefc2-daad-48e4-8b5f-851cfbf2b48c admin admin] PATH_INFO: `/v3/users/885afe2d7a684febb228c5a318264aec` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:13.903358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cefc2-daad-48e4-8b5f-851cfbf2b48c admin admin] RBAC: Authorizing `identity:delete_user(user_id=885afe2d7a684febb228c5a318264aec)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:13.905298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cefc2-daad-48e4-8b5f-851cfbf2b48c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:13.951074 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-371cefc2-daad-48e4-8b5f-851cfbf2b48c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '885afe2d7a684febb228c5a318264aec'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:13.951743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-371cefc2-daad-48e4-8b5f-851cfbf2b48c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '885afe2d7a684febb228c5a318264aec'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:13.952430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-371cefc2-daad-48e4-8b5f-851cfbf2b48c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '885afe2d7a684febb228c5a318264aec'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:13.959622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-371cefc2-daad-48e4-8b5f-851cfbf2b48c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '885afe2d7a684febb228c5a318264aec'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:13.967640 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-371cefc2-daad-48e4-8b5f-851cfbf2b48c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '885afe2d7a684febb228c5a318264aec'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:13.985268 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1135/2257] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:21:13 2022] DELETE /identity/v3/users/885afe2d7a684febb228c5a318264aec => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:21:13.990003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c957af-2266-4c8f-92a0-1a9f386fcba9 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:13.990247 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c957af-2266-4c8f-92a0-1a9f386fcba9 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:13.990529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c957af-2266-4c8f-92a0-1a9f386fcba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:14.013490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e9c957af-2266-4c8f-92a0-1a9f386fcba9 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:21:14.014779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e9c957af-2266-4c8f-92a0-1a9f386fcba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:14.079952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1123/2258] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:21:14.089734 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cefc2-daad-48e4-8b5f-851cfbf2b48c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:14.091147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-371cefc2-daad-48e4-8b5f-851cfbf2b48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:14.158838 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cefc2-daad-48e4-8b5f-851cfbf2b48c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:14.162710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6d7d2-0a6a-4df6-b114-0578ac30870f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:14.163890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6d7d2-0a6a-4df6-b114-0578ac30870f service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:14.164172 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6d7d2-0a6a-4df6-b114-0578ac30870f service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:14.164478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6d7d2-0a6a-4df6-b114-0578ac30870f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:14.175386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6d7d2-0a6a-4df6-b114-0578ac30870f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:14.176932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd6d7d2-0a6a-4df6-b114-0578ac30870f service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:14.187259 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1136/2259] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:21:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:21:14.485357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c957af-2266-4c8f-92a0-1a9f386fcba9 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:14.486699 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e9c957af-2266-4c8f-92a0-1a9f386fcba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:14.499145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c957af-2266-4c8f-92a0-1a9f386fcba9 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:14.504335 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545deb9c-971c-432e-8a35-e8a11ffa391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:14.505198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545deb9c-971c-432e-8a35-e8a11ffa391c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:14.505526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545deb9c-971c-432e-8a35-e8a11ffa391c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:14.505764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545deb9c-971c-432e-8a35-e8a11ffa391c admin admin] PATH_INFO: `/v3/projects/3776e0479ceb49cb96386d5d4a329cbe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:14.507206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545deb9c-971c-432e-8a35-e8a11ffa391c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3776e0479ceb49cb96386d5d4a329cbe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:14.509627 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545deb9c-971c-432e-8a35-e8a11ffa391c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:14.562044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:14.565334 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-545deb9c-971c-432e-8a35-e8a11ffa391c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3776e0479ceb49cb96386d5d4a329cbe', 'request_id': 'req-545deb9c-971c-432e-8a35-e8a11ffa391c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:14.575714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-545deb9c-971c-432e-8a35-e8a11ffa391c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3776e0479ceb49cb96386d5d4a329cbe', 'request_id': 'req-545deb9c-971c-432e-8a35-e8a11ffa391c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:14.586819 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-545deb9c-971c-432e-8a35-e8a11ffa391c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3776e0479ceb49cb96386d5d4a329cbe', 'request_id': 'req-545deb9c-971c-432e-8a35-e8a11ffa391c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:14.600773 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-545deb9c-971c-432e-8a35-e8a11ffa391c admin admin] The token cache is being invalidate because project 3776e0479ceb49cb96386d5d4a329cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:21:14.600773 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-545deb9c-971c-432e-8a35-e8a11ffa391c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:14.601640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-545deb9c-971c-432e-8a35-e8a11ffa391c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:21:14.603306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1124/2260] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:21:14 2022] DELETE /identity/v3/projects/3776e0479ceb49cb96386d5d4a329cbe => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:21:14.608481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b538eac-a362-4aef-a9d1-9c990efa3a0d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:14.608773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b538eac-a362-4aef-a9d1-9c990efa3a0d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:14.609065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b538eac-a362-4aef-a9d1-9c990efa3a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:14.633580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2b538eac-a362-4aef-a9d1-9c990efa3a0d None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:21:14.635021 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2b538eac-a362-4aef-a9d1-9c990efa3a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:14.690044 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:14.726763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1137/2261] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:21:14.735302 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f49b41-0bd2-4de7-9623-42f17af6d2bc None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:14.735554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f49b41-0bd2-4de7-9623-42f17af6d2bc None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:14.735769 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f49b41-0bd2-4de7-9623-42f17af6d2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:14.758115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-56f49b41-0bd2-4de7-9623-42f17af6d2bc None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:21:14.759503 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-56f49b41-0bd2-4de7-9623-42f17af6d2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:14.768568 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1125/2262] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:21:14.773362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b538eac-a362-4aef-a9d1-9c990efa3a0d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:14.784292 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b538eac-a362-4aef-a9d1-9c990efa3a0d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:14.789350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ed08f-fe81-4a4e-a29e-adc171e6dec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:14.790120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ed08f-fe81-4a4e-a29e-adc171e6dec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:14.790478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ed08f-fe81-4a4e-a29e-adc171e6dec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:14.790826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ed08f-fe81-4a4e-a29e-adc171e6dec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:14.791656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ed08f-fe81-4a4e-a29e-adc171e6dec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:21:14.792037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ed08f-fe81-4a4e-a29e-adc171e6dec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:14.793768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ed08f-fe81-4a4e-a29e-adc171e6dec2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:14.806101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1138/2263] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:21:14.810838 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f49b41-0bd2-4de7-9623-42f17af6d2bc None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:14.821365 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f49b41-0bd2-4de7-9623-42f17af6d2bc None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:14.826179 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f5689-fed3-41ce-9171-15c972959efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:14.826880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f5689-fed3-41ce-9171-15c972959efc admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:14.827166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f5689-fed3-41ce-9171-15c972959efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:14.827447 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f5689-fed3-41ce-9171-15c972959efc admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:14.828137 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f5689-fed3-41ce-9171-15c972959efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:14.830121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f5689-fed3-41ce-9171-15c972959efc admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:14.862384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1126/2264] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:21:14 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:21:14.863614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ed08f-fe81-4a4e-a29e-adc171e6dec2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:14.874477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ed08f-fe81-4a4e-a29e-adc171e6dec2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:14.934869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4aed3-c2df-47f3-ab04-d7dad7c5a6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:14.935553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4aed3-c2df-47f3-ab04-d7dad7c5a6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:14.935842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4aed3-c2df-47f3-ab04-d7dad7c5a6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:14.936124 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4aed3-c2df-47f3-ab04-d7dad7c5a6b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:14.936857 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4aed3-c2df-47f3-ab04-d7dad7c5a6b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:14.938798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d4aed3-c2df-47f3-ab04-d7dad7c5a6b5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:14.966217 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1139/2265] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:21:14 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:21:14.967505 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f5689-fed3-41ce-9171-15c972959efc admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:14.978334 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f5689-fed3-41ce-9171-15c972959efc admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:14.983197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d20fee-f0c8-4814-8583-2724e6a953d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:14.983940 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d20fee-f0c8-4814-8583-2724e6a953d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:14.984157 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d20fee-f0c8-4814-8583-2724e6a953d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:14.984474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d20fee-f0c8-4814-8583-2724e6a953d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:14.985214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d20fee-f0c8-4814-8583-2724e6a953d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:14.986889 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d20fee-f0c8-4814-8583-2724e6a953d3 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:15.009550 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1127/2266] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:21:15.013978 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4aed3-c2df-47f3-ab04-d7dad7c5a6b5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:15.028461 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d4aed3-c2df-47f3-ab04-d7dad7c5a6b5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:15.036792 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02e564-c1e0-4db8-97f4-b4e2ceb19ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:15.037913 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02e564-c1e0-4db8-97f4-b4e2ceb19ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:15.038355 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02e564-c1e0-4db8-97f4-b4e2ceb19ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:15.038825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02e564-c1e0-4db8-97f4-b4e2ceb19ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:15.039645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02e564-c1e0-4db8-97f4-b4e2ceb19ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:15.041445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02e564-c1e0-4db8-97f4-b4e2ceb19ab3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:15.054073 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1140/2267] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:21:15.058203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d20fee-f0c8-4814-8583-2724e6a953d3 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:15.068500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d20fee-f0c8-4814-8583-2724e6a953d3 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:15.073829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee70e83-66b5-47ab-b17b-cb9df2ce9e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:15.074705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee70e83-66b5-47ab-b17b-cb9df2ce9e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:15.075018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee70e83-66b5-47ab-b17b-cb9df2ce9e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:15.075299 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee70e83-66b5-47ab-b17b-cb9df2ce9e31 admin admin] PATH_INFO: `/v3/projects/6525e452db2343499996b628afb329b7/users/78d260c86035462cb43cfa1c81dd1b31/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:15.093770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee70e83-66b5-47ab-b17b-cb9df2ce9e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6525e452db2343499996b628afb329b7, user_id=78d260c86035462cb43cfa1c81dd1b31, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:15.104776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee70e83-66b5-47ab-b17b-cb9df2ce9e31 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:15.110893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1128/2268] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:21:15 2022] PUT /identity/v3/projects/6525e452db2343499996b628afb329b7/users/78d260c86035462cb43cfa1c81dd1b31/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:21:15.116479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd117ef-5764-45de-8cc6-8e751b968dc2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:15.116895 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd117ef-5764-45de-8cc6-8e751b968dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:15.117197 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd117ef-5764-45de-8cc6-8e751b968dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:15.139034 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ffd117ef-5764-45de-8cc6-8e751b968dc2 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:21:15.142082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ffd117ef-5764-45de-8cc6-8e751b968dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:15.200868 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1141/2269] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:21:15.212111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee70e83-66b5-47ab-b17b-cb9df2ce9e31 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:15.213853 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-cee70e83-66b5-47ab-b17b-cb9df2ce9e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:15.272223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee70e83-66b5-47ab-b17b-cb9df2ce9e31 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:15.277098 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df104298-e3ba-430f-8cc0-5eddcc54c0f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:15.277750 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df104298-e3ba-430f-8cc0-5eddcc54c0f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:15.278029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df104298-e3ba-430f-8cc0-5eddcc54c0f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:15.278307 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df104298-e3ba-430f-8cc0-5eddcc54c0f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:15.288328 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df104298-e3ba-430f-8cc0-5eddcc54c0f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:15.289773 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df104298-e3ba-430f-8cc0-5eddcc54c0f8 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:15.299501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1129/2270] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:21:16.145208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31c9e5-6a41-4921-bd5f-cadc785c7d12 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:16.145735 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31c9e5-6a41-4921-bd5f-cadc785c7d12 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:16.145816 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31c9e5-6a41-4921-bd5f-cadc785c7d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:16.178613 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7f31c9e5-6a41-4921-bd5f-cadc785c7d12 None None] MFA Rules not processed for user `78d260c86035462cb43cfa1c81dd1b31`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:21:16.180818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7f31c9e5-6a41-4921-bd5f-cadc785c7d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:16.226197 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:16.264494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1142/2271] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:21:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:21:16.276680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df104298-e3ba-430f-8cc0-5eddcc54c0f8 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:16.278233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-df104298-e3ba-430f-8cc0-5eddcc54c0f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:16.336531 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df104298-e3ba-430f-8cc0-5eddcc54c0f8 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:16.342058 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4223c31-3368-4bbe-8dff-bdc31cbad4b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:16.342803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4223c31-3368-4bbe-8dff-bdc31cbad4b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:16.343229 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4223c31-3368-4bbe-8dff-bdc31cbad4b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:16.343510 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4223c31-3368-4bbe-8dff-bdc31cbad4b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:16.352769 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4223c31-3368-4bbe-8dff-bdc31cbad4b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:16.354234 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4223c31-3368-4bbe-8dff-bdc31cbad4b4 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:16.363606 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1130/2272] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:21:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:21:18.812046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049613ea-0394-4ca4-8a73-9f357aab2635 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:18.812645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049613ea-0394-4ca4-8a73-9f357aab2635 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:18.812645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049613ea-0394-4ca4-8a73-9f357aab2635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:18.832227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-049613ea-0394-4ca4-8a73-9f357aab2635 None None] MFA Rules not processed for user `78d260c86035462cb43cfa1c81dd1b31`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:21:18.833496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-049613ea-0394-4ca4-8a73-9f357aab2635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:18.841171 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1143/2273] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:21:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:21:26.359317 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:DELETE=4,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:28.826999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=12 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:21:48.242545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688af77-a59d-4a21-9285-4a99b026579b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:48.243115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688af77-a59d-4a21-9285-4a99b026579b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:48.243115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688af77-a59d-4a21-9285-4a99b026579b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:48.266649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a688af77-a59d-4a21-9285-4a99b026579b None None] MFA Rules not processed for user `471739ee64504a6fa88d5d52eb0c1df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:21:48.267850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a688af77-a59d-4a21-9285-4a99b026579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:48.326128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1131/2274] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:21:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:21:53.798221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049613ea-0394-4ca4-8a73-9f357aab2635 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:21:53.799728 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-049613ea-0394-4ca4-8a73-9f357aab2635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:53.877665 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049613ea-0394-4ca4-8a73-9f357aab2635 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:21:53.883593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988a16f-d77f-4567-bb32-ac03fa0ec189 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3474e40117440498f0fe99f743df50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:21:53.884293 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988a16f-d77f-4567-bb32-ac03fa0ec189 service placement] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:21:53.884582 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988a16f-d77f-4567-bb32-ac03fa0ec189 service placement] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:21:53.884862 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988a16f-d77f-4567-bb32-ac03fa0ec189 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:21:53.886630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a988a16f-d77f-4567-bb32-ac03fa0ec189 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:21:53.898500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988a16f-d77f-4567-bb32-ac03fa0ec189 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:21:53.900095 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988a16f-d77f-4567-bb32-ac03fa0ec189 service placement] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:21:53.910075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1144/2275] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:21:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:21:58.318952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=25 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:01.627427 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688af77-a59d-4a21-9285-4a99b026579b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:22:01.628944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a688af77-a59d-4a21-9285-4a99b026579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:22:01.640811 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688af77-a59d-4a21-9285-4a99b026579b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:22:01.644306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6bbf2-ad77-4479-b665-d5318abc848d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:22:01.644959 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6bbf2-ad77-4479-b665-d5318abc848d service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:22:01.645241 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6bbf2-ad77-4479-b665-d5318abc848d service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:22:01.646079 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6bbf2-ad77-4479-b665-d5318abc848d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:22:01.647828 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bdd6bbf2-ad77-4479-b665-d5318abc848d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:22:01.715055 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6bbf2-ad77-4479-b665-d5318abc848d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:22:01.716536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6bbf2-ad77-4479-b665-d5318abc848d service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:22:01.727325 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1132/2276] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:22:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:22:03.905717 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=32 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:06.852131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988a16f-d77f-4567-bb32-ac03fa0ec189 service placement] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:22:06.866626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988a16f-d77f-4567-bb32-ac03fa0ec189 service placement] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:22:06.870818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761d4f7-e9ef-433e-a5c9-14bf292b15a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:22:06.871871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d4f7-e9ef-433e-a5c9-14bf292b15a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:22:06.872615 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d4f7-e9ef-433e-a5c9-14bf292b15a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:22:06.873106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d4f7-e9ef-433e-a5c9-14bf292b15a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:22:06.875225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0761d4f7-e9ef-433e-a5c9-14bf292b15a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:22:06.971443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761d4f7-e9ef-433e-a5c9-14bf292b15a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:22:06.973248 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761d4f7-e9ef-433e-a5c9-14bf292b15a5 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:22:06.988220 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1145/2277] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:22:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:22:09.185616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a409ce4-9eef-4027-9974-2520c28bec36 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:22:09.186850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a409ce4-9eef-4027-9974-2520c28bec36 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:22:09.187056 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a409ce4-9eef-4027-9974-2520c28bec36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:22:09.207446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-4a409ce4-9eef-4027-9974-2520c28bec36 None None] MFA Rules not processed for user `78d260c86035462cb43cfa1c81dd1b31`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:22:09.208823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4a409ce4-9eef-4027-9974-2520c28bec36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:22:09.216404 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1133/2278] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:22:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:22:16.982493 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=30 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:19.201994 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=33 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:43.297320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017196b4-0d8e-41a0-b53f-33bd484e3845 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:22:43.297890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017196b4-0d8e-41a0-b53f-33bd484e3845 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:22:43.297890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017196b4-0d8e-41a0-b53f-33bd484e3845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:22:43.318422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-017196b4-0d8e-41a0-b53f-33bd484e3845 None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:22:43.319648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-017196b4-0d8e-41a0-b53f-33bd484e3845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:22:43.378642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1146/2279] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 25 16:22:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:22:43.427532 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a409ce4-9eef-4027-9974-2520c28bec36 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:22:43.429090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4a409ce4-9eef-4027-9974-2520c28bec36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:22:43.503003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a409ce4-9eef-4027-9974-2520c28bec36 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:22:43.508445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac8613-4380-4e0f-828f-0a9a5f5849b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:22:43.509114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac8613-4380-4e0f-828f-0a9a5f5849b3 service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:22:43.509402 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac8613-4380-4e0f-828f-0a9a5f5849b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:22:43.509682 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac8613-4380-4e0f-828f-0a9a5f5849b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:22:43.518539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac8613-4380-4e0f-828f-0a9a5f5849b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:22:43.520705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac8613-4380-4e0f-828f-0a9a5f5849b3 service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:22:43.529481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1134/2280] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:22:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 16:22:48.789505 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ad93e-08f2-48d0-b424-fefed75d1639 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:22:48.790150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ad93e-08f2-48d0-b424-fefed75d1639 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:22:48.790150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ad93e-08f2-48d0-b424-fefed75d1639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:22:48.819732 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b51ad93e-08f2-48d0-b424-fefed75d1639 None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:22:48.821024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b51ad93e-08f2-48d0-b424-fefed75d1639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:22:48.834649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1147/2281] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 25 16:22:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:22:48.867766 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac8613-4380-4e0f-828f-0a9a5f5849b3 service swift] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:22:48.884395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac8613-4380-4e0f-828f-0a9a5f5849b3 service swift] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:22:48.891642 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82836fe-fde6-4a89-8c9f-75b2e2132f0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:22:48.892628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82836fe-fde6-4a89-8c9f-75b2e2132f0f service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:22:48.893131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82836fe-fde6-4a89-8c9f-75b2e2132f0f service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:22:48.893616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82836fe-fde6-4a89-8c9f-75b2e2132f0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:22:48.904803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82836fe-fde6-4a89-8c9f-75b2e2132f0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:22:48.907288 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82836fe-fde6-4a89-8c9f-75b2e2132f0f service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:22:48.918831 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1135/2282] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:22:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 16:22:58.812704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=28 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:58.914468 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=38 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:03.970838 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f36d2-021b-498f-8909-a25baedd3bed None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:03.971365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f36d2-021b-498f-8909-a25baedd3bed None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:03.971365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f36d2-021b-498f-8909-a25baedd3bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:03.991042 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bc6f36d2-021b-498f-8909-a25baedd3bed None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:23:03.992269 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bc6f36d2-021b-498f-8909-a25baedd3bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:23:03.999473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1148/2283] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jul 25 16:23:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:23:04.011873 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82836fe-fde6-4a89-8c9f-75b2e2132f0f service swift] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:04.024735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82836fe-fde6-4a89-8c9f-75b2e2132f0f service swift] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:04.029947 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc063413-d486-4c27-afed-b540614a2c40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:04.030636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc063413-d486-4c27-afed-b540614a2c40 service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:04.030943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc063413-d486-4c27-afed-b540614a2c40 service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:04.031224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc063413-d486-4c27-afed-b540614a2c40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:04.039991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc063413-d486-4c27-afed-b540614a2c40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:04.041600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc063413-d486-4c27-afed-b540614a2c40 service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:04.050106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1136/2284] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:23:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 16:23:06.045428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f36d2-021b-498f-8909-a25baedd3bed None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:06.059363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f36d2-021b-498f-8909-a25baedd3bed None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:06.064450 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6fe54f-039b-4ef0-9bbb-2bb2c65519e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:06.065331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fe54f-039b-4ef0-9bbb-2bb2c65519e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:06.065615 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fe54f-039b-4ef0-9bbb-2bb2c65519e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:06.065880 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6fe54f-039b-4ef0-9bbb-2bb2c65519e8 admin admin] PATH_INFO: `/v3/users/78d260c86035462cb43cfa1c81dd1b31` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:06.067066 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fe54f-039b-4ef0-9bbb-2bb2c65519e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d260c86035462cb43cfa1c81dd1b31)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:06.069799 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6fe54f-039b-4ef0-9bbb-2bb2c65519e8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:06.122412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4e6fe54f-039b-4ef0-9bbb-2bb2c65519e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d260c86035462cb43cfa1c81dd1b31'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:06.122412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4e6fe54f-039b-4ef0-9bbb-2bb2c65519e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d260c86035462cb43cfa1c81dd1b31'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:06.122412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4e6fe54f-039b-4ef0-9bbb-2bb2c65519e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d260c86035462cb43cfa1c81dd1b31'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:06.130794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4e6fe54f-039b-4ef0-9bbb-2bb2c65519e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d260c86035462cb43cfa1c81dd1b31'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:06.141044 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4e6fe54f-039b-4ef0-9bbb-2bb2c65519e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d260c86035462cb43cfa1c81dd1b31'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:06.159745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1149/2285] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:23:06 2022] DELETE /identity/v3/users/78d260c86035462cb43cfa1c81dd1b31 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:23:06.333609 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc063413-d486-4c27-afed-b540614a2c40 service swift] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:06.346039 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc063413-d486-4c27-afed-b540614a2c40 service swift] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:06.403314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb482f-a483-4854-8ab8-94a6650e79b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:06.404183 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb482f-a483-4854-8ab8-94a6650e79b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:06.404493 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb482f-a483-4854-8ab8-94a6650e79b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:06.404766 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb482f-a483-4854-8ab8-94a6650e79b8 admin admin] PATH_INFO: `/v3/projects/6525e452db2343499996b628afb329b7` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:06.405931 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb482f-a483-4854-8ab8-94a6650e79b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6525e452db2343499996b628afb329b7)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:06.407829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb482f-a483-4854-8ab8-94a6650e79b8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:06.454043 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8cdb482f-a483-4854-8ab8-94a6650e79b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6525e452db2343499996b628afb329b7', 'request_id': 'req-8cdb482f-a483-4854-8ab8-94a6650e79b8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:06.461866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8cdb482f-a483-4854-8ab8-94a6650e79b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6525e452db2343499996b628afb329b7', 'request_id': 'req-8cdb482f-a483-4854-8ab8-94a6650e79b8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:06.468057 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8cdb482f-a483-4854-8ab8-94a6650e79b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6525e452db2343499996b628afb329b7', 'request_id': 'req-8cdb482f-a483-4854-8ab8-94a6650e79b8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:06.478079 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8cdb482f-a483-4854-8ab8-94a6650e79b8 admin admin] The token cache is being invalidate because project 6525e452db2343499996b628afb329b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:23:06.478366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8cdb482f-a483-4854-8ab8-94a6650e79b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:06.478982 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8cdb482f-a483-4854-8ab8-94a6650e79b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:06.480743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1137/2286] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:23:06 2022] DELETE /identity/v3/projects/6525e452db2343499996b628afb329b7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:23:06.485619 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924444d9-cef5-4aef-8d8c-54fc1bfdc972 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:06.485961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924444d9-cef5-4aef-8d8c-54fc1bfdc972 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:06.486267 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924444d9-cef5-4aef-8d8c-54fc1bfdc972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:06.506920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-924444d9-cef5-4aef-8d8c-54fc1bfdc972 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:23:06.508193 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-924444d9-cef5-4aef-8d8c-54fc1bfdc972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:23:06.570388 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1150/2287] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:23:06.578611 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05829d8-1816-4610-90ce-04e728778ab3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:06.578918 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05829d8-1816-4610-90ce-04e728778ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:06.579213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05829d8-1816-4610-90ce-04e728778ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:06.600853 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c05829d8-1816-4610-90ce-04e728778ab3 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:23:06.602082 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c05829d8-1816-4610-90ce-04e728778ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:23:06.610125 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1138/2288] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:23:06.614795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924444d9-cef5-4aef-8d8c-54fc1bfdc972 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:06.624945 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924444d9-cef5-4aef-8d8c-54fc1bfdc972 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:06.631948 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc685a-78fa-458f-b215-74282c773680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:06.632657 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc685a-78fa-458f-b215-74282c773680 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:06.632946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc685a-78fa-458f-b215-74282c773680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:06.633234 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc685a-78fa-458f-b215-74282c773680 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:06.633969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc685a-78fa-458f-b215-74282c773680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:23:06.634279 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc685a-78fa-458f-b215-74282c773680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:06.635872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc685a-78fa-458f-b215-74282c773680 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:06.648552 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1151/2289] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:23:06.653227 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05829d8-1816-4610-90ce-04e728778ab3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:06.663731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05829d8-1816-4610-90ce-04e728778ab3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:06.668534 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a662a4-a261-44cf-b7f1-584cbef21f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:06.669227 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a662a4-a261-44cf-b7f1-584cbef21f73 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:06.669511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a662a4-a261-44cf-b7f1-584cbef21f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:06.669793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a662a4-a261-44cf-b7f1-584cbef21f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:06.670487 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a662a4-a261-44cf-b7f1-584cbef21f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:06.672420 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a662a4-a261-44cf-b7f1-584cbef21f73 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:06.714061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1139/2290] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:23:06 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:23:06.715277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc685a-78fa-458f-b215-74282c773680 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:06.728186 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc685a-78fa-458f-b215-74282c773680 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:06.779940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:06.793412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12b741-84c7-46ac-85a8-b4f45e38eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:06.794095 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12b741-84c7-46ac-85a8-b4f45e38eb8e admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:06.794379 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12b741-84c7-46ac-85a8-b4f45e38eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:06.794656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12b741-84c7-46ac-85a8-b4f45e38eb8e admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:06.795340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12b741-84c7-46ac-85a8-b4f45e38eb8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:06.797446 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12b741-84c7-46ac-85a8-b4f45e38eb8e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:06.821098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1152/2291] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:23:06 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:23:06.825472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a662a4-a261-44cf-b7f1-584cbef21f73 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:06.835691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a662a4-a261-44cf-b7f1-584cbef21f73 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:06.840748 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179a47c-c3c1-4207-82a3-b0d579683960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:06.841423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179a47c-c3c1-4207-82a3-b0d579683960 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:06.841688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179a47c-c3c1-4207-82a3-b0d579683960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:06.841965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179a47c-c3c1-4207-82a3-b0d579683960 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:06.842688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179a47c-c3c1-4207-82a3-b0d579683960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:06.844309 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179a47c-c3c1-4207-82a3-b0d579683960 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:06.856570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1140/2292] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:23:06.860443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12b741-84c7-46ac-85a8-b4f45e38eb8e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:06.871819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12b741-84c7-46ac-85a8-b4f45e38eb8e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:06.877462 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034fceb-8055-4cf4-98d4-24c63445c3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:06.878690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034fceb-8055-4cf4-98d4-24c63445c3ba admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:06.879086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034fceb-8055-4cf4-98d4-24c63445c3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:06.879255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034fceb-8055-4cf4-98d4-24c63445c3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:06.879989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034fceb-8055-4cf4-98d4-24c63445c3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:06.881710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034fceb-8055-4cf4-98d4-24c63445c3ba admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:06.897289 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1153/2293] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:23:06.901334 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179a47c-c3c1-4207-82a3-b0d579683960 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:06.912274 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179a47c-c3c1-4207-82a3-b0d579683960 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:06.917971 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f8ad-59f3-44a2-b387-fd9ce0490918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:06.919002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f8ad-59f3-44a2-b387-fd9ce0490918 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:06.919313 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f8ad-59f3-44a2-b387-fd9ce0490918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:06.919769 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f8ad-59f3-44a2-b387-fd9ce0490918 admin admin] PATH_INFO: `/v3/projects/ffa305a028824965920dbab999079ac6/users/5c0be29a71754da4ac259dfccb397dd9/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:06.936397 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62f8ad-59f3-44a2-b387-fd9ce0490918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa305a028824965920dbab999079ac6, user_id=5c0be29a71754da4ac259dfccb397dd9, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:06.939084 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62f8ad-59f3-44a2-b387-fd9ce0490918 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:06.953772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1141/2294] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:23:06 2022] PUT /identity/v3/projects/ffa305a028824965920dbab999079ac6/users/5c0be29a71754da4ac259dfccb397dd9/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:23:06.965393 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec47967-ed5a-4da7-a352-af4af99d123c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:06.965685 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec47967-ed5a-4da7-a352-af4af99d123c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:06.965990 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec47967-ed5a-4da7-a352-af4af99d123c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:06.995122 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6ec47967-ed5a-4da7-a352-af4af99d123c None None] MFA Rules not processed for user `5c0be29a71754da4ac259dfccb397dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:23:06.996434 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6ec47967-ed5a-4da7-a352-af4af99d123c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:23:07.074355 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1154/2295] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:23:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:23:07.086132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f8ad-59f3-44a2-b387-fd9ce0490918 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:07.088032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6d62f8ad-59f3-44a2-b387-fd9ce0490918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:23:07.104697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:07.163930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f8ad-59f3-44a2-b387-fd9ce0490918 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:07.169499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c0f83-f0fb-4e01-858f-7f64c8b1a9e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '623c97746d304c6ba971e79e4dbeb730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:07.170499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c0f83-f0fb-4e01-858f-7f64c8b1a9e2 service glance] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:07.170971 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c0f83-f0fb-4e01-858f-7f64c8b1a9e2 service glance] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:07.171409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c0f83-f0fb-4e01-858f-7f64c8b1a9e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:07.181661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c0f83-f0fb-4e01-858f-7f64c8b1a9e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:07.183096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c0f83-f0fb-4e01-858f-7f64c8b1a9e2 service glance] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:07.192452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1142/2296] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:23:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:23:08.591110 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245aedf-575a-4fcc-8cb6-56c3222e4efd None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:08.591670 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245aedf-575a-4fcc-8cb6-56c3222e4efd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:08.591860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245aedf-575a-4fcc-8cb6-56c3222e4efd None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:08.593241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1155/2297] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 25 16:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:23:08.599979 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dcd4e-d4b8-4a1f-84eb-913e1a20bd63 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:08.600513 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dcd4e-d4b8-4a1f-84eb-913e1a20bd63 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:08.600908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dcd4e-d4b8-4a1f-84eb-913e1a20bd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:08.621011 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-f72dcd4e-d4b8-4a1f-84eb-913e1a20bd63 None None] MFA Rules not processed for user `c455f8d340444b068249213ff504895e`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:23:08.622235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f72dcd4e-d4b8-4a1f-84eb-913e1a20bd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:23:08.718462 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1143/2298] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 25 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:23:08.733235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245aedf-575a-4fcc-8cb6-56c3222e4efd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:08.744540 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245aedf-575a-4fcc-8cb6-56c3222e4efd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:08.748770 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9f47a-c522-4661-80cc-9daca7249b5f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '623c97746d304c6ba971e79e4dbeb730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:08.749971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9f47a-c522-4661-80cc-9daca7249b5f service glance] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:08.750064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9f47a-c522-4661-80cc-9daca7249b5f service glance] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:08.750352 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9f47a-c522-4661-80cc-9daca7249b5f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:08.761960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9f47a-c522-4661-80cc-9daca7249b5f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:08.763560 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9f47a-c522-4661-80cc-9daca7249b5f service glance] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:08.775339 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1156/2299] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:23:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:23:08.844412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd1a68-f670-4ee7-abf1-d886f064b5b4 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:08.844698 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd1a68-f670-4ee7-abf1-d886f064b5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:08.844973 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd1a68-f670-4ee7-abf1-d886f064b5b4 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:08.846936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1144/2300] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 25 16:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:23:08.851780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef9117-80bd-4a99-9c09-f16579e36175 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:08.852144 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef9117-80bd-4a99-9c09-f16579e36175 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:08.852464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef9117-80bd-4a99-9c09-f16579e36175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:08.872710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-58ef9117-80bd-4a99-9c09-f16579e36175 None None] MFA Rules not processed for user `ad22a7d1e01c4c40b7cbefe971755148`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:23:08.873958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-58ef9117-80bd-4a99-9c09-f16579e36175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:23:08.926445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1157/2301] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 25 16:23:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:23:08.938122 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd1a68-f670-4ee7-abf1-d886f064b5b4 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:08.939818 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-38cd1a68-f670-4ee7-abf1-d886f064b5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:23:08.953081 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd1a68-f670-4ee7-abf1-d886f064b5b4 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:08.958308 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d67f2a-8b40-4031-9c8b-d60ab8bb4d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:08.958990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d67f2a-8b40-4031-9c8b-d60ab8bb4d1e service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:08.959261 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d67f2a-8b40-4031-9c8b-d60ab8bb4d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:08.959584 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d67f2a-8b40-4031-9c8b-d60ab8bb4d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:08.968592 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d67f2a-8b40-4031-9c8b-d60ab8bb4d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:08.970044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d67f2a-8b40-4031-9c8b-d60ab8bb4d1e service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:08.981342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1145/2302] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:23:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:23:09.069014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0c347-9679-47d0-bb75-b50075300681 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:09.069393 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0c347-9679-47d0-bb75-b50075300681 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:09.069890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0c347-9679-47d0-bb75-b50075300681 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:09.072035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1158/2303] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 25 16:23:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:23:09.077637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9565a3-8c28-45f2-9d7e-e1c9eb741eb4 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:09.078081 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9565a3-8c28-45f2-9d7e-e1c9eb741eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:09.078365 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9565a3-8c28-45f2-9d7e-e1c9eb741eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:09.100571 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-fd9565a3-8c28-45f2-9d7e-e1c9eb741eb4 None None] MFA Rules not processed for user `c455f8d340444b068249213ff504895e`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:23:09.101842 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-fd9565a3-8c28-45f2-9d7e-e1c9eb741eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:23:09.112862 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1146/2304] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 25 16:23:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:23:09.123564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0c347-9679-47d0-bb75-b50075300681 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:09.137515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0c347-9679-47d0-bb75-b50075300681 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:09.141615 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72298c5-d0b4-44d5-b543-34e40c3ee3aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:09.142268 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72298c5-d0b4-44d5-b543-34e40c3ee3aa service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:09.142733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72298c5-d0b4-44d5-b543-34e40c3ee3aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:09.143012 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72298c5-d0b4-44d5-b543-34e40c3ee3aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:09.154997 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72298c5-d0b4-44d5-b543-34e40c3ee3aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:09.156810 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72298c5-d0b4-44d5-b543-34e40c3ee3aa service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:09.169715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1159/2305] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:23:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:23:12.427643 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb41d3-339f-4da2-946b-3f9403783cc7 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:12.428126 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb41d3-339f-4da2-946b-3f9403783cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:12.428245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb41d3-339f-4da2-946b-3f9403783cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:12.448654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-dabb41d3-339f-4da2-946b-3f9403783cc7 None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:23:12.449898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-dabb41d3-339f-4da2-946b-3f9403783cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:23:12.636946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1147/2306] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 25 16:23:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:23:12.649403 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72298c5-d0b4-44d5-b543-34e40c3ee3aa service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:12.650796 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a72298c5-d0b4-44d5-b543-34e40c3ee3aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:23:12.699603 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:12.724013 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72298c5-d0b4-44d5-b543-34e40c3ee3aa service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:12.729108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd86bf4-591a-4255-874a-8c1ae6f4aa2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:12.729757 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd86bf4-591a-4255-874a-8c1ae6f4aa2c service swift] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:12.730042 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd86bf4-591a-4255-874a-8c1ae6f4aa2c service swift] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:12.730321 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd86bf4-591a-4255-874a-8c1ae6f4aa2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:12.739634 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd86bf4-591a-4255-874a-8c1ae6f4aa2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:12.741268 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd86bf4-591a-4255-874a-8c1ae6f4aa2c service swift] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:12.749292 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1160/2307] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:23:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 16:23:22.629553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=85 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:22.746043 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=12 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:49.989370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb41d3-339f-4da2-946b-3f9403783cc7 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:50.053274 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb41d3-339f-4da2-946b-3f9403783cc7 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:50.058289 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a31f53-2d23-4407-a6b7-0f944a67ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:50.059164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a31f53-2d23-4407-a6b7-0f944a67ca16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:50.059457 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a31f53-2d23-4407-a6b7-0f944a67ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:50.059718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a31f53-2d23-4407-a6b7-0f944a67ca16 admin admin] PATH_INFO: `/v3/users/5c0be29a71754da4ac259dfccb397dd9` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:50.060965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a31f53-2d23-4407-a6b7-0f944a67ca16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c0be29a71754da4ac259dfccb397dd9)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:50.062913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a31f53-2d23-4407-a6b7-0f944a67ca16 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:50.112508 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f4a31f53-2d23-4407-a6b7-0f944a67ca16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c0be29a71754da4ac259dfccb397dd9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:50.120740 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f4a31f53-2d23-4407-a6b7-0f944a67ca16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c0be29a71754da4ac259dfccb397dd9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:50.121436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f4a31f53-2d23-4407-a6b7-0f944a67ca16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c0be29a71754da4ac259dfccb397dd9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:50.122088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f4a31f53-2d23-4407-a6b7-0f944a67ca16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c0be29a71754da4ac259dfccb397dd9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:50.134659 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f4a31f53-2d23-4407-a6b7-0f944a67ca16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c0be29a71754da4ac259dfccb397dd9'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:50.148113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1148/2308] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:23:49 2022] DELETE /identity/v3/users/5c0be29a71754da4ac259dfccb397dd9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:23:50.152675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b82ca4-cf6d-4f85-b434-c39181f4e1d0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:50.153233 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b82ca4-cf6d-4f85-b434-c39181f4e1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:50.153233 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b82ca4-cf6d-4f85-b434-c39181f4e1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:50.173526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-98b82ca4-cf6d-4f85-b434-c39181f4e1d0 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:23:50.174754 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-98b82ca4-cf6d-4f85-b434-c39181f4e1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:23:50.240584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1161/2309] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:23:50.247500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a31f53-2d23-4407-a6b7-0f944a67ca16 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:50.249006 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f4a31f53-2d23-4407-a6b7-0f944a67ca16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:23:50.316963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a31f53-2d23-4407-a6b7-0f944a67ca16 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:50.320576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a746-dec6-42b6-bc51-7b9cfc9d13d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:50.321252 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a746-dec6-42b6-bc51-7b9cfc9d13d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:50.321528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a746-dec6-42b6-bc51-7b9cfc9d13d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:50.321800 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a746-dec6-42b6-bc51-7b9cfc9d13d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:50.331548 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840a746-dec6-42b6-bc51-7b9cfc9d13d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:50.333005 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840a746-dec6-42b6-bc51-7b9cfc9d13d2 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:50.342958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1149/2310] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:23:50.611828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b82ca4-cf6d-4f85-b434-c39181f4e1d0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:50.613416 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-98b82ca4-cf6d-4f85-b434-c39181f4e1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:23:50.625511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b82ca4-cf6d-4f85-b434-c39181f4e1d0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:50.630838 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e1d0f-806f-4b35-972f-49ee1e033a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:50.631711 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e1d0f-806f-4b35-972f-49ee1e033a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:50.632051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e1d0f-806f-4b35-972f-49ee1e033a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:50.632272 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e1d0f-806f-4b35-972f-49ee1e033a26 admin admin] PATH_INFO: `/v3/projects/ffa305a028824965920dbab999079ac6` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:50.633559 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e1d0f-806f-4b35-972f-49ee1e033a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa305a028824965920dbab999079ac6)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:50.635483 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e1d0f-806f-4b35-972f-49ee1e033a26 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:50.685263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e35e1d0f-806f-4b35-972f-49ee1e033a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa305a028824965920dbab999079ac6', 'request_id': 'req-e35e1d0f-806f-4b35-972f-49ee1e033a26'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:50.691989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e35e1d0f-806f-4b35-972f-49ee1e033a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa305a028824965920dbab999079ac6', 'request_id': 'req-e35e1d0f-806f-4b35-972f-49ee1e033a26'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:50.697746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e35e1d0f-806f-4b35-972f-49ee1e033a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa305a028824965920dbab999079ac6', 'request_id': 'req-e35e1d0f-806f-4b35-972f-49ee1e033a26'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:50.711111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e35e1d0f-806f-4b35-972f-49ee1e033a26 admin admin] The token cache is being invalidate because project ffa305a028824965920dbab999079ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:23:50.711433 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e35e1d0f-806f-4b35-972f-49ee1e033a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:50.712027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e35e1d0f-806f-4b35-972f-49ee1e033a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:23:50.713610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1162/2311] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:23:50 2022] DELETE /identity/v3/projects/ffa305a028824965920dbab999079ac6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:23:52.637316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8ebee-0104-4286-865b-7cfb138fa161 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:52.637820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8ebee-0104-4286-865b-7cfb138fa161 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:52.637913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8ebee-0104-4286-865b-7cfb138fa161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:52.658027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-07d8ebee-0104-4286-865b-7cfb138fa161 None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:23:52.659500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-07d8ebee-0104-4286-865b-7cfb138fa161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:23:52.676360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:23:52.714398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1150/2312] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jul 25 16:23:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:23:52.736026 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e1d0f-806f-4b35-972f-49ee1e033a26 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:23:52.737480 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e35e1d0f-806f-4b35-972f-49ee1e033a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:23:52.806469 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e1d0f-806f-4b35-972f-49ee1e033a26 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:23:52.811310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dd0ab-aeec-4874-a71d-492811dddf37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:23:52.811959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dd0ab-aeec-4874-a71d-492811dddf37 service swift] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:23:52.812244 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dd0ab-aeec-4874-a71d-492811dddf37 service swift] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:23:52.812551 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dd0ab-aeec-4874-a71d-492811dddf37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:23:52.821107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dd0ab-aeec-4874-a71d-492811dddf37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:23:52.822685 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dd0ab-aeec-4874-a71d-492811dddf37 service swift] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:23:52.831330 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1163/2313] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:23:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 16:24:02.708147 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=15 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:02.827429 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:09.247095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8ebee-0104-4286-865b-7cfb138fa161 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:24:09.248637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-07d8ebee-0104-4286-865b-7cfb138fa161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:24:09.306156 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8ebee-0104-4286-865b-7cfb138fa161 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:24:09.311576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17af2b-916b-43d7-8904-a456c9e87f07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:24:09.311576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17af2b-916b-43d7-8904-a456c9e87f07 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:24:09.311576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17af2b-916b-43d7-8904-a456c9e87f07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:24:09.311996 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17af2b-916b-43d7-8904-a456c9e87f07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:24:09.313978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9b17af2b-916b-43d7-8904-a456c9e87f07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:24:09.391945 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17af2b-916b-43d7-8904-a456c9e87f07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:24:09.393342 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17af2b-916b-43d7-8904-a456c9e87f07 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:24:09.404984 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1151/2314] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:24:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:24:15.321953 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482feb1-bbcd-46e8-b508-54b003abd35e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:24:15.322509 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482feb1-bbcd-46e8-b508-54b003abd35e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:24:15.322509 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482feb1-bbcd-46e8-b508-54b003abd35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:24:15.341761 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3482feb1-bbcd-46e8-b508-54b003abd35e None None] MFA Rules not processed for user `10c3b4f5766449c19198efc35dc80429`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:24:15.342979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3482feb1-bbcd-46e8-b508-54b003abd35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:24:15.398680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1164/2315] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:24:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:24:16.271215 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17af2b-916b-43d7-8904-a456c9e87f07 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:24:16.272877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9b17af2b-916b-43d7-8904-a456c9e87f07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:24:16.334387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17af2b-916b-43d7-8904-a456c9e87f07 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:24:16.338118 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a82aa0-6ad0-4b10-8b01-73cbd494eb95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:24:16.339508 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a82aa0-6ad0-4b10-8b01-73cbd494eb95 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:24:16.339795 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a82aa0-6ad0-4b10-8b01-73cbd494eb95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:24:16.340068 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a82aa0-6ad0-4b10-8b01-73cbd494eb95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:24:16.341938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c8a82aa0-6ad0-4b10-8b01-73cbd494eb95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:24:16.356642 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a82aa0-6ad0-4b10-8b01-73cbd494eb95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:24:16.358110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a82aa0-6ad0-4b10-8b01-73cbd494eb95 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:24:16.370115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1152/2316] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:24:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:24:25.391525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=25 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:26.365596 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=80 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:33.465157 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482feb1-bbcd-46e8-b508-54b003abd35e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:24:33.466980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3482feb1-bbcd-46e8-b508-54b003abd35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:24:33.479886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482feb1-bbcd-46e8-b508-54b003abd35e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:24:33.484182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9bc8e-bde9-4500-a6ef-98ef7e899d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:24:33.485011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9bc8e-bde9-4500-a6ef-98ef7e899d1a service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:24:33.485349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9bc8e-bde9-4500-a6ef-98ef7e899d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:24:33.485673 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9bc8e-bde9-4500-a6ef-98ef7e899d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:24:33.487771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0af9bc8e-bde9-4500-a6ef-98ef7e899d1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:24:33.498491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9bc8e-bde9-4500-a6ef-98ef7e899d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:24:33.500485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9bc8e-bde9-4500-a6ef-98ef7e899d1a service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:24:33.510791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1165/2317] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:24:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:24:40.732578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a82aa0-6ad0-4b10-8b01-73cbd494eb95 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:24:40.734311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c8a82aa0-6ad0-4b10-8b01-73cbd494eb95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:24:40.748287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a82aa0-6ad0-4b10-8b01-73cbd494eb95 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:24:40.754005 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a38edb-cdce-462f-bbda-e6b4123fdd7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:24:40.754698 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a38edb-cdce-462f-bbda-e6b4123fdd7e service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:24:40.754981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a38edb-cdce-462f-bbda-e6b4123fdd7e service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:24:40.755256 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a38edb-cdce-462f-bbda-e6b4123fdd7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:24:40.757483 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a2a38edb-cdce-462f-bbda-e6b4123fdd7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:24:40.822461 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a38edb-cdce-462f-bbda-e6b4123fdd7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:24:40.824063 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a38edb-cdce-462f-bbda-e6b4123fdd7e service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:24:40.834140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1153/2318] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:24:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:24:43.506072 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:48.377649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9bc8e-bde9-4500-a6ef-98ef7e899d1a service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:24:48.392722 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9bc8e-bde9-4500-a6ef-98ef7e899d1a service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:24:48.399404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99788a7c-b3b9-4b09-87ee-08a790a36cf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:24:48.400065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99788a7c-b3b9-4b09-87ee-08a790a36cf9 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:24:48.400371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99788a7c-b3b9-4b09-87ee-08a790a36cf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:24:48.400651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99788a7c-b3b9-4b09-87ee-08a790a36cf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:24:48.402477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-99788a7c-b3b9-4b09-87ee-08a790a36cf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:24:48.465684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99788a7c-b3b9-4b09-87ee-08a790a36cf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:24:48.467331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99788a7c-b3b9-4b09-87ee-08a790a36cf9 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:24:48.477437 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1166/2319] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:24:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:24:50.829661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=28 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:58.473060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=28 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:20.677899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe12b8-81e5-4c56-bbeb-1482d932b2d8 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:25:20.678475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe12b8-81e5-4c56-bbeb-1482d932b2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:25:20.678475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe12b8-81e5-4c56-bbeb-1482d932b2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:25:20.697725 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2afe12b8-81e5-4c56-bbeb-1482d932b2d8 None None] MFA Rules not processed for user `471739ee64504a6fa88d5d52eb0c1df4`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:25:20.698959 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2afe12b8-81e5-4c56-bbeb-1482d932b2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:25:20.706449 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1154/2320] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:25:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:25:26.810886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99788a7c-b3b9-4b09-87ee-08a790a36cf9 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:25:26.822883 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99788a7c-b3b9-4b09-87ee-08a790a36cf9 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:25:26.828609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19ea5a-5ad1-4f53-bf00-1f5adf358566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:25:26.829331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19ea5a-5ad1-4f53-bf00-1f5adf358566 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:25:26.829686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19ea5a-5ad1-4f53-bf00-1f5adf358566 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:25:26.830067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19ea5a-5ad1-4f53-bf00-1f5adf358566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:25:26.831892 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2b19ea5a-5ad1-4f53-bf00-1f5adf358566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:25:26.845411 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19ea5a-5ad1-4f53-bf00-1f5adf358566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:25:26.847012 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19ea5a-5ad1-4f53-bf00-1f5adf358566 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:25:26.858278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1167/2321] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:25:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:25:27.592043 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe12b8-81e5-4c56-bbeb-1482d932b2d8 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:25:27.593528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2afe12b8-81e5-4c56-bbeb-1482d932b2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:25:27.609755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe12b8-81e5-4c56-bbeb-1482d932b2d8 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:25:27.615281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61534c-8693-431a-bd43-81535369f2d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:25:27.615971 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61534c-8693-431a-bd43-81535369f2d1 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:25:27.616272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61534c-8693-431a-bd43-81535369f2d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:25:27.616567 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61534c-8693-431a-bd43-81535369f2d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:25:27.618377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bb61534c-8693-431a-bd43-81535369f2d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:25:27.678854 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61534c-8693-431a-bd43-81535369f2d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:25:27.680464 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61534c-8693-431a-bd43-81535369f2d1 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:25:27.690271 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1155/2322] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:25:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:25:34.222940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19ea5a-5ad1-4f53-bf00-1f5adf358566 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:25:34.236986 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19ea5a-5ad1-4f53-bf00-1f5adf358566 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:25:34.243800 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a46acf-07ab-4c28-ab7b-5520e70302a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:25:34.244628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46acf-07ab-4c28-ab7b-5520e70302a7 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:25:34.245083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46acf-07ab-4c28-ab7b-5520e70302a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:25:34.245415 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46acf-07ab-4c28-ab7b-5520e70302a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:25:34.248390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c3a46acf-07ab-4c28-ab7b-5520e70302a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:25:34.264637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a46acf-07ab-4c28-ab7b-5520e70302a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:25:34.266799 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a46acf-07ab-4c28-ab7b-5520e70302a7 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:25:34.278801 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1168/2323] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:25:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:25:37.685340 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=31 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:38.679659 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63141e43-a988-480a-927b-a243eded4586 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:25:38.679951 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63141e43-a988-480a-927b-a243eded4586 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:25:38.680237 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63141e43-a988-480a-927b-a243eded4586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:25:38.700108 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-63141e43-a988-480a-927b-a243eded4586 None None] MFA Rules not processed for user `13ea16d9dcaa4c00b26e166b9a639077`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:25:38.701369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-63141e43-a988-480a-927b-a243eded4586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:25:38.708542 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1156/2324] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:25:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:25:39.063557 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a46acf-07ab-4c28-ab7b-5520e70302a7 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:25:39.073788 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a46acf-07ab-4c28-ab7b-5520e70302a7 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:25:39.078022 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8116fa-0562-47ac-a88b-1fc2378d43a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:25:39.078673 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8116fa-0562-47ac-a88b-1fc2378d43a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:25:39.078988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8116fa-0562-47ac-a88b-1fc2378d43a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:25:39.079263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8116fa-0562-47ac-a88b-1fc2378d43a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:25:39.081440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2f8116fa-0562-47ac-a88b-1fc2378d43a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:25:39.092667 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8116fa-0562-47ac-a88b-1fc2378d43a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:25:39.094120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8116fa-0562-47ac-a88b-1fc2378d43a3 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:25:39.103690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1169/2325] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:25:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:25:40.448398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63141e43-a988-480a-927b-a243eded4586 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:25:40.449808 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-63141e43-a988-480a-927b-a243eded4586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:25:40.523264 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63141e43-a988-480a-927b-a243eded4586 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:25:40.528447 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f88ed-60b5-4a2f-9c85-156da5c8f3ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3474e40117440498f0fe99f743df50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:25:40.529659 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f88ed-60b5-4a2f-9c85-156da5c8f3ec service placement] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:25:40.529964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f88ed-60b5-4a2f-9c85-156da5c8f3ec service placement] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:25:40.530237 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f88ed-60b5-4a2f-9c85-156da5c8f3ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:25:40.532112 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-043f88ed-60b5-4a2f-9c85-156da5c8f3ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:25:40.546678 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f88ed-60b5-4a2f-9c85-156da5c8f3ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:25:40.548570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f88ed-60b5-4a2f-9c85-156da5c8f3ec service placement] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:25:40.559603 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1157/2326] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:25:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:25:49.099022 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=18 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:50.554798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=35 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:55.348796 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8116fa-0562-47ac-a88b-1fc2378d43a3 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:25:55.361889 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8116fa-0562-47ac-a88b-1fc2378d43a3 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:25:55.367449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd0c39-00d2-4888-9fc5-c8b0cade9b21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:25:55.368220 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd0c39-00d2-4888-9fc5-c8b0cade9b21 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:25:55.368533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd0c39-00d2-4888-9fc5-c8b0cade9b21 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:25:55.368809 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd0c39-00d2-4888-9fc5-c8b0cade9b21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:25:55.370561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9edd0c39-00d2-4888-9fc5-c8b0cade9b21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:25:55.383838 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd0c39-00d2-4888-9fc5-c8b0cade9b21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:25:55.385613 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd0c39-00d2-4888-9fc5-c8b0cade9b21 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:25:55.398139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1170/2327] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:25:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:26:02.954200 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f88ed-60b5-4a2f-9c85-156da5c8f3ec service placement] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:26:02.967417 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f88ed-60b5-4a2f-9c85-156da5c8f3ec service placement] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:26:02.973327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838f075-fa74-468a-aeaf-61d53b3fdf5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:26:02.974017 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838f075-fa74-468a-aeaf-61d53b3fdf5f service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:02.974261 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838f075-fa74-468a-aeaf-61d53b3fdf5f service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:02.974527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838f075-fa74-468a-aeaf-61d53b3fdf5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:02.977093 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f838f075-fa74-468a-aeaf-61d53b3fdf5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:03.036361 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838f075-fa74-468a-aeaf-61d53b3fdf5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:26:03.037949 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838f075-fa74-468a-aeaf-61d53b3fdf5f service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:26:03.047426 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1158/2328] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:26:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:26:05.393968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:11.740827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd0c39-00d2-4888-9fc5-c8b0cade9b21 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:26:11.750518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd0c39-00d2-4888-9fc5-c8b0cade9b21 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:26:11.754100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632e220-c892-490f-8592-ec68647e2f8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:26:11.754732 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632e220-c892-490f-8592-ec68647e2f8a service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:11.755017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632e220-c892-490f-8592-ec68647e2f8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:11.755295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632e220-c892-490f-8592-ec68647e2f8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:11.757360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d632e220-c892-490f-8592-ec68647e2f8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:11.767173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632e220-c892-490f-8592-ec68647e2f8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:26:11.768573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632e220-c892-490f-8592-ec68647e2f8a service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:26:11.776528 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1171/2329] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:26:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:26:11.882831 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd7453-58d5-4e29-9554-b13ef72837f9 None None] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:11.883419 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd7453-58d5-4e29-9554-b13ef72837f9 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:11.883419 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd7453-58d5-4e29-9554-b13ef72837f9 None None] PATH_INFO: `/` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:11.884792 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1159/2330] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 25 16:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:26:11.891622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371ddf5-d30f-4f23-80e8-6a97ea11a234 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:11.891941 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371ddf5-d30f-4f23-80e8-6a97ea11a234 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:11.892224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371ddf5-d30f-4f23-80e8-6a97ea11a234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:11.915601 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9371ddf5-d30f-4f23-80e8-6a97ea11a234 None None] MFA Rules not processed for user `ad22a7d1e01c4c40b7cbefe971755148`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:26:11.916898 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9371ddf5-d30f-4f23-80e8-6a97ea11a234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:11.925618 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1172/2331] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 25 16:26:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:26:11.938575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd7453-58d5-4e29-9554-b13ef72837f9 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:26:11.949593 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd7453-58d5-4e29-9554-b13ef72837f9 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:26:11.953409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54165e0-4427-4d6b-a4a7-c3897a08c601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:26:11.954265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54165e0-4427-4d6b-a4a7-c3897a08c601 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:11.954550 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54165e0-4427-4d6b-a4a7-c3897a08c601 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:11.954826 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54165e0-4427-4d6b-a4a7-c3897a08c601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:11.962914 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54165e0-4427-4d6b-a4a7-c3897a08c601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:26:11.964394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54165e0-4427-4d6b-a4a7-c3897a08c601 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:26:11.972752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1160/2332] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:26:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:26:12.060348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda629cc-6d37-474c-9f54-eb44265ab8e5 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:12.060644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda629cc-6d37-474c-9f54-eb44265ab8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:12.060921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda629cc-6d37-474c-9f54-eb44265ab8e5 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:12.062329 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1173/2333] 10.222.0.70 () {54 vars in 921 bytes} [Mon Jul 25 16:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 16:26:12.067658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58f748-49f6-42c6-8e3b-ce342232ff55 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:12.067945 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58f748-49f6-42c6-8e3b-ce342232ff55 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:12.068218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58f748-49f6-42c6-8e3b-ce342232ff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:12.088144 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2f58f748-49f6-42c6-8e3b-ce342232ff55 None None] MFA Rules not processed for user `c455f8d340444b068249213ff504895e`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:26:12.089391 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2f58f748-49f6-42c6-8e3b-ce342232ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:12.098558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1161/2334] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Jul 25 16:26:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:26:12.109643 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda629cc-6d37-474c-9f54-eb44265ab8e5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:26:12.120653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda629cc-6d37-474c-9f54-eb44265ab8e5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:26:12.125271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecb730-0afd-466c-b110-1d09cf8ebba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:26:12.126000 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecb730-0afd-466c-b110-1d09cf8ebba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:12.126209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecb730-0afd-466c-b110-1d09cf8ebba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:12.126485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecb730-0afd-466c-b110-1d09cf8ebba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:12.137365 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecb730-0afd-466c-b110-1d09cf8ebba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:26:12.138800 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecb730-0afd-466c-b110-1d09cf8ebba4 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:26:12.149321 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1174/2335] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:26:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:26:17.738664 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58f748-49f6-42c6-8e3b-ce342232ff55 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:26:17.750271 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58f748-49f6-42c6-8e3b-ce342232ff55 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:26:17.755641 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c9a4e-80c8-465a-8a17-c569f88284f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:26:17.756298 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c9a4e-80c8-465a-8a17-c569f88284f1 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:17.756584 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c9a4e-80c8-465a-8a17-c569f88284f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:17.756859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c9a4e-80c8-465a-8a17-c569f88284f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:17.758681 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5d0c9a4e-80c8-465a-8a17-c569f88284f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:17.819917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c9a4e-80c8-465a-8a17-c569f88284f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:26:17.821520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c9a4e-80c8-465a-8a17-c569f88284f1 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:26:17.833199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1162/2336] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:26:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:26:22.144822 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=15 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:27.827395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=65 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:30.263540 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac62643-0526-452c-bd08-dd8915b5bf1b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:30.264043 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac62643-0526-452c-bd08-dd8915b5bf1b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:30.264128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac62643-0526-452c-bd08-dd8915b5bf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:30.404605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8ac62643-0526-452c-bd08-dd8915b5bf1b None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:26:30.405822 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8ac62643-0526-452c-bd08-dd8915b5bf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:30.413104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1175/2337] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jul 25 16:26:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:26:30.459640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c9a4e-80c8-465a-8a17-c569f88284f1 service nova] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:26:30.470815 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c9a4e-80c8-465a-8a17-c569f88284f1 service nova] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:26:30.475702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5d66d-a6e2-4a80-98bb-0aa4a044f506 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:26:30.476379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5d66d-a6e2-4a80-98bb-0aa4a044f506 service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:30.476667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5d66d-a6e2-4a80-98bb-0aa4a044f506 service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:30.476944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5d66d-a6e2-4a80-98bb-0aa4a044f506 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:30.485188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5d66d-a6e2-4a80-98bb-0aa4a044f506 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:26:30.486705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5d66d-a6e2-4a80-98bb-0aa4a044f506 service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:26:30.494626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1163/2338] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:26:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 16:26:30.845731 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac62643-0526-452c-bd08-dd8915b5bf1b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:26:30.855320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac62643-0526-452c-bd08-dd8915b5bf1b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:26:30.858867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90bf89-85d5-4c78-b0c8-73fe39ca881a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:26:30.859503 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90bf89-85d5-4c78-b0c8-73fe39ca881a service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:30.859787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90bf89-85d5-4c78-b0c8-73fe39ca881a service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:30.860067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90bf89-85d5-4c78-b0c8-73fe39ca881a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:30.861862 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cc90bf89-85d5-4c78-b0c8-73fe39ca881a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:30.923543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90bf89-85d5-4c78-b0c8-73fe39ca881a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:26:30.925054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90bf89-85d5-4c78-b0c8-73fe39ca881a service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:26:30.934583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1176/2339] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:26:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:26:33.263783 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5d66d-a6e2-4a80-98bb-0aa4a044f506 service swift] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:26:33.275898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5d66d-a6e2-4a80-98bb-0aa4a044f506 service swift] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:26:33.282174 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91520ad2-1da0-41f0-bef9-bada9d348e74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:26:33.282854 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91520ad2-1da0-41f0-bef9-bada9d348e74 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:33.283154 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91520ad2-1da0-41f0-bef9-bada9d348e74 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:33.283415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91520ad2-1da0-41f0-bef9-bada9d348e74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:33.285504 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-91520ad2-1da0-41f0-bef9-bada9d348e74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:33.298198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91520ad2-1da0-41f0-bef9-bada9d348e74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:26:33.299807 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91520ad2-1da0-41f0-bef9-bada9d348e74 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:26:33.309167 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1164/2340] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:26:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:26:34.390232 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90bf89-85d5-4c78-b0c8-73fe39ca881a service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:26:34.391702 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cc90bf89-85d5-4c78-b0c8-73fe39ca881a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:34.406661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90bf89-85d5-4c78-b0c8-73fe39ca881a service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:26:34.412033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb8cdf-5397-4b3e-a7ff-ce4b4d7cef48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3474e40117440498f0fe99f743df50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:26:34.412738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb8cdf-5397-4b3e-a7ff-ce4b4d7cef48 service placement] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:34.413021 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb8cdf-5397-4b3e-a7ff-ce4b4d7cef48 service placement] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:34.413324 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb8cdf-5397-4b3e-a7ff-ce4b4d7cef48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:34.415114 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0bdb8cdf-5397-4b3e-a7ff-ce4b4d7cef48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:34.428130 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb8cdf-5397-4b3e-a7ff-ce4b4d7cef48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:26:34.429816 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb8cdf-5397-4b3e-a7ff-ce4b4d7cef48 service placement] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:26:34.444136 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1177/2341] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:26:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:26:38.348376 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91520ad2-1da0-41f0-bef9-bada9d348e74 service nova] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:26:38.349968 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-91520ad2-1da0-41f0-bef9-bada9d348e74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:38.364887 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91520ad2-1da0-41f0-bef9-bada9d348e74 service nova] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:26:38.369835 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cca942-e4ab-4b0f-a8ba-6dca3b3584b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:26:38.371502 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cca942-e4ab-4b0f-a8ba-6dca3b3584b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:38.371786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cca942-e4ab-4b0f-a8ba-6dca3b3584b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:38.372147 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cca942-e4ab-4b0f-a8ba-6dca3b3584b3 admin admin] PATH_INFO: `/v3/users/947b842f0b1e428286893d5f9353393a` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:38.373501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cca942-e4ab-4b0f-a8ba-6dca3b3584b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=947b842f0b1e428286893d5f9353393a)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:26:38.375484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cca942-e4ab-4b0f-a8ba-6dca3b3584b3 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:26:38.427179 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-53cca942-e4ab-4b0f-a8ba-6dca3b3584b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '947b842f0b1e428286893d5f9353393a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:38.435389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-53cca942-e4ab-4b0f-a8ba-6dca3b3584b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '947b842f0b1e428286893d5f9353393a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:38.436211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-53cca942-e4ab-4b0f-a8ba-6dca3b3584b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '947b842f0b1e428286893d5f9353393a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:38.437137 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-53cca942-e4ab-4b0f-a8ba-6dca3b3584b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '947b842f0b1e428286893d5f9353393a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:38.449405 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-53cca942-e4ab-4b0f-a8ba-6dca3b3584b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '947b842f0b1e428286893d5f9353393a'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:38.461999 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1165/2342] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:26:38 2022] DELETE /identity/v3/users/947b842f0b1e428286893d5f9353393a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:26:38.685936 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb8cdf-5397-4b3e-a7ff-ce4b4d7cef48 service placement] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:26:38.697909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb8cdf-5397-4b3e-a7ff-ce4b4d7cef48 service placement] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:26:38.812473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:26:38.813806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:38.813806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:38.814051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7 admin admin] PATH_INFO: `/v3/projects/e942c28342514f5ca73cf47ac89022df` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:38.815049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e942c28342514f5ca73cf47ac89022df)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:26:38.816968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:26:38.855657 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:38.868342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e942c28342514f5ca73cf47ac89022df', 'request_id': 'req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:38.875698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e942c28342514f5ca73cf47ac89022df', 'request_id': 'req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:38.881475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e942c28342514f5ca73cf47ac89022df', 'request_id': 'req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:38.908367 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7 admin admin] The token cache is being invalidate because project e942c28342514f5ca73cf47ac89022df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:26:38.908920 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:38.909647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:38.911100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1178/2343] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:26:38 2022] DELETE /identity/v3/projects/e942c28342514f5ca73cf47ac89022df => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:26:38.915136 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cca942-e4ab-4b0f-a8ba-6dca3b3584b3 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:26:38.916711 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-53cca942-e4ab-4b0f-a8ba-6dca3b3584b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:38.977664 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cca942-e4ab-4b0f-a8ba-6dca3b3584b3 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:26:39.034085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027ac03-76bc-4604-af5c-5b1a0794832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:26:39.034972 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027ac03-76bc-4604-af5c-5b1a0794832a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:39.035250 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027ac03-76bc-4604-af5c-5b1a0794832a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:39.035527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027ac03-76bc-4604-af5c-5b1a0794832a admin admin] PATH_INFO: `/v3/users/eee03ed1e2144e5fa451a2f16da21bf2` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:39.036747 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027ac03-76bc-4604-af5c-5b1a0794832a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee03ed1e2144e5fa451a2f16da21bf2)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:26:39.038669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027ac03-76bc-4604-af5c-5b1a0794832a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:26:39.044051 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:39.092200 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a027ac03-76bc-4604-af5c-5b1a0794832a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee03ed1e2144e5fa451a2f16da21bf2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:39.100529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a027ac03-76bc-4604-af5c-5b1a0794832a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee03ed1e2144e5fa451a2f16da21bf2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:39.101483 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a027ac03-76bc-4604-af5c-5b1a0794832a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee03ed1e2144e5fa451a2f16da21bf2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:39.102108 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a027ac03-76bc-4604-af5c-5b1a0794832a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee03ed1e2144e5fa451a2f16da21bf2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:39.115487 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a027ac03-76bc-4604-af5c-5b1a0794832a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee03ed1e2144e5fa451a2f16da21bf2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:39.133477 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1166/2344] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:26:38 2022] DELETE /identity/v3/users/eee03ed1e2144e5fa451a2f16da21bf2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:26:39.333876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:26:39.335868 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:39.350091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a56acf-24b5-4d0f-9fd0-1f33cb11fdb7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:26:39.423003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84a753-6923-49a3-a209-42988a781572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:26:39.423955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84a753-6923-49a3-a209-42988a781572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:39.424292 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84a753-6923-49a3-a209-42988a781572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:39.424575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84a753-6923-49a3-a209-42988a781572 admin admin] PATH_INFO: `/v3/projects/177c2add29e249f7b9b48afdee52ee72` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:39.427243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84a753-6923-49a3-a209-42988a781572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=177c2add29e249f7b9b48afdee52ee72)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:26:39.427677 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84a753-6923-49a3-a209-42988a781572 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:26:39.480969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9f84a753-6923-49a3-a209-42988a781572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177c2add29e249f7b9b48afdee52ee72', 'request_id': 'req-9f84a753-6923-49a3-a209-42988a781572'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:39.488364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9f84a753-6923-49a3-a209-42988a781572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177c2add29e249f7b9b48afdee52ee72', 'request_id': 'req-9f84a753-6923-49a3-a209-42988a781572'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:39.495061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9f84a753-6923-49a3-a209-42988a781572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177c2add29e249f7b9b48afdee52ee72', 'request_id': 'req-9f84a753-6923-49a3-a209-42988a781572'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:39.510276 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9f84a753-6923-49a3-a209-42988a781572 admin admin] The token cache is being invalidate because project 177c2add29e249f7b9b48afdee52ee72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:26:39.510725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9f84a753-6923-49a3-a209-42988a781572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:39.511486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9f84a753-6923-49a3-a209-42988a781572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:26:39.513229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1179/2345] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:26:39 2022] DELETE /identity/v3/projects/177c2add29e249f7b9b48afdee52ee72 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:26:48.539393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8a1e5-38df-48f7-9877-831bda57f7c8 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:48.540545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8a1e5-38df-48f7-9877-831bda57f7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:48.540928 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8a1e5-38df-48f7-9877-831bda57f7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:48.562719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e1a8a1e5-38df-48f7-9877-831bda57f7c8 None None] MFA Rules not processed for user `6fa2cda90dc54933a3fe22880bebb478`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:26:48.564032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e1a8a1e5-38df-48f7-9877-831bda57f7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:48.622787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1167/2346] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:26:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:26:49.079084 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7907ce2-620b-4daa-aaab-1f50ef68f7a8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:49.079645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7907ce2-620b-4daa-aaab-1f50ef68f7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:49.079838 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7907ce2-620b-4daa-aaab-1f50ef68f7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:49.099346 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b7907ce2-620b-4daa-aaab-1f50ef68f7a8 None None] MFA Rules not processed for user `10c3b4f5766449c19198efc35dc80429`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:26:49.100579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b7907ce2-620b-4daa-aaab-1f50ef68f7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:49.140327 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:49.161334 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1180/2347] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:26:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:26:57.963848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8a1e5-38df-48f7-9877-831bda57f7c8 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:26:57.966201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e1a8a1e5-38df-48f7-9877-831bda57f7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:58.079996 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:58.108496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8a1e5-38df-48f7-9877-831bda57f7c8 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:26:58.113788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755bc00-a097-4214-a6ec-d725605aa928 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3474e40117440498f0fe99f743df50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:26:58.114453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755bc00-a097-4214-a6ec-d725605aa928 service placement] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:26:58.114737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755bc00-a097-4214-a6ec-d725605aa928 service placement] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:26:58.115016 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755bc00-a097-4214-a6ec-d725605aa928 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:26:58.118719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8755bc00-a097-4214-a6ec-d725605aa928 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:26:58.133955 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755bc00-a097-4214-a6ec-d725605aa928 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:26:58.135620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755bc00-a097-4214-a6ec-d725605aa928 service placement] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:26:58.146587 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1168/2348] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:26:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:26:59.153927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:08.141629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=8 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:21.771279 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7907ce2-620b-4daa-aaab-1f50ef68f7a8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:21.772796 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b7907ce2-620b-4daa-aaab-1f50ef68f7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:21.850740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7907ce2-620b-4daa-aaab-1f50ef68f7a8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:21.854257 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b600d2-5fdb-456b-b57c-1ff6e23b16a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:21.854895 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b600d2-5fdb-456b-b57c-1ff6e23b16a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:21.855180 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b600d2-5fdb-456b-b57c-1ff6e23b16a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:21.855455 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b600d2-5fdb-456b-b57c-1ff6e23b16a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:21.857254 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e9b600d2-5fdb-456b-b57c-1ff6e23b16a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:21.919320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b600d2-5fdb-456b-b57c-1ff6e23b16a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:21.920794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b600d2-5fdb-456b-b57c-1ff6e23b16a9 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:21.930715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1181/2349] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:27:25.277053 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755bc00-a097-4214-a6ec-d725605aa928 service placement] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:25.279327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8755bc00-a097-4214-a6ec-d725605aa928 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:25.299532 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755bc00-a097-4214-a6ec-d725605aa928 service placement] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:25.304447 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc397ff-da61-40d3-9149-8620855d7af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:25.305594 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc397ff-da61-40d3-9149-8620855d7af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:25.305881 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc397ff-da61-40d3-9149-8620855d7af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:25.306162 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc397ff-da61-40d3-9149-8620855d7af5 admin admin] PATH_INFO: `/v3/users/471739ee64504a6fa88d5d52eb0c1df4` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:25.307512 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc397ff-da61-40d3-9149-8620855d7af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=471739ee64504a6fa88d5d52eb0c1df4)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:25.309591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc397ff-da61-40d3-9149-8620855d7af5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:25.376547 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0bc397ff-da61-40d3-9149-8620855d7af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471739ee64504a6fa88d5d52eb0c1df4'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:25.386207 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0bc397ff-da61-40d3-9149-8620855d7af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471739ee64504a6fa88d5d52eb0c1df4'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:25.386997 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0bc397ff-da61-40d3-9149-8620855d7af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471739ee64504a6fa88d5d52eb0c1df4'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:25.387779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0bc397ff-da61-40d3-9149-8620855d7af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471739ee64504a6fa88d5d52eb0c1df4'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:25.406535 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0bc397ff-da61-40d3-9149-8620855d7af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471739ee64504a6fa88d5d52eb0c1df4'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:25.419576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1169/2350] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:27:25 2022] DELETE /identity/v3/users/471739ee64504a6fa88d5d52eb0c1df4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:25.600723 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b600d2-5fdb-456b-b57c-1ff6e23b16a9 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:25.613363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b600d2-5fdb-456b-b57c-1ff6e23b16a9 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:25.685591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21607a42-61df-455b-bfa9-6ecf2bd22bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:25.686485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21607a42-61df-455b-bfa9-6ecf2bd22bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:25.686769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21607a42-61df-455b-bfa9-6ecf2bd22bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:25.687127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21607a42-61df-455b-bfa9-6ecf2bd22bc9 admin admin] PATH_INFO: `/v3/projects/31cff479d29e46d5afd36dfb98a65aa2` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:25.688628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21607a42-61df-455b-bfa9-6ecf2bd22bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31cff479d29e46d5afd36dfb98a65aa2)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:25.690561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21607a42-61df-455b-bfa9-6ecf2bd22bc9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:25.731886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:25.745204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-21607a42-61df-455b-bfa9-6ecf2bd22bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31cff479d29e46d5afd36dfb98a65aa2', 'request_id': 'req-21607a42-61df-455b-bfa9-6ecf2bd22bc9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:25.752068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-21607a42-61df-455b-bfa9-6ecf2bd22bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31cff479d29e46d5afd36dfb98a65aa2', 'request_id': 'req-21607a42-61df-455b-bfa9-6ecf2bd22bc9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:25.758399 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-21607a42-61df-455b-bfa9-6ecf2bd22bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31cff479d29e46d5afd36dfb98a65aa2', 'request_id': 'req-21607a42-61df-455b-bfa9-6ecf2bd22bc9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:25.772572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-21607a42-61df-455b-bfa9-6ecf2bd22bc9 admin admin] The token cache is being invalidate because project 31cff479d29e46d5afd36dfb98a65aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:27:25.772842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-21607a42-61df-455b-bfa9-6ecf2bd22bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:25.773466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-21607a42-61df-455b-bfa9-6ecf2bd22bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:25.775714 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1182/2351] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:27:25 2022] DELETE /identity/v3/projects/31cff479d29e46d5afd36dfb98a65aa2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:25.781125 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f749be3-b2ca-41db-bda8-76a4270544d0 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:25.781415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f749be3-b2ca-41db-bda8-76a4270544d0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:25.781695 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f749be3-b2ca-41db-bda8-76a4270544d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:25.848989 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6f749be3-b2ca-41db-bda8-76a4270544d0 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:25.850244 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6f749be3-b2ca-41db-bda8-76a4270544d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:25.914014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1170/2352] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:27:25.922538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dd084-c426-418b-b438-79edd7bba05b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:25.922830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dd084-c426-418b-b438-79edd7bba05b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:25.923113 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dd084-c426-418b-b438-79edd7bba05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:25.944420 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ab7dd084-c426-418b-b438-79edd7bba05b None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:25.945672 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ab7dd084-c426-418b-b438-79edd7bba05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:25.954572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1183/2353] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:27:25.959202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f749be3-b2ca-41db-bda8-76a4270544d0 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:25.969559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f749be3-b2ca-41db-bda8-76a4270544d0 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:25.974863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16326cfd-c811-4084-9e0f-c60d6d0262b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:25.975571 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16326cfd-c811-4084-9e0f-c60d6d0262b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:25.975847 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16326cfd-c811-4084-9e0f-c60d6d0262b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:25.976121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16326cfd-c811-4084-9e0f-c60d6d0262b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:25.976912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16326cfd-c811-4084-9e0f-c60d6d0262b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:27:25.977225 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16326cfd-c811-4084-9e0f-c60d6d0262b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:25.978886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16326cfd-c811-4084-9e0f-c60d6d0262b2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:25.994906 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1171/2354] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:27:25.999693 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dd084-c426-418b-b438-79edd7bba05b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:26.010229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dd084-c426-418b-b438-79edd7bba05b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:26.015167 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df1ba9-8db6-4eec-85b7-fbb1bf0e17bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:26.015765 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df1ba9-8db6-4eec-85b7-fbb1bf0e17bb admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:26.016049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df1ba9-8db6-4eec-85b7-fbb1bf0e17bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:26.016358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df1ba9-8db6-4eec-85b7-fbb1bf0e17bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:26.017101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df1ba9-8db6-4eec-85b7-fbb1bf0e17bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:26.019043 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df1ba9-8db6-4eec-85b7-fbb1bf0e17bb admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:26.048320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1184/2355] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:27:25 2022] POST /identity/v3/projects => generated 407 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:27:26.052709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16326cfd-c811-4084-9e0f-c60d6d0262b2 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:26.063836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16326cfd-c811-4084-9e0f-c60d6d0262b2 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:26.094729 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:26.133689 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ddb2d-5a4a-4418-b7e8-ac2dca6c8245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:26.134395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ddb2d-5a4a-4418-b7e8-ac2dca6c8245 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:26.135263 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ddb2d-5a4a-4418-b7e8-ac2dca6c8245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:26.135543 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ddb2d-5a4a-4418-b7e8-ac2dca6c8245 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:26.136233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ddb2d-5a4a-4418-b7e8-ac2dca6c8245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:26.138265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ddb2d-5a4a-4418-b7e8-ac2dca6c8245 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:26.161845 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1172/2356] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:27:26 2022] POST /identity/v3/users => generated 304 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:27:26.167268 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df1ba9-8db6-4eec-85b7-fbb1bf0e17bb admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:26.178375 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df1ba9-8db6-4eec-85b7-fbb1bf0e17bb admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:26.185286 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee9c2a-f015-44b3-9dd4-754c0c7e16d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:26.185971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee9c2a-f015-44b3-9dd4-754c0c7e16d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:26.186255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee9c2a-f015-44b3-9dd4-754c0c7e16d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:26.186533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee9c2a-f015-44b3-9dd4-754c0c7e16d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:26.187267 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee9c2a-f015-44b3-9dd4-754c0c7e16d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:26.188959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee9c2a-f015-44b3-9dd4-754c0c7e16d7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:26.200086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1185/2357] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:27:26.204376 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ddb2d-5a4a-4418-b7e8-ac2dca6c8245 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:26.214845 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ddb2d-5a4a-4418-b7e8-ac2dca6c8245 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:26.219839 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631caf4c-dd12-4178-839a-c0a72e45a474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:26.220553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631caf4c-dd12-4178-839a-c0a72e45a474 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:26.220837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631caf4c-dd12-4178-839a-c0a72e45a474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:26.221115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631caf4c-dd12-4178-839a-c0a72e45a474 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:26.221839 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631caf4c-dd12-4178-839a-c0a72e45a474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:26.223469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631caf4c-dd12-4178-839a-c0a72e45a474 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:26.235005 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1173/2358] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:27:26.240604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee9c2a-f015-44b3-9dd4-754c0c7e16d7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:26.252373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee9c2a-f015-44b3-9dd4-754c0c7e16d7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:26.257115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6dfa39-2bab-4590-bbfa-cf34ec9b826b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:26.258005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dfa39-2bab-4590-bbfa-cf34ec9b826b admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:26.258283 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dfa39-2bab-4590-bbfa-cf34ec9b826b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:26.258551 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dfa39-2bab-4590-bbfa-cf34ec9b826b admin admin] PATH_INFO: `/v3/projects/18d9d9d6da7f4cc58639f6b80da6ca1b/users/6f371a5c072848248db3bd98c3f5f2e6/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:26.274088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6dfa39-2bab-4590-bbfa-cf34ec9b826b admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d9d9d6da7f4cc58639f6b80da6ca1b, user_id=6f371a5c072848248db3bd98c3f5f2e6, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:26.277032 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6dfa39-2bab-4590-bbfa-cf34ec9b826b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:26.292000 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1186/2359] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:27:26 2022] PUT /identity/v3/projects/18d9d9d6da7f4cc58639f6b80da6ca1b/users/6f371a5c072848248db3bd98c3f5f2e6/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:26.304165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba51395-7302-4a76-9f38-554922ab901a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:26.304747 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba51395-7302-4a76-9f38-554922ab901a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:26.304879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba51395-7302-4a76-9f38-554922ab901a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:26.345476 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-5ba51395-7302-4a76-9f38-554922ab901a None None] MFA Rules not processed for user `6f371a5c072848248db3bd98c3f5f2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:26.347191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5ba51395-7302-4a76-9f38-554922ab901a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:26.423289 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1174/2360] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:27:26.427938 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6dfa39-2bab-4590-bbfa-cf34ec9b826b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:26.493062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6dfa39-2bab-4590-bbfa-cf34ec9b826b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:26.498563 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a67d2-1c85-4ff0-8f85-b056f708e377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:26.499265 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a67d2-1c85-4ff0-8f85-b056f708e377 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:26.499548 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a67d2-1c85-4ff0-8f85-b056f708e377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:26.499822 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a67d2-1c85-4ff0-8f85-b056f708e377 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:26.500547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a67d2-1c85-4ff0-8f85-b056f708e377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:26.502496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a67d2-1c85-4ff0-8f85-b056f708e377 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:26.538417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1187/2361] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:27:26 2022] POST /identity/v3/projects => generated 409 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:27:26.545711 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba51395-7302-4a76-9f38-554922ab901a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:26.559728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba51395-7302-4a76-9f38-554922ab901a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:26.621917 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dec135-d73c-4d28-b539-ac65962376ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:26.622666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dec135-d73c-4d28-b539-ac65962376ef admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:26.622982 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dec135-d73c-4d28-b539-ac65962376ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:26.623288 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dec135-d73c-4d28-b539-ac65962376ef admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:26.624016 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dec135-d73c-4d28-b539-ac65962376ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:26.626100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dec135-d73c-4d28-b539-ac65962376ef admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:26.651273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1175/2362] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:27:26 2022] POST /identity/v3/users => generated 311 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:27:26.655717 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a67d2-1c85-4ff0-8f85-b056f708e377 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:26.667256 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a67d2-1c85-4ff0-8f85-b056f708e377 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:26.672059 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3949fa5-ab86-49ce-86c6-1f54a2efc3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:26.672771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949fa5-ab86-49ce-86c6-1f54a2efc3bf admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:26.673058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949fa5-ab86-49ce-86c6-1f54a2efc3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:26.673339 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949fa5-ab86-49ce-86c6-1f54a2efc3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:26.674074 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3949fa5-ab86-49ce-86c6-1f54a2efc3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:26.675682 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3949fa5-ab86-49ce-86c6-1f54a2efc3bf admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:26.687391 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1188/2363] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:27:26.691830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dec135-d73c-4d28-b539-ac65962376ef admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:26.702296 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dec135-d73c-4d28-b539-ac65962376ef admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:26.706956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a32218-aa71-4cdb-a515-080aa45d27cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:26.707848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a32218-aa71-4cdb-a515-080aa45d27cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:26.708132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a32218-aa71-4cdb-a515-080aa45d27cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:26.708441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a32218-aa71-4cdb-a515-080aa45d27cd admin admin] PATH_INFO: `/v3/projects/f5e606ef386647739da06f053b6479b8/users/27ad4335f85444418832020769781c15/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:26.727529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a32218-aa71-4cdb-a515-080aa45d27cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e606ef386647739da06f053b6479b8, user_id=27ad4335f85444418832020769781c15, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:26.731262 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a32218-aa71-4cdb-a515-080aa45d27cd admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:26.748426 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1176/2364] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:27:26 2022] PUT /identity/v3/projects/f5e606ef386647739da06f053b6479b8/users/27ad4335f85444418832020769781c15/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:27:26.752801 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3949fa5-ab86-49ce-86c6-1f54a2efc3bf admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:26.762829 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3949fa5-ab86-49ce-86c6-1f54a2efc3bf admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:26.798448 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:26.831084 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334f7c4-eb17-4bc8-b79f-f48c3f3178b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:26.831685 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334f7c4-eb17-4bc8-b79f-f48c3f3178b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:26.831970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334f7c4-eb17-4bc8-b79f-f48c3f3178b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:26.832386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334f7c4-eb17-4bc8-b79f-f48c3f3178b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:26.833017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334f7c4-eb17-4bc8-b79f-f48c3f3178b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:26.834632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334f7c4-eb17-4bc8-b79f-f48c3f3178b9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:26.847447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1189/2365] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:27:26.851694 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a32218-aa71-4cdb-a515-080aa45d27cd admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:26.857920 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:26.864562 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a32218-aa71-4cdb-a515-080aa45d27cd admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:26.869803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf60c8-62b0-4e92-bbcb-5f1fffe803de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:26.870711 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf60c8-62b0-4e92-bbcb-5f1fffe803de admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:26.870986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf60c8-62b0-4e92-bbcb-5f1fffe803de admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:26.871253 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf60c8-62b0-4e92-bbcb-5f1fffe803de admin admin] PATH_INFO: `/v3/projects/f5e606ef386647739da06f053b6479b8/users/27ad4335f85444418832020769781c15/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:26.873247 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf60c8-62b0-4e92-bbcb-5f1fffe803de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e606ef386647739da06f053b6479b8, user_id=27ad4335f85444418832020769781c15, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:26.875863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf60c8-62b0-4e92-bbcb-5f1fffe803de admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:26.887531 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1177/2366] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:27:26 2022] PUT /identity/v3/projects/f5e606ef386647739da06f053b6479b8/users/27ad4335f85444418832020769781c15/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:26.898019 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d912e-3e50-49a2-9eaf-f1f62c6ca3c2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:26.898316 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d912e-3e50-49a2-9eaf-f1f62c6ca3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:26.898597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d912e-3e50-49a2-9eaf-f1f62c6ca3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:26.931934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7f2d912e-3e50-49a2-9eaf-f1f62c6ca3c2 None None] MFA Rules not processed for user `27ad4335f85444418832020769781c15`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:26.933225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7f2d912e-3e50-49a2-9eaf-f1f62c6ca3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:27.010520 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1190/2367] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:26 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:27:27.022242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf60c8-62b0-4e92-bbcb-5f1fffe803de admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:27.024100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-65cf60c8-62b0-4e92-bbcb-5f1fffe803de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:27.111245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf60c8-62b0-4e92-bbcb-5f1fffe803de admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:27.115108 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58417e4e-dc1e-4c35-842d-67876882db67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:27.115759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58417e4e-dc1e-4c35-842d-67876882db67 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:27.116047 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58417e4e-dc1e-4c35-842d-67876882db67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:27.116352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58417e4e-dc1e-4c35-842d-67876882db67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:27.126264 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58417e4e-dc1e-4c35-842d-67876882db67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:27.127759 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58417e4e-dc1e-4c35-842d-67876882db67 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:27.138560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1178/2368] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:27:27 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:27:27.313714 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d912e-3e50-49a2-9eaf-f1f62c6ca3c2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:27.324113 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d912e-3e50-49a2-9eaf-f1f62c6ca3c2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:27.328512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5826f5d-706f-4da2-afc7-5e38c6badd09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:27.329180 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5826f5d-706f-4da2-afc7-5e38c6badd09 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:27.329463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5826f5d-706f-4da2-afc7-5e38c6badd09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:27.329768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5826f5d-706f-4da2-afc7-5e38c6badd09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:27.387576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5826f5d-706f-4da2-afc7-5e38c6badd09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:27.388938 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5826f5d-706f-4da2-afc7-5e38c6badd09 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:27.397688 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1191/2369] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:27:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:27:32.795516 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58417e4e-dc1e-4c35-842d-67876882db67 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:32.863345 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58417e4e-dc1e-4c35-842d-67876882db67 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:32.867850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed140130-98f8-42fc-b673-c667e4126238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:32.869266 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed140130-98f8-42fc-b673-c667e4126238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:32.869542 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed140130-98f8-42fc-b673-c667e4126238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:32.869810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed140130-98f8-42fc-b673-c667e4126238 admin admin] PATH_INFO: `/v3/users/6f371a5c072848248db3bd98c3f5f2e6` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:32.871038 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed140130-98f8-42fc-b673-c667e4126238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f371a5c072848248db3bd98c3f5f2e6)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:32.873050 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed140130-98f8-42fc-b673-c667e4126238 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:32.925778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ed140130-98f8-42fc-b673-c667e4126238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f371a5c072848248db3bd98c3f5f2e6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:32.934988 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ed140130-98f8-42fc-b673-c667e4126238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f371a5c072848248db3bd98c3f5f2e6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:32.935663 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ed140130-98f8-42fc-b673-c667e4126238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f371a5c072848248db3bd98c3f5f2e6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:32.936301 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ed140130-98f8-42fc-b673-c667e4126238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f371a5c072848248db3bd98c3f5f2e6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:32.949741 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ed140130-98f8-42fc-b673-c667e4126238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f371a5c072848248db3bd98c3f5f2e6'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:32.951964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:32.964708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1179/2370] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:27:32 2022] DELETE /identity/v3/users/6f371a5c072848248db3bd98c3f5f2e6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:32.969331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84bac8-3950-438e-91a3-df583b94d408 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:32.969930 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84bac8-3950-438e-91a3-df583b94d408 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:32.969930 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84bac8-3950-438e-91a3-df583b94d408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:32.989715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ab84bac8-3950-438e-91a3-df583b94d408 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:32.990932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ab84bac8-3950-438e-91a3-df583b94d408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:33.065081 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:33.089002 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1192/2371] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:27:33.100949 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed140130-98f8-42fc-b673-c667e4126238 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:33.102458 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ed140130-98f8-42fc-b673-c667e4126238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:33.168743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed140130-98f8-42fc-b673-c667e4126238 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:33.172354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f6c00-bccb-4bf2-895d-43f34c6992b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:33.173029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f6c00-bccb-4bf2-895d-43f34c6992b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:33.173310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f6c00-bccb-4bf2-895d-43f34c6992b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:33.173579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f6c00-bccb-4bf2-895d-43f34c6992b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:33.184467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f6c00-bccb-4bf2-895d-43f34c6992b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:33.185962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f6c00-bccb-4bf2-895d-43f34c6992b2 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:33.197006 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1180/2372] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:27:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:27:33.538518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84bac8-3950-438e-91a3-df583b94d408 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:33.540075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ab84bac8-3950-438e-91a3-df583b94d408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:33.553677 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84bac8-3950-438e-91a3-df583b94d408 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:33.560280 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae725a8-3e4f-4d80-a6c8-086c3855a579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:33.561183 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae725a8-3e4f-4d80-a6c8-086c3855a579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:33.561470 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae725a8-3e4f-4d80-a6c8-086c3855a579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:33.561747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae725a8-3e4f-4d80-a6c8-086c3855a579 admin admin] PATH_INFO: `/v3/projects/18d9d9d6da7f4cc58639f6b80da6ca1b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:33.563028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae725a8-3e4f-4d80-a6c8-086c3855a579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d9d9d6da7f4cc58639f6b80da6ca1b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:33.565045 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae725a8-3e4f-4d80-a6c8-086c3855a579 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:33.621475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4ae725a8-3e4f-4d80-a6c8-086c3855a579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d9d9d6da7f4cc58639f6b80da6ca1b', 'request_id': 'req-4ae725a8-3e4f-4d80-a6c8-086c3855a579'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:33.628384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4ae725a8-3e4f-4d80-a6c8-086c3855a579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d9d9d6da7f4cc58639f6b80da6ca1b', 'request_id': 'req-4ae725a8-3e4f-4d80-a6c8-086c3855a579'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:33.634644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4ae725a8-3e4f-4d80-a6c8-086c3855a579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d9d9d6da7f4cc58639f6b80da6ca1b', 'request_id': 'req-4ae725a8-3e4f-4d80-a6c8-086c3855a579'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:33.651023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4ae725a8-3e4f-4d80-a6c8-086c3855a579 admin admin] The token cache is being invalidate because project 18d9d9d6da7f4cc58639f6b80da6ca1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:27:33.651311 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4ae725a8-3e4f-4d80-a6c8-086c3855a579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:33.651991 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4ae725a8-3e4f-4d80-a6c8-086c3855a579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:33.653651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1193/2373] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:27:33 2022] DELETE /identity/v3/projects/18d9d9d6da7f4cc58639f6b80da6ca1b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:33.658671 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f6c00-bccb-4bf2-895d-43f34c6992b2 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:33.677518 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f6c00-bccb-4bf2-895d-43f34c6992b2 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:33.749476 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d7b47-7aca-41f2-8a7c-270a5302a1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:33.750377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7b47-7aca-41f2-8a7c-270a5302a1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:33.750655 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7b47-7aca-41f2-8a7c-270a5302a1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:33.750928 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7b47-7aca-41f2-8a7c-270a5302a1fd admin admin] PATH_INFO: `/v3/users/27ad4335f85444418832020769781c15` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:33.752299 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d7b47-7aca-41f2-8a7c-270a5302a1fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ad4335f85444418832020769781c15)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:33.754284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d7b47-7aca-41f2-8a7c-270a5302a1fd admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:33.814706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-001d7b47-7aca-41f2-8a7c-270a5302a1fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ad4335f85444418832020769781c15'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:33.828462 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-001d7b47-7aca-41f2-8a7c-270a5302a1fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ad4335f85444418832020769781c15'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:33.829233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-001d7b47-7aca-41f2-8a7c-270a5302a1fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ad4335f85444418832020769781c15'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:33.829859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-001d7b47-7aca-41f2-8a7c-270a5302a1fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ad4335f85444418832020769781c15'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:33.845652 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-001d7b47-7aca-41f2-8a7c-270a5302a1fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ad4335f85444418832020769781c15'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:33.861219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1181/2374] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:27:33 2022] DELETE /identity/v3/users/27ad4335f85444418832020769781c15 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:34.280692 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae725a8-3e4f-4d80-a6c8-086c3855a579 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:34.282579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4ae725a8-3e4f-4d80-a6c8-086c3855a579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:34.306756 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae725a8-3e4f-4d80-a6c8-086c3855a579 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:34.382303 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9be61-43f5-43f8-b399-ecb4968ecc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:34.383265 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9be61-43f5-43f8-b399-ecb4968ecc23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:34.383725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9be61-43f5-43f8-b399-ecb4968ecc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:34.384101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9be61-43f5-43f8-b399-ecb4968ecc23 admin admin] PATH_INFO: `/v3/projects/f5e606ef386647739da06f053b6479b8` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:34.385587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9be61-43f5-43f8-b399-ecb4968ecc23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e606ef386647739da06f053b6479b8)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:34.387523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9be61-43f5-43f8-b399-ecb4968ecc23 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:34.443719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47a9be61-43f5-43f8-b399-ecb4968ecc23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e606ef386647739da06f053b6479b8', 'request_id': 'req-47a9be61-43f5-43f8-b399-ecb4968ecc23'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:34.451025 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47a9be61-43f5-43f8-b399-ecb4968ecc23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e606ef386647739da06f053b6479b8', 'request_id': 'req-47a9be61-43f5-43f8-b399-ecb4968ecc23'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:34.457027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47a9be61-43f5-43f8-b399-ecb4968ecc23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e606ef386647739da06f053b6479b8', 'request_id': 'req-47a9be61-43f5-43f8-b399-ecb4968ecc23'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:34.472121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47a9be61-43f5-43f8-b399-ecb4968ecc23 admin admin] The token cache is being invalidate because project f5e606ef386647739da06f053b6479b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:27:34.472478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47a9be61-43f5-43f8-b399-ecb4968ecc23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:34.473115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47a9be61-43f5-43f8-b399-ecb4968ecc23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:34.474670 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1194/2375] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:27:34 2022] DELETE /identity/v3/projects/f5e606ef386647739da06f053b6479b8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:27:34.479994 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec03ee9-d279-4dc0-bb7a-72bc138dcbd4 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:34.480313 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec03ee9-d279-4dc0-bb7a-72bc138dcbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:34.480590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec03ee9-d279-4dc0-bb7a-72bc138dcbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:34.501448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-bec03ee9-d279-4dc0-bb7a-72bc138dcbd4 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:34.502707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bec03ee9-d279-4dc0-bb7a-72bc138dcbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:34.513471 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:34.579000 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1182/2376] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:27:34.591562 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a26c6-52fe-4923-aae6-67857879d69e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:34.592172 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a26c6-52fe-4923-aae6-67857879d69e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:34.592732 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a26c6-52fe-4923-aae6-67857879d69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:34.608607 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:34.627611 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-261a26c6-52fe-4923-aae6-67857879d69e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:34.630027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-261a26c6-52fe-4923-aae6-67857879d69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:34.640131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1195/2377] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:27:34.644889 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec03ee9-d279-4dc0-bb7a-72bc138dcbd4 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:34.656003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec03ee9-d279-4dc0-bb7a-72bc138dcbd4 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:34.661389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9724be2-a8ab-4ccc-a951-4fc0b1514d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:34.662087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724be2-a8ab-4ccc-a951-4fc0b1514d82 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:34.662377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724be2-a8ab-4ccc-a951-4fc0b1514d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:34.662657 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724be2-a8ab-4ccc-a951-4fc0b1514d82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:34.663412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9724be2-a8ab-4ccc-a951-4fc0b1514d82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:27:34.663725 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9724be2-a8ab-4ccc-a951-4fc0b1514d82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:34.665477 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9724be2-a8ab-4ccc-a951-4fc0b1514d82 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:34.679777 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1183/2378] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:27:34.685491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a26c6-52fe-4923-aae6-67857879d69e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:34.695441 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a26c6-52fe-4923-aae6-67857879d69e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:34.701156 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6ce0d-ff21-45a4-99cb-67baaa6f11bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:34.701855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6ce0d-ff21-45a4-99cb-67baaa6f11bd admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:34.702138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6ce0d-ff21-45a4-99cb-67baaa6f11bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:34.702416 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6ce0d-ff21-45a4-99cb-67baaa6f11bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:34.703141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6ce0d-ff21-45a4-99cb-67baaa6f11bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:34.705161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6ce0d-ff21-45a4-99cb-67baaa6f11bd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:34.735797 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1196/2379] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:27:34 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:27:34.740223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9724be2-a8ab-4ccc-a951-4fc0b1514d82 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:34.751447 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9724be2-a8ab-4ccc-a951-4fc0b1514d82 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:34.814169 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f33294-c6f6-4426-9a59-84130450df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:34.814852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f33294-c6f6-4426-9a59-84130450df78 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:34.815436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f33294-c6f6-4426-9a59-84130450df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:34.815436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f33294-c6f6-4426-9a59-84130450df78 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:34.816094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f33294-c6f6-4426-9a59-84130450df78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:34.818072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f33294-c6f6-4426-9a59-84130450df78 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:34.841807 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1184/2380] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:27:34 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:27:34.845931 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6ce0d-ff21-45a4-99cb-67baaa6f11bd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:34.857384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6ce0d-ff21-45a4-99cb-67baaa6f11bd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:34.862615 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9db70-891c-497a-971e-b0b0b30765b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:34.863497 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9db70-891c-497a-971e-b0b0b30765b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:34.863726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9db70-891c-497a-971e-b0b0b30765b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:34.864037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9db70-891c-497a-971e-b0b0b30765b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:34.864751 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9db70-891c-497a-971e-b0b0b30765b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:34.866359 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9db70-891c-497a-971e-b0b0b30765b8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:34.877539 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1197/2381] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:27:34.881825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f33294-c6f6-4426-9a59-84130450df78 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:34.892742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f33294-c6f6-4426-9a59-84130450df78 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:34.897610 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea2b2a-a3a2-4e44-9e86-a49a3cf11442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:34.898287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea2b2a-a3a2-4e44-9e86-a49a3cf11442 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:34.898569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea2b2a-a3a2-4e44-9e86-a49a3cf11442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:34.898845 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea2b2a-a3a2-4e44-9e86-a49a3cf11442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:34.899574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea2b2a-a3a2-4e44-9e86-a49a3cf11442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:34.902691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea2b2a-a3a2-4e44-9e86-a49a3cf11442 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:34.914768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1185/2382] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:27:34.920084 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9db70-891c-497a-971e-b0b0b30765b8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:34.931239 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9db70-891c-497a-971e-b0b0b30765b8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:34.936645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54254f47-2d74-4095-88f6-f51a47c20a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:34.937596 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54254f47-2d74-4095-88f6-f51a47c20a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:34.937877 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54254f47-2d74-4095-88f6-f51a47c20a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:34.938152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54254f47-2d74-4095-88f6-f51a47c20a00 admin admin] PATH_INFO: `/v3/projects/fe6c6ffce0f340deb8d9f250a138243a/users/604ff19e97374c408a41cdcf492d3340/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:34.957031 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54254f47-2d74-4095-88f6-f51a47c20a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6c6ffce0f340deb8d9f250a138243a, user_id=604ff19e97374c408a41cdcf492d3340, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:34.959943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54254f47-2d74-4095-88f6-f51a47c20a00 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:34.976830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1198/2383] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:27:34 2022] PUT /identity/v3/projects/fe6c6ffce0f340deb8d9f250a138243a/users/604ff19e97374c408a41cdcf492d3340/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:27:34.988991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf135-4333-473c-95c0-9db7017d1b5a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:34.989465 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf135-4333-473c-95c0-9db7017d1b5a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:34.989639 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf135-4333-473c-95c0-9db7017d1b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:35.020863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-89caf135-4333-473c-95c0-9db7017d1b5a None None] MFA Rules not processed for user `604ff19e97374c408a41cdcf492d3340`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:35.022117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-89caf135-4333-473c-95c0-9db7017d1b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:35.099909 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1186/2384] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:27:35.107736 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54254f47-2d74-4095-88f6-f51a47c20a00 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:35.220055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54254f47-2d74-4095-88f6-f51a47c20a00 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:35.227651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed7d97-dbc9-4331-bf5c-3f947dd3ea31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:35.228387 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed7d97-dbc9-4331-bf5c-3f947dd3ea31 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:35.228700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed7d97-dbc9-4331-bf5c-3f947dd3ea31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:35.228989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed7d97-dbc9-4331-bf5c-3f947dd3ea31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:35.229732 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed7d97-dbc9-4331-bf5c-3f947dd3ea31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:35.231819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed7d97-dbc9-4331-bf5c-3f947dd3ea31 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:35.278572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1199/2385] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:27:35 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:27:35.283070 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caf135-4333-473c-95c0-9db7017d1b5a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:35.295579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caf135-4333-473c-95c0-9db7017d1b5a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:35.301216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:35.367332 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a69b1-2127-427e-8dc6-e1a389e82ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:35.367930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a69b1-2127-427e-8dc6-e1a389e82ffa admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:35.368213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a69b1-2127-427e-8dc6-e1a389e82ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:35.368515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a69b1-2127-427e-8dc6-e1a389e82ffa admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:35.369220 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a69b1-2127-427e-8dc6-e1a389e82ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:35.371199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a69b1-2127-427e-8dc6-e1a389e82ffa admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:35.401231 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1187/2386] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:27:35 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:27:35.403134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed7d97-dbc9-4331-bf5c-3f947dd3ea31 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:35.414608 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed7d97-dbc9-4331-bf5c-3f947dd3ea31 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:35.420414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071663a6-c9f9-4577-a031-0c7086690409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:35.421115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071663a6-c9f9-4577-a031-0c7086690409 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:35.421413 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071663a6-c9f9-4577-a031-0c7086690409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:35.421679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071663a6-c9f9-4577-a031-0c7086690409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:35.422416 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071663a6-c9f9-4577-a031-0c7086690409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:35.424066 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071663a6-c9f9-4577-a031-0c7086690409 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:35.436951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1200/2387] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:27:35.442451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a69b1-2127-427e-8dc6-e1a389e82ffa admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:35.453630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a69b1-2127-427e-8dc6-e1a389e82ffa admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:35.458545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069585ce-34d7-4966-b7b8-908e3bb53787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:35.459238 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069585ce-34d7-4966-b7b8-908e3bb53787 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:35.459521 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069585ce-34d7-4966-b7b8-908e3bb53787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:35.459796 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069585ce-34d7-4966-b7b8-908e3bb53787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:35.460573 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069585ce-34d7-4966-b7b8-908e3bb53787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:35.462316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069585ce-34d7-4966-b7b8-908e3bb53787 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:35.473963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1188/2388] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:27:35.479795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071663a6-c9f9-4577-a031-0c7086690409 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:35.490642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071663a6-c9f9-4577-a031-0c7086690409 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:35.496038 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39566ec-47b6-43c0-830c-891d89617ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:35.497062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39566ec-47b6-43c0-830c-891d89617ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:35.497356 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39566ec-47b6-43c0-830c-891d89617ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:35.497624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39566ec-47b6-43c0-830c-891d89617ec0 admin admin] PATH_INFO: `/v3/projects/e9599216b7ef4792ad0fb7bd96a542af/users/f4c909eca14a4a7490f8f093fdece06e/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:35.516449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39566ec-47b6-43c0-830c-891d89617ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9599216b7ef4792ad0fb7bd96a542af, user_id=f4c909eca14a4a7490f8f093fdece06e, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:35.519136 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39566ec-47b6-43c0-830c-891d89617ec0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:35.535125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1201/2389] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:27:35 2022] PUT /identity/v3/projects/e9599216b7ef4792ad0fb7bd96a542af/users/f4c909eca14a4a7490f8f093fdece06e/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:35.546298 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767ac29-40e5-4360-820d-96e8d3620181 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:35.546623 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767ac29-40e5-4360-820d-96e8d3620181 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:35.546886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767ac29-40e5-4360-820d-96e8d3620181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:35.579885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6767ac29-40e5-4360-820d-96e8d3620181 None None] MFA Rules not processed for user `f4c909eca14a4a7490f8f093fdece06e`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:35.581414 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6767ac29-40e5-4360-820d-96e8d3620181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:35.659539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1189/2390] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:27:35.664129 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39566ec-47b6-43c0-830c-891d89617ec0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:35.720902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:35.735197 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39566ec-47b6-43c0-830c-891d89617ec0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:35.740312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13d758-a683-4b50-959c-830fc6ba78d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:35.740987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13d758-a683-4b50-959c-830fc6ba78d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:35.741486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13d758-a683-4b50-959c-830fc6ba78d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:35.741614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13d758-a683-4b50-959c-830fc6ba78d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:35.742287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13d758-a683-4b50-959c-830fc6ba78d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:35.744303 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13d758-a683-4b50-959c-830fc6ba78d0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:35.773699 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1202/2391] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:27:35 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:27:35.780773 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767ac29-40e5-4360-820d-96e8d3620181 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:35.793590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767ac29-40e5-4360-820d-96e8d3620181 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:35.854300 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a11c8-5092-415d-941f-4d18af204da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:35.855060 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a11c8-5092-415d-941f-4d18af204da5 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:35.855260 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a11c8-5092-415d-941f-4d18af204da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:35.855533 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a11c8-5092-415d-941f-4d18af204da5 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:35.856231 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a11c8-5092-415d-941f-4d18af204da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:35.858211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a11c8-5092-415d-941f-4d18af204da5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:35.881878 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1190/2392] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:27:35 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:27:35.887984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13d758-a683-4b50-959c-830fc6ba78d0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:35.905665 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13d758-a683-4b50-959c-830fc6ba78d0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:35.913807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e172c8-1df5-4fb4-928c-eea18f367581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:35.914891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e172c8-1df5-4fb4-928c-eea18f367581 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:35.915373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e172c8-1df5-4fb4-928c-eea18f367581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:35.915855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e172c8-1df5-4fb4-928c-eea18f367581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:35.917262 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e172c8-1df5-4fb4-928c-eea18f367581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:35.920402 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e172c8-1df5-4fb4-928c-eea18f367581 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:35.941017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1203/2393] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:27:35.945615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a11c8-5092-415d-941f-4d18af204da5 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:35.957434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a11c8-5092-415d-941f-4d18af204da5 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:35.963358 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d30b6-c64d-4f2f-9be1-650b0ad3f132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:35.964360 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d30b6-c64d-4f2f-9be1-650b0ad3f132 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:35.964649 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d30b6-c64d-4f2f-9be1-650b0ad3f132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:35.964924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d30b6-c64d-4f2f-9be1-650b0ad3f132 admin admin] PATH_INFO: `/v3/projects/77b7b95659124640a7153d47350ecb82/users/cde20ba7e91d4efe92fa1ce0cea2e41e/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:35.967718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:35.984135 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d30b6-c64d-4f2f-9be1-650b0ad3f132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b7b95659124640a7153d47350ecb82, user_id=cde20ba7e91d4efe92fa1ce0cea2e41e, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:35.986865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d30b6-c64d-4f2f-9be1-650b0ad3f132 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:36.002240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1191/2394] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:27:35 2022] PUT /identity/v3/projects/77b7b95659124640a7153d47350ecb82/users/cde20ba7e91d4efe92fa1ce0cea2e41e/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:36.008444 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e172c8-1df5-4fb4-928c-eea18f367581 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:36.021594 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e172c8-1df5-4fb4-928c-eea18f367581 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:36.083111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f150b61-b0b8-4ec2-a848-d42f45bed243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:36.083796 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f150b61-b0b8-4ec2-a848-d42f45bed243 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:36.084080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f150b61-b0b8-4ec2-a848-d42f45bed243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:36.084390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f150b61-b0b8-4ec2-a848-d42f45bed243 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:36.085129 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f150b61-b0b8-4ec2-a848-d42f45bed243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:36.086755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f150b61-b0b8-4ec2-a848-d42f45bed243 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:36.098215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1204/2395] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:27:36.103643 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d30b6-c64d-4f2f-9be1-650b0ad3f132 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:36.118199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d30b6-c64d-4f2f-9be1-650b0ad3f132 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:36.123139 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ec64c-23f0-4406-888c-7a49225b07d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:36.124181 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec64c-23f0-4406-888c-7a49225b07d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:36.124506 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec64c-23f0-4406-888c-7a49225b07d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:36.124788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec64c-23f0-4406-888c-7a49225b07d8 admin admin] PATH_INFO: `/v3/projects/77b7b95659124640a7153d47350ecb82/users/cde20ba7e91d4efe92fa1ce0cea2e41e/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:36.126910 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ec64c-23f0-4406-888c-7a49225b07d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b7b95659124640a7153d47350ecb82, user_id=cde20ba7e91d4efe92fa1ce0cea2e41e, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:36.129650 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ec64c-23f0-4406-888c-7a49225b07d8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:36.142164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1192/2396] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:27:36 2022] PUT /identity/v3/projects/77b7b95659124640a7153d47350ecb82/users/cde20ba7e91d4efe92fa1ce0cea2e41e/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:36.154289 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861ca37-1994-421e-82b9-3e20179edd4d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:36.154579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861ca37-1994-421e-82b9-3e20179edd4d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:36.154886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861ca37-1994-421e-82b9-3e20179edd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:36.193146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5861ca37-1994-421e-82b9-3e20179edd4d None None] MFA Rules not processed for user `cde20ba7e91d4efe92fa1ce0cea2e41e`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:36.194391 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5861ca37-1994-421e-82b9-3e20179edd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:36.270853 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1205/2397] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:27:36.284450 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ec64c-23f0-4406-888c-7a49225b07d8 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:36.286503 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0c6ec64c-23f0-4406-888c-7a49225b07d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:36.401275 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ec64c-23f0-4406-888c-7a49225b07d8 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:36.407691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f4a6a-e745-4af2-90f3-626c1be536fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:36.409145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f4a6a-e745-4af2-90f3-626c1be536fd service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:36.409652 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f4a6a-e745-4af2-90f3-626c1be536fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:36.410148 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f4a6a-e745-4af2-90f3-626c1be536fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:36.427813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f4a6a-e745-4af2-90f3-626c1be536fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:36.431687 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f4a6a-e745-4af2-90f3-626c1be536fd service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:36.452009 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1193/2398] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:27:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:27:36.506169 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861ca37-1994-421e-82b9-3e20179edd4d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:36.507894 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5861ca37-1994-421e-82b9-3e20179edd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:36.521572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861ca37-1994-421e-82b9-3e20179edd4d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:36.526558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1842a32-8dcb-4b6d-ac5b-a9d79cb7a41c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:36.527448 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1842a32-8dcb-4b6d-ac5b-a9d79cb7a41c service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:36.527832 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1842a32-8dcb-4b6d-ac5b-a9d79cb7a41c service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:36.528205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1842a32-8dcb-4b6d-ac5b-a9d79cb7a41c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:36.586052 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:36.610927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1842a32-8dcb-4b6d-ac5b-a9d79cb7a41c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:36.613879 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1842a32-8dcb-4b6d-ac5b-a9d79cb7a41c service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:36.631628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1206/2399] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:27:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:27:39.605402 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f4a6a-e745-4af2-90f3-626c1be536fd service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:39.672198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f4a6a-e745-4af2-90f3-626c1be536fd service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:39.676861 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f89520-af88-40c8-b9d9-b662ec7fa2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:39.677743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f89520-af88-40c8-b9d9-b662ec7fa2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:39.678029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f89520-af88-40c8-b9d9-b662ec7fa2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:39.678309 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f89520-af88-40c8-b9d9-b662ec7fa2b6 admin admin] PATH_INFO: `/v3/users/604ff19e97374c408a41cdcf492d3340` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:39.679493 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f89520-af88-40c8-b9d9-b662ec7fa2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=604ff19e97374c408a41cdcf492d3340)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:39.682066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f89520-af88-40c8-b9d9-b662ec7fa2b6 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:39.728677 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-96f89520-af88-40c8-b9d9-b662ec7fa2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '604ff19e97374c408a41cdcf492d3340'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:39.736203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-96f89520-af88-40c8-b9d9-b662ec7fa2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '604ff19e97374c408a41cdcf492d3340'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:39.736880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-96f89520-af88-40c8-b9d9-b662ec7fa2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '604ff19e97374c408a41cdcf492d3340'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:39.737498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-96f89520-af88-40c8-b9d9-b662ec7fa2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '604ff19e97374c408a41cdcf492d3340'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:39.750504 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-96f89520-af88-40c8-b9d9-b662ec7fa2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '604ff19e97374c408a41cdcf492d3340'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:39.752695 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:39.768843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1194/2400] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:27:39 2022] DELETE /identity/v3/users/604ff19e97374c408a41cdcf492d3340 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:27:39.773505 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64241f-92c2-47d9-b50b-da34f34612f6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:39.774169 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64241f-92c2-47d9-b50b-da34f34612f6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:39.774169 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64241f-92c2-47d9-b50b-da34f34612f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:39.796282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7c64241f-92c2-47d9-b50b-da34f34612f6 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:39.797506 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7c64241f-92c2-47d9-b50b-da34f34612f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:39.858620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1207/2401] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:27:39.869223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f89520-af88-40c8-b9d9-b662ec7fa2b6 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:39.870990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-96f89520-af88-40c8-b9d9-b662ec7fa2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:39.932849 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f89520-af88-40c8-b9d9-b662ec7fa2b6 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:39.936480 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea50586-704f-4e9f-a30b-b129568144ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:39.937156 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea50586-704f-4e9f-a30b-b129568144ea service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:39.937435 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea50586-704f-4e9f-a30b-b129568144ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:39.937709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea50586-704f-4e9f-a30b-b129568144ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:39.947171 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea50586-704f-4e9f-a30b-b129568144ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:39.948644 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea50586-704f-4e9f-a30b-b129568144ea service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:39.958516 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1195/2402] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:27:40.245872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64241f-92c2-47d9-b50b-da34f34612f6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:40.247374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7c64241f-92c2-47d9-b50b-da34f34612f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:40.259542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64241f-92c2-47d9-b50b-da34f34612f6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:40.264621 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d01418-1e29-4b05-a681-39b1f97bb072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:40.265495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d01418-1e29-4b05-a681-39b1f97bb072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:40.265826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d01418-1e29-4b05-a681-39b1f97bb072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:40.266057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d01418-1e29-4b05-a681-39b1f97bb072 admin admin] PATH_INFO: `/v3/projects/fe6c6ffce0f340deb8d9f250a138243a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:40.267324 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d01418-1e29-4b05-a681-39b1f97bb072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6c6ffce0f340deb8d9f250a138243a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:40.269456 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d01418-1e29-4b05-a681-39b1f97bb072 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:40.319239 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-57d01418-1e29-4b05-a681-39b1f97bb072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6c6ffce0f340deb8d9f250a138243a', 'request_id': 'req-57d01418-1e29-4b05-a681-39b1f97bb072'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:40.325433 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-57d01418-1e29-4b05-a681-39b1f97bb072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6c6ffce0f340deb8d9f250a138243a', 'request_id': 'req-57d01418-1e29-4b05-a681-39b1f97bb072'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:40.332532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-57d01418-1e29-4b05-a681-39b1f97bb072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6c6ffce0f340deb8d9f250a138243a', 'request_id': 'req-57d01418-1e29-4b05-a681-39b1f97bb072'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:40.345982 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-57d01418-1e29-4b05-a681-39b1f97bb072 admin admin] The token cache is being invalidate because project fe6c6ffce0f340deb8d9f250a138243a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:27:40.346275 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-57d01418-1e29-4b05-a681-39b1f97bb072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:40.346950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-57d01418-1e29-4b05-a681-39b1f97bb072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:40.348494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1208/2403] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:27:40 2022] DELETE /identity/v3/projects/fe6c6ffce0f340deb8d9f250a138243a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:40.352523 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea50586-704f-4e9f-a30b-b129568144ea service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:40.362908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea50586-704f-4e9f-a30b-b129568144ea service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:40.418885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ff103-7c35-488d-b188-f0b6aa49a0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:40.419757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff103-7c35-488d-b188-f0b6aa49a0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:40.420153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff103-7c35-488d-b188-f0b6aa49a0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:40.420455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff103-7c35-488d-b188-f0b6aa49a0aa admin admin] PATH_INFO: `/v3/users/f4c909eca14a4a7490f8f093fdece06e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:40.421648 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ff103-7c35-488d-b188-f0b6aa49a0aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4c909eca14a4a7490f8f093fdece06e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:40.423549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ff103-7c35-488d-b188-f0b6aa49a0aa admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:40.469893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-023ff103-7c35-488d-b188-f0b6aa49a0aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4c909eca14a4a7490f8f093fdece06e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:40.478561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-023ff103-7c35-488d-b188-f0b6aa49a0aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4c909eca14a4a7490f8f093fdece06e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:40.479309 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-023ff103-7c35-488d-b188-f0b6aa49a0aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4c909eca14a4a7490f8f093fdece06e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:40.480062 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-023ff103-7c35-488d-b188-f0b6aa49a0aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4c909eca14a4a7490f8f093fdece06e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:40.495371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-023ff103-7c35-488d-b188-f0b6aa49a0aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4c909eca14a4a7490f8f093fdece06e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:40.510490 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1196/2404] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:27:40 2022] DELETE /identity/v3/users/f4c909eca14a4a7490f8f093fdece06e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:40.781607 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d01418-1e29-4b05-a681-39b1f97bb072 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:40.783096 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-57d01418-1e29-4b05-a681-39b1f97bb072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:40.801322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d01418-1e29-4b05-a681-39b1f97bb072 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:40.858902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:40.859677 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:40.859955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:40.860233 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2 admin admin] PATH_INFO: `/v3/projects/e9599216b7ef4792ad0fb7bd96a542af` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:40.861424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9599216b7ef4792ad0fb7bd96a542af)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:40.863310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:40.874511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:40.912427 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9599216b7ef4792ad0fb7bd96a542af', 'request_id': 'req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:40.918481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9599216b7ef4792ad0fb7bd96a542af', 'request_id': 'req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:40.924027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9599216b7ef4792ad0fb7bd96a542af', 'request_id': 'req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:40.936303 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2 admin admin] The token cache is being invalidate because project e9599216b7ef4792ad0fb7bd96a542af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:27:40.936595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:40.937209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:40.938728 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1209/2405] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:27:40 2022] DELETE /identity/v3/projects/e9599216b7ef4792ad0fb7bd96a542af => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:40.942814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ff103-7c35-488d-b188-f0b6aa49a0aa admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:40.944214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-023ff103-7c35-488d-b188-f0b6aa49a0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:40.957314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ff103-7c35-488d-b188-f0b6aa49a0aa admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:40.965934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:41.015179 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded4472-7dd0-42c0-9ceb-a64e7e33963b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:41.016060 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded4472-7dd0-42c0-9ceb-a64e7e33963b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:41.016375 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded4472-7dd0-42c0-9ceb-a64e7e33963b admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:41.016661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded4472-7dd0-42c0-9ceb-a64e7e33963b admin admin] PATH_INFO: `/v3/users/cde20ba7e91d4efe92fa1ce0cea2e41e` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:41.017822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded4472-7dd0-42c0-9ceb-a64e7e33963b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde20ba7e91d4efe92fa1ce0cea2e41e)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:41.019776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded4472-7dd0-42c0-9ceb-a64e7e33963b admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:41.066450 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-cded4472-7dd0-42c0-9ceb-a64e7e33963b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde20ba7e91d4efe92fa1ce0cea2e41e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:41.074655 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-cded4472-7dd0-42c0-9ceb-a64e7e33963b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde20ba7e91d4efe92fa1ce0cea2e41e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:41.075470 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-cded4472-7dd0-42c0-9ceb-a64e7e33963b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde20ba7e91d4efe92fa1ce0cea2e41e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:41.076129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-cded4472-7dd0-42c0-9ceb-a64e7e33963b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde20ba7e91d4efe92fa1ce0cea2e41e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:41.090290 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-cded4472-7dd0-42c0-9ceb-a64e7e33963b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde20ba7e91d4efe92fa1ce0cea2e41e'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:41.103346 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1197/2406] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:27:40 2022] DELETE /identity/v3/users/cde20ba7e91d4efe92fa1ce0cea2e41e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:41.381099 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:41.382709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:41.398684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210dc88-7bc7-400a-9276-8e8b57f5d1e2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:41.492676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa39399-b322-4c38-9547-4af7f3dca625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:41.493571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa39399-b322-4c38-9547-4af7f3dca625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:41.493841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa39399-b322-4c38-9547-4af7f3dca625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:41.494120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa39399-b322-4c38-9547-4af7f3dca625 admin admin] PATH_INFO: `/v3/projects/77b7b95659124640a7153d47350ecb82` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:41.495323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa39399-b322-4c38-9547-4af7f3dca625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b7b95659124640a7153d47350ecb82)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:41.497273 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa39399-b322-4c38-9547-4af7f3dca625 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:41.547104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7aa39399-b322-4c38-9547-4af7f3dca625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b7b95659124640a7153d47350ecb82', 'request_id': 'req-7aa39399-b322-4c38-9547-4af7f3dca625'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:41.553299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7aa39399-b322-4c38-9547-4af7f3dca625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b7b95659124640a7153d47350ecb82', 'request_id': 'req-7aa39399-b322-4c38-9547-4af7f3dca625'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:41.559478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7aa39399-b322-4c38-9547-4af7f3dca625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b7b95659124640a7153d47350ecb82', 'request_id': 'req-7aa39399-b322-4c38-9547-4af7f3dca625'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:41.576217 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7aa39399-b322-4c38-9547-4af7f3dca625 admin admin] The token cache is being invalidate because project 77b7b95659124640a7153d47350ecb82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:27:41.576535 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7aa39399-b322-4c38-9547-4af7f3dca625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:41.577215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7aa39399-b322-4c38-9547-4af7f3dca625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:41.578705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1210/2407] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:27:41 2022] DELETE /identity/v3/projects/77b7b95659124640a7153d47350ecb82 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:41.585093 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0433-db5d-48f9-a83e-633e91cd82ac None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:41.585391 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0433-db5d-48f9-a83e-633e91cd82ac None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:41.585728 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd0433-db5d-48f9-a83e-633e91cd82ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:41.606861 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b5bd0433-db5d-48f9-a83e-633e91cd82ac None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:41.608095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b5bd0433-db5d-48f9-a83e-633e91cd82ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:41.674774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1198/2408] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:27:41.687592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc9de0-ced9-4398-99ca-95e1e67baacb None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:41.687864 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc9de0-ced9-4398-99ca-95e1e67baacb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:41.688144 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc9de0-ced9-4398-99ca-95e1e67baacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:41.709189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f6fc9de0-ced9-4398-99ca-95e1e67baacb None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:41.710405 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f6fc9de0-ced9-4398-99ca-95e1e67baacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:41.724080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1211/2409] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:27:41.728501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd0433-db5d-48f9-a83e-633e91cd82ac None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:41.738405 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd0433-db5d-48f9-a83e-633e91cd82ac None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:41.743048 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76c5eb-a153-4fad-aeab-f73a1d01a158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:41.744205 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76c5eb-a153-4fad-aeab-f73a1d01a158 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:41.744532 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76c5eb-a153-4fad-aeab-f73a1d01a158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:41.744810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76c5eb-a153-4fad-aeab-f73a1d01a158 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:41.745537 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76c5eb-a153-4fad-aeab-f73a1d01a158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:27:41.745846 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76c5eb-a153-4fad-aeab-f73a1d01a158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:41.747541 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76c5eb-a153-4fad-aeab-f73a1d01a158 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:41.760128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1199/2410] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:27:41.764826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc9de0-ced9-4398-99ca-95e1e67baacb None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:41.774543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc9de0-ced9-4398-99ca-95e1e67baacb None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:41.779743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1214c-dcf8-4246-9835-cd0765116ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:41.780487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1214c-dcf8-4246-9835-cd0765116ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:41.780775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1214c-dcf8-4246-9835-cd0765116ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:41.781128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1214c-dcf8-4246-9835-cd0765116ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:41.781878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1214c-dcf8-4246-9835-cd0765116ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:41.784216 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1214c-dcf8-4246-9835-cd0765116ec2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:41.807245 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:41.816297 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1212/2411] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:27:41 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:27:41.820275 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76c5eb-a153-4fad-aeab-f73a1d01a158 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:41.831489 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76c5eb-a153-4fad-aeab-f73a1d01a158 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:41.854096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:41.902309 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79feaf65-0812-4b3d-b37e-5dc906e5bb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:41.902985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feaf65-0812-4b3d-b37e-5dc906e5bb72 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:41.903274 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feaf65-0812-4b3d-b37e-5dc906e5bb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:41.903551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feaf65-0812-4b3d-b37e-5dc906e5bb72 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:41.904309 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79feaf65-0812-4b3d-b37e-5dc906e5bb72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:41.906252 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79feaf65-0812-4b3d-b37e-5dc906e5bb72 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:41.929499 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1200/2412] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:27:41 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:27:41.934150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1214c-dcf8-4246-9835-cd0765116ec2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:41.944642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1214c-dcf8-4246-9835-cd0765116ec2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:41.949228 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e39ff-6617-4fc8-b5f9-fffeb495b43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:41.949880 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e39ff-6617-4fc8-b5f9-fffeb495b43d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:41.950161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e39ff-6617-4fc8-b5f9-fffeb495b43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:41.950439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e39ff-6617-4fc8-b5f9-fffeb495b43d admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:41.951162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e39ff-6617-4fc8-b5f9-fffeb495b43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:41.952775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e39ff-6617-4fc8-b5f9-fffeb495b43d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:41.962571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1213/2413] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:27:41.966503 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79feaf65-0812-4b3d-b37e-5dc906e5bb72 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:41.976541 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79feaf65-0812-4b3d-b37e-5dc906e5bb72 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:41.981680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947243f-b632-4017-80e0-f4110be17a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:41.982335 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947243f-b632-4017-80e0-f4110be17a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:41.982619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947243f-b632-4017-80e0-f4110be17a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:41.982894 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947243f-b632-4017-80e0-f4110be17a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:41.983606 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947243f-b632-4017-80e0-f4110be17a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:41.985224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947243f-b632-4017-80e0-f4110be17a6b admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:41.996438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1201/2414] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:27:42.000474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e39ff-6617-4fc8-b5f9-fffeb495b43d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:42.010566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e39ff-6617-4fc8-b5f9-fffeb495b43d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:42.018727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f2ed-696b-4cd6-8764-8ef0df986ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:42.019635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f2ed-696b-4cd6-8764-8ef0df986ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:42.019919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f2ed-696b-4cd6-8764-8ef0df986ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:42.020197 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f2ed-696b-4cd6-8764-8ef0df986ecb admin admin] PATH_INFO: `/v3/projects/113c9ee3d32046f0b416a971747045fc/users/1de2c497e8d44f57ad44a5865002412f/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:42.035752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2f2ed-696b-4cd6-8764-8ef0df986ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=113c9ee3d32046f0b416a971747045fc, user_id=1de2c497e8d44f57ad44a5865002412f, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:42.038451 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2f2ed-696b-4cd6-8764-8ef0df986ecb admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:42.051955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1214/2415] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:27:41 2022] PUT /identity/v3/projects/113c9ee3d32046f0b416a971747045fc/users/1de2c497e8d44f57ad44a5865002412f/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:42.064652 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd791b-e09c-42ba-aacf-5cf9faebbb0e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:42.064945 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd791b-e09c-42ba-aacf-5cf9faebbb0e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:42.065241 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd791b-e09c-42ba-aacf-5cf9faebbb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:42.094708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-81bd791b-e09c-42ba-aacf-5cf9faebbb0e None None] MFA Rules not processed for user `1de2c497e8d44f57ad44a5865002412f`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:42.096002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-81bd791b-e09c-42ba-aacf-5cf9faebbb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:42.159996 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1202/2416] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:27:42.165205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f2ed-696b-4cd6-8764-8ef0df986ecb admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:42.224778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f2ed-696b-4cd6-8764-8ef0df986ecb admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:42.230180 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4daa62-401d-4afe-86df-4d3bf6ef8c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:42.230873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4daa62-401d-4afe-86df-4d3bf6ef8c5a admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:42.231527 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4daa62-401d-4afe-86df-4d3bf6ef8c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:42.231527 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4daa62-401d-4afe-86df-4d3bf6ef8c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:42.232099 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4daa62-401d-4afe-86df-4d3bf6ef8c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:42.234035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4daa62-401d-4afe-86df-4d3bf6ef8c5a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:42.260748 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1215/2417] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:27:42 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:27:42.264977 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd791b-e09c-42ba-aacf-5cf9faebbb0e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:42.276284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd791b-e09c-42ba-aacf-5cf9faebbb0e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:42.333141 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbe197-7222-4755-b9de-329b53fe6122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:42.333825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbe197-7222-4755-b9de-329b53fe6122 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:42.334112 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbe197-7222-4755-b9de-329b53fe6122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:42.334393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbe197-7222-4755-b9de-329b53fe6122 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:42.335090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbe197-7222-4755-b9de-329b53fe6122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:42.337056 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbe197-7222-4755-b9de-329b53fe6122 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:42.362094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1203/2418] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:27:42 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:27:42.366278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4daa62-401d-4afe-86df-4d3bf6ef8c5a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:42.376966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4daa62-401d-4afe-86df-4d3bf6ef8c5a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:42.381653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8266b0-2db1-4c22-b70d-8dc0bdea25a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:42.382310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8266b0-2db1-4c22-b70d-8dc0bdea25a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:42.382789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8266b0-2db1-4c22-b70d-8dc0bdea25a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:42.383073 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8266b0-2db1-4c22-b70d-8dc0bdea25a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:42.383827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8266b0-2db1-4c22-b70d-8dc0bdea25a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:42.386070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8266b0-2db1-4c22-b70d-8dc0bdea25a0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:42.396630 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1216/2419] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:27:42.400967 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbe197-7222-4755-b9de-329b53fe6122 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:42.411307 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbe197-7222-4755-b9de-329b53fe6122 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:42.415982 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca94c1-a40b-4c78-8f2d-81a31e351909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:42.416923 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca94c1-a40b-4c78-8f2d-81a31e351909 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:42.417202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca94c1-a40b-4c78-8f2d-81a31e351909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:42.417479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca94c1-a40b-4c78-8f2d-81a31e351909 admin admin] PATH_INFO: `/v3/projects/e3733b77b3164bef83816d9a54f773e7/users/26c2303b86604503bfa4a0312fb6f6a1/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:42.433622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca94c1-a40b-4c78-8f2d-81a31e351909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3733b77b3164bef83816d9a54f773e7, user_id=26c2303b86604503bfa4a0312fb6f6a1, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:42.436327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca94c1-a40b-4c78-8f2d-81a31e351909 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:42.438537 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:42.450182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1204/2420] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:27:42 2022] PUT /identity/v3/projects/e3733b77b3164bef83816d9a54f773e7/users/26c2303b86604503bfa4a0312fb6f6a1/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:42.454248 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8266b0-2db1-4c22-b70d-8dc0bdea25a0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:42.464094 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8266b0-2db1-4c22-b70d-8dc0bdea25a0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:42.521522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c24c8-bf89-4a34-b375-bc000741858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:42.522115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c24c8-bf89-4a34-b375-bc000741858c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:42.522405 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c24c8-bf89-4a34-b375-bc000741858c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:42.522714 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c24c8-bf89-4a34-b375-bc000741858c admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:42.523447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c24c8-bf89-4a34-b375-bc000741858c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:42.525136 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c24c8-bf89-4a34-b375-bc000741858c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:42.539003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1217/2421] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:27:42.543190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca94c1-a40b-4c78-8f2d-81a31e351909 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:42.554353 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca94c1-a40b-4c78-8f2d-81a31e351909 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:42.559760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106db39e-dd8a-481f-bb6b-b27f17af0e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:42.560683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106db39e-dd8a-481f-bb6b-b27f17af0e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:42.560970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106db39e-dd8a-481f-bb6b-b27f17af0e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:42.561252 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106db39e-dd8a-481f-bb6b-b27f17af0e54 admin admin] PATH_INFO: `/v3/projects/e3733b77b3164bef83816d9a54f773e7/users/26c2303b86604503bfa4a0312fb6f6a1/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:42.563255 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106db39e-dd8a-481f-bb6b-b27f17af0e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3733b77b3164bef83816d9a54f773e7, user_id=26c2303b86604503bfa4a0312fb6f6a1, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:42.566213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106db39e-dd8a-481f-bb6b-b27f17af0e54 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:42.577810 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1205/2422] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:27:42 2022] PUT /identity/v3/projects/e3733b77b3164bef83816d9a54f773e7/users/26c2303b86604503bfa4a0312fb6f6a1/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:27:42.589152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9238dfc-de26-432c-b067-be20da8cf336 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:42.589152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9238dfc-de26-432c-b067-be20da8cf336 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:42.589152 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9238dfc-de26-432c-b067-be20da8cf336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:42.619026 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e9238dfc-de26-432c-b067-be20da8cf336 None None] MFA Rules not processed for user `26c2303b86604503bfa4a0312fb6f6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:42.620241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e9238dfc-de26-432c-b067-be20da8cf336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:42.644628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:42.691600 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1218/2423] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:27:42.702707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106db39e-dd8a-481f-bb6b-b27f17af0e54 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:42.704570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-106db39e-dd8a-481f-bb6b-b27f17af0e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:42.763295 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106db39e-dd8a-481f-bb6b-b27f17af0e54 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:42.766963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807c851-c2fe-4a36-94e5-b3953e3a299b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:42.767599 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807c851-c2fe-4a36-94e5-b3953e3a299b service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:42.767876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807c851-c2fe-4a36-94e5-b3953e3a299b service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:42.768146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807c851-c2fe-4a36-94e5-b3953e3a299b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:42.777132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807c851-c2fe-4a36-94e5-b3953e3a299b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:42.778492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807c851-c2fe-4a36-94e5-b3953e3a299b service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:42.788151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1206/2424] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:27:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:27:43.160295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9238dfc-de26-432c-b067-be20da8cf336 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:43.221966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9238dfc-de26-432c-b067-be20da8cf336 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:43.226441 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bc3bf-0abd-40c6-a5da-81bec6b4d683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:43.227309 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bc3bf-0abd-40c6-a5da-81bec6b4d683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:43.227658 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bc3bf-0abd-40c6-a5da-81bec6b4d683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:43.228475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bc3bf-0abd-40c6-a5da-81bec6b4d683 admin admin] PATH_INFO: `/v3/users/1de2c497e8d44f57ad44a5865002412f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:43.229660 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bc3bf-0abd-40c6-a5da-81bec6b4d683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de2c497e8d44f57ad44a5865002412f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:43.231576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bc3bf-0abd-40c6-a5da-81bec6b4d683 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:43.279091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e44bc3bf-0abd-40c6-a5da-81bec6b4d683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de2c497e8d44f57ad44a5865002412f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:43.279734 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e44bc3bf-0abd-40c6-a5da-81bec6b4d683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de2c497e8d44f57ad44a5865002412f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:43.280379 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e44bc3bf-0abd-40c6-a5da-81bec6b4d683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de2c497e8d44f57ad44a5865002412f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:43.287370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e44bc3bf-0abd-40c6-a5da-81bec6b4d683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de2c497e8d44f57ad44a5865002412f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:43.295299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e44bc3bf-0abd-40c6-a5da-81bec6b4d683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de2c497e8d44f57ad44a5865002412f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:43.312366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1219/2425] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:27:43 2022] DELETE /identity/v3/users/1de2c497e8d44f57ad44a5865002412f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:43.316904 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bf9c6-d7f6-48ce-947c-f3a1812fe1a5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:43.317453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bf9c6-d7f6-48ce-947c-f3a1812fe1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:43.317551 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bf9c6-d7f6-48ce-947c-f3a1812fe1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:43.337467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-271bf9c6-d7f6-48ce-947c-f3a1812fe1a5 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:43.338712 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-271bf9c6-d7f6-48ce-947c-f3a1812fe1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:43.398879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1207/2426] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:27:43.411076 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bc3bf-0abd-40c6-a5da-81bec6b4d683 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:43.412583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e44bc3bf-0abd-40c6-a5da-81bec6b4d683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:43.457158 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:43.472205 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bc3bf-0abd-40c6-a5da-81bec6b4d683 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:43.476051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c6f56-16e8-4099-9c22-3852deac0ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:43.476724 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c6f56-16e8-4099-9c22-3852deac0ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:43.477034 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c6f56-16e8-4099-9c22-3852deac0ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:43.477306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c6f56-16e8-4099-9c22-3852deac0ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:43.486432 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c6f56-16e8-4099-9c22-3852deac0ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:43.487860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c6f56-16e8-4099-9c22-3852deac0ad9 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:43.497510 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1220/2427] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:27:43.782662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bf9c6-d7f6-48ce-947c-f3a1812fe1a5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:43.785054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-271bf9c6-d7f6-48ce-947c-f3a1812fe1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:43.812859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bf9c6-d7f6-48ce-947c-f3a1812fe1a5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:43.818451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e7158-2a62-4d90-adde-020120636295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:43.819424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e7158-2a62-4d90-adde-020120636295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:43.819844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e7158-2a62-4d90-adde-020120636295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:43.820182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e7158-2a62-4d90-adde-020120636295 admin admin] PATH_INFO: `/v3/projects/113c9ee3d32046f0b416a971747045fc` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:43.821520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e7158-2a62-4d90-adde-020120636295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=113c9ee3d32046f0b416a971747045fc)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:43.823562 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e7158-2a62-4d90-adde-020120636295 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:43.881964 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b0e7158-2a62-4d90-adde-020120636295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113c9ee3d32046f0b416a971747045fc', 'request_id': 'req-0b0e7158-2a62-4d90-adde-020120636295'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:43.893445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b0e7158-2a62-4d90-adde-020120636295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113c9ee3d32046f0b416a971747045fc', 'request_id': 'req-0b0e7158-2a62-4d90-adde-020120636295'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:43.904665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b0e7158-2a62-4d90-adde-020120636295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113c9ee3d32046f0b416a971747045fc', 'request_id': 'req-0b0e7158-2a62-4d90-adde-020120636295'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:43.918046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b0e7158-2a62-4d90-adde-020120636295 admin admin] The token cache is being invalidate because project 113c9ee3d32046f0b416a971747045fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:27:43.918350 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b0e7158-2a62-4d90-adde-020120636295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:43.919592 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0b0e7158-2a62-4d90-adde-020120636295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:43.921758 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1208/2428] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:27:43 2022] DELETE /identity/v3/projects/113c9ee3d32046f0b416a971747045fc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:43.925756 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c6f56-16e8-4099-9c22-3852deac0ad9 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:43.938063 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c6f56-16e8-4099-9c22-3852deac0ad9 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:44.011373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f19eb0-5c2d-4f4e-89ad-b82e859b92db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:44.012424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f19eb0-5c2d-4f4e-89ad-b82e859b92db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:44.012739 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f19eb0-5c2d-4f4e-89ad-b82e859b92db admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:44.013023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f19eb0-5c2d-4f4e-89ad-b82e859b92db admin admin] PATH_INFO: `/v3/users/26c2303b86604503bfa4a0312fb6f6a1` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:44.014479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f19eb0-5c2d-4f4e-89ad-b82e859b92db admin admin] RBAC: Authorizing `identity:delete_user(user_id=26c2303b86604503bfa4a0312fb6f6a1)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:44.016694 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f19eb0-5c2d-4f4e-89ad-b82e859b92db admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:44.080418 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b7f19eb0-5c2d-4f4e-89ad-b82e859b92db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26c2303b86604503bfa4a0312fb6f6a1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:44.081176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b7f19eb0-5c2d-4f4e-89ad-b82e859b92db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26c2303b86604503bfa4a0312fb6f6a1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:44.082107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b7f19eb0-5c2d-4f4e-89ad-b82e859b92db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26c2303b86604503bfa4a0312fb6f6a1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:44.089943 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b7f19eb0-5c2d-4f4e-89ad-b82e859b92db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26c2303b86604503bfa4a0312fb6f6a1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:44.099095 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b7f19eb0-5c2d-4f4e-89ad-b82e859b92db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26c2303b86604503bfa4a0312fb6f6a1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:44.119879 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1221/2429] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:27:43 2022] DELETE /identity/v3/users/26c2303b86604503bfa4a0312fb6f6a1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:44.423645 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e7158-2a62-4d90-adde-020120636295 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:44.425457 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0b0e7158-2a62-4d90-adde-020120636295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:44.441154 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e7158-2a62-4d90-adde-020120636295 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:44.446773 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:44.504493 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f09ea-0138-446d-9e19-716edede3cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:44.505369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f09ea-0138-446d-9e19-716edede3cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:44.505650 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f09ea-0138-446d-9e19-716edede3cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:44.505925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f09ea-0138-446d-9e19-716edede3cc8 admin admin] PATH_INFO: `/v3/projects/e3733b77b3164bef83816d9a54f773e7` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:44.507148 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f09ea-0138-446d-9e19-716edede3cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3733b77b3164bef83816d9a54f773e7)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:44.509652 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f09ea-0138-446d-9e19-716edede3cc8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:44.561139 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-493f09ea-0138-446d-9e19-716edede3cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3733b77b3164bef83816d9a54f773e7', 'request_id': 'req-493f09ea-0138-446d-9e19-716edede3cc8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:44.576677 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-493f09ea-0138-446d-9e19-716edede3cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3733b77b3164bef83816d9a54f773e7', 'request_id': 'req-493f09ea-0138-446d-9e19-716edede3cc8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:44.583725 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-493f09ea-0138-446d-9e19-716edede3cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3733b77b3164bef83816d9a54f773e7', 'request_id': 'req-493f09ea-0138-446d-9e19-716edede3cc8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:44.595450 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-493f09ea-0138-446d-9e19-716edede3cc8 admin admin] The token cache is being invalidate because project e3733b77b3164bef83816d9a54f773e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:27:44.595740 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-493f09ea-0138-446d-9e19-716edede3cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:44.596455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-493f09ea-0138-446d-9e19-716edede3cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:27:44.598058 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1209/2430] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:27:44 2022] DELETE /identity/v3/projects/e3733b77b3164bef83816d9a54f773e7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:44.603238 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9b390-8a05-4c4b-99fe-15108e64b1da None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:44.603744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9b390-8a05-4c4b-99fe-15108e64b1da None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:44.603836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9b390-8a05-4c4b-99fe-15108e64b1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:44.625135 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1ae9b390-8a05-4c4b-99fe-15108e64b1da None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:44.626372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1ae9b390-8a05-4c4b-99fe-15108e64b1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:44.691688 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1222/2431] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:27:44.700619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfef8d-4904-439a-b9b1-f0b5ae9e9be0 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:44.700905 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfef8d-4904-439a-b9b1-f0b5ae9e9be0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:44.701185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfef8d-4904-439a-b9b1-f0b5ae9e9be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:44.723052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-62bfef8d-4904-439a-b9b1-f0b5ae9e9be0 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:44.724357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-62bfef8d-4904-439a-b9b1-f0b5ae9e9be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:44.733666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1210/2432] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:27:44.738214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9b390-8a05-4c4b-99fe-15108e64b1da None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:44.743874 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:44.750994 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9b390-8a05-4c4b-99fe-15108e64b1da None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:44.757340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388afc4c-2729-4d2a-b58b-557d852db94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:44.758027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388afc4c-2729-4d2a-b58b-557d852db94e admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:44.758311 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388afc4c-2729-4d2a-b58b-557d852db94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:44.758586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388afc4c-2729-4d2a-b58b-557d852db94e admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:44.759422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388afc4c-2729-4d2a-b58b-557d852db94e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:27:44.759729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388afc4c-2729-4d2a-b58b-557d852db94e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:44.761882 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388afc4c-2729-4d2a-b58b-557d852db94e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:44.774843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1223/2433] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:27:44.779510 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfef8d-4904-439a-b9b1-f0b5ae9e9be0 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:44.789512 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfef8d-4904-439a-b9b1-f0b5ae9e9be0 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:44.794355 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcd294-dfc7-425a-b788-f91fa33ac23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:44.795028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcd294-dfc7-425a-b788-f91fa33ac23b admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:44.795313 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcd294-dfc7-425a-b788-f91fa33ac23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:44.795586 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcd294-dfc7-425a-b788-f91fa33ac23b admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:44.796328 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcd294-dfc7-425a-b788-f91fa33ac23b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:44.798258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcd294-dfc7-425a-b788-f91fa33ac23b admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:44.827997 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1211/2434] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:27:44 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:27:44.832528 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388afc4c-2729-4d2a-b58b-557d852db94e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:44.844660 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388afc4c-2729-4d2a-b58b-557d852db94e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:44.912236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266c49e-9455-4239-93ef-858983e9570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:44.912876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266c49e-9455-4239-93ef-858983e9570b admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:44.913204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266c49e-9455-4239-93ef-858983e9570b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:44.913465 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266c49e-9455-4239-93ef-858983e9570b admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:44.914166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266c49e-9455-4239-93ef-858983e9570b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:44.916644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266c49e-9455-4239-93ef-858983e9570b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:44.940094 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1224/2435] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:27:44 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:27:44.943938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcd294-dfc7-425a-b788-f91fa33ac23b admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:44.954542 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcd294-dfc7-425a-b788-f91fa33ac23b admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:44.959275 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6451e-26f7-4950-b525-b37b15a5dd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:44.959955 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6451e-26f7-4950-b525-b37b15a5dd5b admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:44.960233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6451e-26f7-4950-b525-b37b15a5dd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:44.960535 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6451e-26f7-4950-b525-b37b15a5dd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:44.961265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6451e-26f7-4950-b525-b37b15a5dd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:44.962898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6451e-26f7-4950-b525-b37b15a5dd5b admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:44.974583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1212/2436] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:27:44.979992 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266c49e-9455-4239-93ef-858983e9570b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:44.990570 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266c49e-9455-4239-93ef-858983e9570b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:44.996337 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947de76-00de-4988-9ba2-0b0a00121731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:44.997035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947de76-00de-4988-9ba2-0b0a00121731 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:44.997312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947de76-00de-4988-9ba2-0b0a00121731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:44.997586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947de76-00de-4988-9ba2-0b0a00121731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:44.998304 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947de76-00de-4988-9ba2-0b0a00121731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:44.999898 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947de76-00de-4988-9ba2-0b0a00121731 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:45.010948 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1225/2437] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:27:45.015210 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6451e-26f7-4950-b525-b37b15a5dd5b admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:45.026934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6451e-26f7-4950-b525-b37b15a5dd5b admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:45.037614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d94a2-1ea1-45fb-b304-966d8bd2fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:45.038587 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d94a2-1ea1-45fb-b304-966d8bd2fc72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:45.038865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d94a2-1ea1-45fb-b304-966d8bd2fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:45.039213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d94a2-1ea1-45fb-b304-966d8bd2fc72 admin admin] PATH_INFO: `/v3/projects/4b8b4ceaea5d4408b3d1f2bb05a52995/users/487830d5faf845cfae3572c44ca2c25b/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:45.057104 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d94a2-1ea1-45fb-b304-966d8bd2fc72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8b4ceaea5d4408b3d1f2bb05a52995, user_id=487830d5faf845cfae3572c44ca2c25b, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:45.059850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d94a2-1ea1-45fb-b304-966d8bd2fc72 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:45.077664 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1213/2438] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:27:45 2022] PUT /identity/v3/projects/4b8b4ceaea5d4408b3d1f2bb05a52995/users/487830d5faf845cfae3572c44ca2c25b/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:27:45.147200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ba279-0f2f-42cd-b13a-725f0ba445fe None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:45.147492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ba279-0f2f-42cd-b13a-725f0ba445fe None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:45.147773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ba279-0f2f-42cd-b13a-725f0ba445fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:45.183023 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9c6ba279-0f2f-42cd-b13a-725f0ba445fe None None] MFA Rules not processed for user `487830d5faf845cfae3572c44ca2c25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:27:45.184997 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9c6ba279-0f2f-42cd-b13a-725f0ba445fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:45.294830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1226/2439] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:27:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:27:45.307124 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d94a2-1ea1-45fb-b304-966d8bd2fc72 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:27:45.308903 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3f9d94a2-1ea1-45fb-b304-966d8bd2fc72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:27:45.346335 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:45.371513 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d94a2-1ea1-45fb-b304-966d8bd2fc72 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:27:45.375254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4b9c2-13dc-4214-b1f5-3a50d1ae8554 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '623c97746d304c6ba971e79e4dbeb730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:27:45.375973 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4b9c2-13dc-4214-b1f5-3a50d1ae8554 service glance] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:27:45.376276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4b9c2-13dc-4214-b1f5-3a50d1ae8554 service glance] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:27:45.376565 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4b9c2-13dc-4214-b1f5-3a50d1ae8554 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:27:45.386674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4b9c2-13dc-4214-b1f5-3a50d1ae8554 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:27:45.388131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4b9c2-13dc-4214-b1f5-3a50d1ae8554 service glance] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:27:45.397528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1214/2440] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:27:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:27:55.291704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=71,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:55.393338 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=11 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:14.312146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e49a4-2421-4f59-8f21-8b58b8c1b1d6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:14.312722 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e49a4-2421-4f59-8f21-8b58b8c1b1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:14.312975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e49a4-2421-4f59-8f21-8b58b8c1b1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:14.343318 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-190e49a4-2421-4f59-8f21-8b58b8c1b1d6 None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:28:14.344499 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-190e49a4-2421-4f59-8f21-8b58b8c1b1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:14.405659 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1227/2441] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 25 16:28:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:28:14.455678 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4b9c2-13dc-4214-b1f5-3a50d1ae8554 service glance] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:14.457260 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5dd4b9c2-13dc-4214-b1f5-3a50d1ae8554 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:14.527500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4b9c2-13dc-4214-b1f5-3a50d1ae8554 service glance] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:14.532571 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956fc16-6722-470a-93b0-ff27f7c8d2ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:14.533221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956fc16-6722-470a-93b0-ff27f7c8d2ac service swift] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:14.533504 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956fc16-6722-470a-93b0-ff27f7c8d2ac service swift] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:14.533779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956fc16-6722-470a-93b0-ff27f7c8d2ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:14.543246 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956fc16-6722-470a-93b0-ff27f7c8d2ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:14.544894 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956fc16-6722-470a-93b0-ff27f7c8d2ac service swift] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:14.553596 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1215/2442] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:28:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 16:28:22.265603 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e49a4-2421-4f59-8f21-8b58b8c1b1d6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:22.349155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e49a4-2421-4f59-8f21-8b58b8c1b1d6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:22.353815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb409a5-681d-48b1-aecc-ac45c31cc259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:22.354711 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb409a5-681d-48b1-aecc-ac45c31cc259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:22.354981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb409a5-681d-48b1-aecc-ac45c31cc259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:22.355269 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb409a5-681d-48b1-aecc-ac45c31cc259 admin admin] PATH_INFO: `/v3/users/487830d5faf845cfae3572c44ca2c25b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:22.356540 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb409a5-681d-48b1-aecc-ac45c31cc259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=487830d5faf845cfae3572c44ca2c25b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:22.358458 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb409a5-681d-48b1-aecc-ac45c31cc259 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:22.411970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1fb409a5-681d-48b1-aecc-ac45c31cc259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '487830d5faf845cfae3572c44ca2c25b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:22.412586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1fb409a5-681d-48b1-aecc-ac45c31cc259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '487830d5faf845cfae3572c44ca2c25b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:22.413198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1fb409a5-681d-48b1-aecc-ac45c31cc259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '487830d5faf845cfae3572c44ca2c25b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:22.420809 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1fb409a5-681d-48b1-aecc-ac45c31cc259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '487830d5faf845cfae3572c44ca2c25b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:22.428762 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1fb409a5-681d-48b1-aecc-ac45c31cc259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '487830d5faf845cfae3572c44ca2c25b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:22.452221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1228/2443] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:28:22 2022] DELETE /identity/v3/users/487830d5faf845cfae3572c44ca2c25b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:28:22.457322 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a64aa-fe02-48ca-a6e9-7ea8e0f6344f None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:22.458295 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a64aa-fe02-48ca-a6e9-7ea8e0f6344f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:22.458795 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a64aa-fe02-48ca-a6e9-7ea8e0f6344f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:22.485704 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-9f5a64aa-fe02-48ca-a6e9-7ea8e0f6344f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:28:22.486927 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9f5a64aa-fe02-48ca-a6e9-7ea8e0f6344f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:22.599652 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1216/2444] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:28:22.611431 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb409a5-681d-48b1-aecc-ac45c31cc259 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:22.613192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1fb409a5-681d-48b1-aecc-ac45c31cc259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:22.638655 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:22.695700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb409a5-681d-48b1-aecc-ac45c31cc259 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:22.699629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddace606-706a-448d-9a0c-4a5f3cdf05d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:22.700119 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddace606-706a-448d-9a0c-4a5f3cdf05d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:22.700440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddace606-706a-448d-9a0c-4a5f3cdf05d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:22.700723 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddace606-706a-448d-9a0c-4a5f3cdf05d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:22.711740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddace606-706a-448d-9a0c-4a5f3cdf05d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:22.713211 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddace606-706a-448d-9a0c-4a5f3cdf05d2 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:22.723646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1229/2445] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:28:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:28:23.205083 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a64aa-fe02-48ca-a6e9-7ea8e0f6344f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:23.206909 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9f5a64aa-fe02-48ca-a6e9-7ea8e0f6344f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:23.221362 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a64aa-fe02-48ca-a6e9-7ea8e0f6344f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:23.233136 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7be671-1bfb-41f3-8afe-f0cd41d423b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:23.234025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7be671-1bfb-41f3-8afe-f0cd41d423b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:23.234306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7be671-1bfb-41f3-8afe-f0cd41d423b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:23.234590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7be671-1bfb-41f3-8afe-f0cd41d423b5 admin admin] PATH_INFO: `/v3/projects/4b8b4ceaea5d4408b3d1f2bb05a52995` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:23.243033 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7be671-1bfb-41f3-8afe-f0cd41d423b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8b4ceaea5d4408b3d1f2bb05a52995)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:23.245027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7be671-1bfb-41f3-8afe-f0cd41d423b5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:23.344305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-df7be671-1bfb-41f3-8afe-f0cd41d423b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8b4ceaea5d4408b3d1f2bb05a52995', 'request_id': 'req-df7be671-1bfb-41f3-8afe-f0cd41d423b5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:23.379372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-df7be671-1bfb-41f3-8afe-f0cd41d423b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8b4ceaea5d4408b3d1f2bb05a52995', 'request_id': 'req-df7be671-1bfb-41f3-8afe-f0cd41d423b5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:23.386884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-df7be671-1bfb-41f3-8afe-f0cd41d423b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8b4ceaea5d4408b3d1f2bb05a52995', 'request_id': 'req-df7be671-1bfb-41f3-8afe-f0cd41d423b5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:23.397919 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-df7be671-1bfb-41f3-8afe-f0cd41d423b5 admin admin] The token cache is being invalidate because project 4b8b4ceaea5d4408b3d1f2bb05a52995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:28:23.398926 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-df7be671-1bfb-41f3-8afe-f0cd41d423b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:23.400347 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-df7be671-1bfb-41f3-8afe-f0cd41d423b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:23.402298 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1217/2446] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:28:23 2022] DELETE /identity/v3/projects/4b8b4ceaea5d4408b3d1f2bb05a52995 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:28:23.407467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f6105-4dab-49bf-a289-006227731ec0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:23.407989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f6105-4dab-49bf-a289-006227731ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:23.408150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f6105-4dab-49bf-a289-006227731ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:23.429627 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-532f6105-4dab-49bf-a289-006227731ec0 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:28:23.430872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-532f6105-4dab-49bf-a289-006227731ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:23.519680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1230/2447] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:28:23.533400 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3234e27-38ab-436a-9fea-4ee1333d096a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:23.533972 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3234e27-38ab-436a-9fea-4ee1333d096a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:23.535097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3234e27-38ab-436a-9fea-4ee1333d096a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:23.577844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-f3234e27-38ab-436a-9fea-4ee1333d096a None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:28:23.579983 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f3234e27-38ab-436a-9fea-4ee1333d096a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:23.597696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1218/2448] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:28:23.604731 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f6105-4dab-49bf-a289-006227731ec0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:23.615062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f6105-4dab-49bf-a289-006227731ec0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:23.628789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867ac12-2f1a-41d4-827e-592c6a720db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:23.630021 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867ac12-2f1a-41d4-827e-592c6a720db8 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:23.630420 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867ac12-2f1a-41d4-827e-592c6a720db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:23.631052 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867ac12-2f1a-41d4-827e-592c6a720db8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:23.633384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867ac12-2f1a-41d4-827e-592c6a720db8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:28:23.634091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867ac12-2f1a-41d4-827e-592c6a720db8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:23.637886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867ac12-2f1a-41d4-827e-592c6a720db8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:23.682928 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3234e27-38ab-436a-9fea-4ee1333d096a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:23.685092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1231/2449] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:28:23.701363 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3234e27-38ab-436a-9fea-4ee1333d096a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:23.715266 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71afc0e-a022-489b-979d-b1a8c8283f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:23.716919 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71afc0e-a022-489b-979d-b1a8c8283f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:23.720087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71afc0e-a022-489b-979d-b1a8c8283f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:23.720735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71afc0e-a022-489b-979d-b1a8c8283f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:23.723215 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71afc0e-a022-489b-979d-b1a8c8283f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:23.729014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71afc0e-a022-489b-979d-b1a8c8283f03 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:23.750572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:23.813426 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1219/2450] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:28:23 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:28:23.822206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867ac12-2f1a-41d4-827e-592c6a720db8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:23.846055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867ac12-2f1a-41d4-827e-592c6a720db8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:23.942891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1864a-fec6-488d-a9a6-781094e65799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:23.944006 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1864a-fec6-488d-a9a6-781094e65799 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:23.944474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1864a-fec6-488d-a9a6-781094e65799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:23.944923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1864a-fec6-488d-a9a6-781094e65799 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:23.946061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1864a-fec6-488d-a9a6-781094e65799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:23.948168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1864a-fec6-488d-a9a6-781094e65799 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:23.974843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1232/2451] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:28:23 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:28:23.982749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71afc0e-a022-489b-979d-b1a8c8283f03 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:24.001601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71afc0e-a022-489b-979d-b1a8c8283f03 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:24.008645 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380f497-e836-4ad3-a5ce-b1dc1792cd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:24.009665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380f497-e836-4ad3-a5ce-b1dc1792cd10 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:24.010193 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380f497-e836-4ad3-a5ce-b1dc1792cd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:24.010676 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380f497-e836-4ad3-a5ce-b1dc1792cd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:24.011636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380f497-e836-4ad3-a5ce-b1dc1792cd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:24.013704 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380f497-e836-4ad3-a5ce-b1dc1792cd10 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:24.027143 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1220/2452] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:28:24.032355 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1864a-fec6-488d-a9a6-781094e65799 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:24.048685 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1864a-fec6-488d-a9a6-781094e65799 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:24.055583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e80803-8270-4c9a-95ca-2eebfc39f22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:24.056606 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e80803-8270-4c9a-95ca-2eebfc39f22a admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:24.057105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e80803-8270-4c9a-95ca-2eebfc39f22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:24.057589 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e80803-8270-4c9a-95ca-2eebfc39f22a admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:24.058694 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e80803-8270-4c9a-95ca-2eebfc39f22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:24.060725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e80803-8270-4c9a-95ca-2eebfc39f22a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:24.073749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1233/2453] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:28:24.080984 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380f497-e836-4ad3-a5ce-b1dc1792cd10 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:24.104179 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380f497-e836-4ad3-a5ce-b1dc1792cd10 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:24.111672 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368237ee-82b4-41f2-89ad-3f1b5876f0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:24.113029 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368237ee-82b4-41f2-89ad-3f1b5876f0c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:24.113466 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368237ee-82b4-41f2-89ad-3f1b5876f0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:24.113911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368237ee-82b4-41f2-89ad-3f1b5876f0c2 admin admin] PATH_INFO: `/v3/projects/562e4524130f46ec820bae1a34d746ed/users/2134fac6546e400d8da444f906444662/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:24.163589 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368237ee-82b4-41f2-89ad-3f1b5876f0c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562e4524130f46ec820bae1a34d746ed, user_id=2134fac6546e400d8da444f906444662, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:24.167046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368237ee-82b4-41f2-89ad-3f1b5876f0c2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:24.191582 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1221/2454] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:28:24 2022] PUT /identity/v3/projects/562e4524130f46ec820bae1a34d746ed/users/2134fac6546e400d8da444f906444662/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:28:24.219529 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd41c2-29fe-447f-bc0f-1eb64cc36fd8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:24.220533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd41c2-29fe-447f-bc0f-1eb64cc36fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:24.220533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd41c2-29fe-447f-bc0f-1eb64cc36fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:24.324432 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bccd41c2-29fe-447f-bc0f-1eb64cc36fd8 None None] MFA Rules not processed for user `2134fac6546e400d8da444f906444662`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:28:24.325586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bccd41c2-29fe-447f-bc0f-1eb64cc36fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:24.336090 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:24.464822 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1234/2455] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:28:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:28:24.483121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368237ee-82b4-41f2-89ad-3f1b5876f0c2 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:24.485458 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-368237ee-82b4-41f2-89ad-3f1b5876f0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:24.571626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368237ee-82b4-41f2-89ad-3f1b5876f0c2 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:24.578186 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaf970-13e6-4059-9af3-ec6533413d2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:24.578785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf970-13e6-4059-9af3-ec6533413d2e service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:24.579067 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf970-13e6-4059-9af3-ec6533413d2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:24.579334 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf970-13e6-4059-9af3-ec6533413d2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:24.593017 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaf970-13e6-4059-9af3-ec6533413d2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:24.594735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaf970-13e6-4059-9af3-ec6533413d2e service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:24.609796 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1222/2456] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:28:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:28:26.674335 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd41c2-29fe-447f-bc0f-1eb64cc36fd8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:26.675902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bccd41c2-29fe-447f-bc0f-1eb64cc36fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:26.758757 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd41c2-29fe-447f-bc0f-1eb64cc36fd8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:26.763290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df52d79-dff4-4c18-bd3b-74d3a70d81c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:26.764242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df52d79-dff4-4c18-bd3b-74d3a70d81c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:26.764664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df52d79-dff4-4c18-bd3b-74d3a70d81c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:26.765013 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df52d79-dff4-4c18-bd3b-74d3a70d81c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:26.767561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1df52d79-dff4-4c18-bd3b-74d3a70d81c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:26.845886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df52d79-dff4-4c18-bd3b-74d3a70d81c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:26.847718 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df52d79-dff4-4c18-bd3b-74d3a70d81c1 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:26.859758 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1235/2457] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:28:27.548950 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaf970-13e6-4059-9af3-ec6533413d2e service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:27.563616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaf970-13e6-4059-9af3-ec6533413d2e service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:27.568104 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3f240-7755-4c35-961e-fb3649bac413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:27.569017 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3f240-7755-4c35-961e-fb3649bac413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:27.569300 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3f240-7755-4c35-961e-fb3649bac413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:27.569578 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3f240-7755-4c35-961e-fb3649bac413 admin admin] PATH_INFO: `/v3/users/2134fac6546e400d8da444f906444662` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:27.571379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3f240-7755-4c35-961e-fb3649bac413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2134fac6546e400d8da444f906444662)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:27.573403 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3f240-7755-4c35-961e-fb3649bac413 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:27.627669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a5f3f240-7755-4c35-961e-fb3649bac413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2134fac6546e400d8da444f906444662'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:27.635951 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a5f3f240-7755-4c35-961e-fb3649bac413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2134fac6546e400d8da444f906444662'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:27.637054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a5f3f240-7755-4c35-961e-fb3649bac413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2134fac6546e400d8da444f906444662'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:27.637768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a5f3f240-7755-4c35-961e-fb3649bac413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2134fac6546e400d8da444f906444662'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:27.650824 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-a5f3f240-7755-4c35-961e-fb3649bac413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2134fac6546e400d8da444f906444662'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:27.664605 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1223/2458] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:28:27 2022] DELETE /identity/v3/users/2134fac6546e400d8da444f906444662 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:28:27.669180 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde485c-8516-4356-ade0-23e5406fe201 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:27.669495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde485c-8516-4356-ade0-23e5406fe201 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:27.669772 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde485c-8516-4356-ade0-23e5406fe201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:27.689735 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1bde485c-8516-4356-ade0-23e5406fe201 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:28:27.691032 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1bde485c-8516-4356-ade0-23e5406fe201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:27.752508 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:27.762765 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1236/2459] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:28:27.772746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3f240-7755-4c35-961e-fb3649bac413 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:27.775061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a5f3f240-7755-4c35-961e-fb3649bac413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:27.806112 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:27.843700 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3f240-7755-4c35-961e-fb3649bac413 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:27.847650 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b42ba-0d42-454e-9024-6d534bced411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:27.848348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b42ba-0d42-454e-9024-6d534bced411 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:27.848632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b42ba-0d42-454e-9024-6d534bced411 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:27.848904 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b42ba-0d42-454e-9024-6d534bced411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:27.860205 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b42ba-0d42-454e-9024-6d534bced411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:27.861776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b42ba-0d42-454e-9024-6d534bced411 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:27.873959 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1224/2460] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:28:28.175880 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde485c-8516-4356-ade0-23e5406fe201 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:28.177360 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1bde485c-8516-4356-ade0-23e5406fe201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:28.190438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde485c-8516-4356-ade0-23e5406fe201 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:28.196622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c350bb-9587-4ead-a2d2-f0fc4970cbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:28.197529 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c350bb-9587-4ead-a2d2-f0fc4970cbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:28.197795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c350bb-9587-4ead-a2d2-f0fc4970cbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:28.198274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c350bb-9587-4ead-a2d2-f0fc4970cbc9 admin admin] PATH_INFO: `/v3/projects/562e4524130f46ec820bae1a34d746ed` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:28.199558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c350bb-9587-4ead-a2d2-f0fc4970cbc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=562e4524130f46ec820bae1a34d746ed)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:28.201547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c350bb-9587-4ead-a2d2-f0fc4970cbc9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:28.258592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f8c350bb-9587-4ead-a2d2-f0fc4970cbc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562e4524130f46ec820bae1a34d746ed', 'request_id': 'req-f8c350bb-9587-4ead-a2d2-f0fc4970cbc9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:28.265350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f8c350bb-9587-4ead-a2d2-f0fc4970cbc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562e4524130f46ec820bae1a34d746ed', 'request_id': 'req-f8c350bb-9587-4ead-a2d2-f0fc4970cbc9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:28.271919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f8c350bb-9587-4ead-a2d2-f0fc4970cbc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562e4524130f46ec820bae1a34d746ed', 'request_id': 'req-f8c350bb-9587-4ead-a2d2-f0fc4970cbc9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:28.287146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f8c350bb-9587-4ead-a2d2-f0fc4970cbc9 admin admin] The token cache is being invalidate because project 562e4524130f46ec820bae1a34d746ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:28:28.287440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f8c350bb-9587-4ead-a2d2-f0fc4970cbc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:28.288088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f8c350bb-9587-4ead-a2d2-f0fc4970cbc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:28.289901 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1237/2461] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:28:28 2022] DELETE /identity/v3/projects/562e4524130f46ec820bae1a34d746ed => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:28:28.294802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb1dda-6440-4363-adae-3c88cbd9ad5d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:28.295280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb1dda-6440-4363-adae-3c88cbd9ad5d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:28.295651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb1dda-6440-4363-adae-3c88cbd9ad5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:28.315755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-43eb1dda-6440-4363-adae-3c88cbd9ad5d None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:28:28.317002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-43eb1dda-6440-4363-adae-3c88cbd9ad5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:28.382103 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1225/2462] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:28:28.390570 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3d6b4-0f5c-4c84-b464-d79569d3d4a4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:28.391035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3d6b4-0f5c-4c84-b464-d79569d3d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:28.391996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3d6b4-0f5c-4c84-b464-d79569d3d4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:28.414354 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f8b3d6b4-0f5c-4c84-b464-d79569d3d4a4 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:28:28.415597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f8b3d6b4-0f5c-4c84-b464-d79569d3d4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:28.424495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1238/2463] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:28:28.428928 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb1dda-6440-4363-adae-3c88cbd9ad5d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:28.441704 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb1dda-6440-4363-adae-3c88cbd9ad5d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:28.447028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb46c7-efd4-4066-9832-4edfb8fed808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:28.447823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb46c7-efd4-4066-9832-4edfb8fed808 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:28.448809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb46c7-efd4-4066-9832-4edfb8fed808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:28.448809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb46c7-efd4-4066-9832-4edfb8fed808 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:28.450480 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb46c7-efd4-4066-9832-4edfb8fed808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:28:28.450480 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb46c7-efd4-4066-9832-4edfb8fed808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:28.452061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb46c7-efd4-4066-9832-4edfb8fed808 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:28.467774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1226/2464] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:28:28.472677 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3d6b4-0f5c-4c84-b464-d79569d3d4a4 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:28.483546 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3d6b4-0f5c-4c84-b464-d79569d3d4a4 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:28.489809 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74062c-58ee-4ba8-8a9f-2816a402a080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:28.490497 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74062c-58ee-4ba8-8a9f-2816a402a080 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:28.490936 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74062c-58ee-4ba8-8a9f-2816a402a080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:28.491247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74062c-58ee-4ba8-8a9f-2816a402a080 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:28.492596 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74062c-58ee-4ba8-8a9f-2816a402a080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:28.494593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74062c-58ee-4ba8-8a9f-2816a402a080 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:28.536243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1239/2465] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:28:28 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:28:28.537507 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb46c7-efd4-4066-9832-4edfb8fed808 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:28.549631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb46c7-efd4-4066-9832-4edfb8fed808 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:28.624729 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022759f-52e1-4eb0-bc26-226b0813b81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:28.625403 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022759f-52e1-4eb0-bc26-226b0813b81a admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:28.625686 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022759f-52e1-4eb0-bc26-226b0813b81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:28.625987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022759f-52e1-4eb0-bc26-226b0813b81a admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:28.626698 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022759f-52e1-4eb0-bc26-226b0813b81a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:28.628736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022759f-52e1-4eb0-bc26-226b0813b81a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:28.650154 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1227/2466] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:28:28 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:28:28.654176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74062c-58ee-4ba8-8a9f-2816a402a080 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:28.665172 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74062c-58ee-4ba8-8a9f-2816a402a080 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:28.669886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d843632-9689-4bdc-ae81-98355a33cd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:28.670549 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d843632-9689-4bdc-ae81-98355a33cd13 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:28.670828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d843632-9689-4bdc-ae81-98355a33cd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:28.671129 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d843632-9689-4bdc-ae81-98355a33cd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:28.671827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d843632-9689-4bdc-ae81-98355a33cd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:28.673501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d843632-9689-4bdc-ae81-98355a33cd13 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:28.686106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1240/2467] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:28:28.691877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022759f-52e1-4eb0-bc26-226b0813b81a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:28.703822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022759f-52e1-4eb0-bc26-226b0813b81a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:28.710217 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c99fcd-399b-4b20-b519-b14d6d89ff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:28.711078 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c99fcd-399b-4b20-b519-b14d6d89ff41 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:28.711517 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c99fcd-399b-4b20-b519-b14d6d89ff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:28.711820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c99fcd-399b-4b20-b519-b14d6d89ff41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:28.712992 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c99fcd-399b-4b20-b519-b14d6d89ff41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:28.714636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c99fcd-399b-4b20-b519-b14d6d89ff41 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:28.727736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1228/2468] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:28:28.731779 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d843632-9689-4bdc-ae81-98355a33cd13 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:28.746939 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d843632-9689-4bdc-ae81-98355a33cd13 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:28.752723 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72506a-7465-4034-9b59-557e321279f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:28.753621 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72506a-7465-4034-9b59-557e321279f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:28.753900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72506a-7465-4034-9b59-557e321279f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:28.754315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72506a-7465-4034-9b59-557e321279f4 admin admin] PATH_INFO: `/v3/projects/b67731587ec0478aa737429572417ed1/users/17f48784df644a6faa59a4dcd446f7ac/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:28.774610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72506a-7465-4034-9b59-557e321279f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b67731587ec0478aa737429572417ed1, user_id=17f48784df644a6faa59a4dcd446f7ac, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:28.777391 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72506a-7465-4034-9b59-557e321279f4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:28.793511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1241/2469] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:28:28 2022] PUT /identity/v3/projects/b67731587ec0478aa737429572417ed1/users/17f48784df644a6faa59a4dcd446f7ac/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:28:28.804999 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c7bcd-78a6-4a73-b7af-d0582055d8f0 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:28.805359 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c7bcd-78a6-4a73-b7af-d0582055d8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:28.805568 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c7bcd-78a6-4a73-b7af-d0582055d8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:28.834884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a37c7bcd-78a6-4a73-b7af-d0582055d8f0 None None] MFA Rules not processed for user `17f48784df644a6faa59a4dcd446f7ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:28:28.836866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a37c7bcd-78a6-4a73-b7af-d0582055d8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:28.859321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:28.915013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1229/2470] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:28:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:28:28.927238 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72506a-7465-4034-9b59-557e321279f4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:28.929883 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7d72506a-7465-4034-9b59-557e321279f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:29.006700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72506a-7465-4034-9b59-557e321279f4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:29.011078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76c235-3c15-4a7c-87e5-8511723d7c9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:29.011747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76c235-3c15-4a7c-87e5-8511723d7c9b service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:29.012036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76c235-3c15-4a7c-87e5-8511723d7c9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:29.012350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76c235-3c15-4a7c-87e5-8511723d7c9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:29.021614 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76c235-3c15-4a7c-87e5-8511723d7c9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:29.023102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76c235-3c15-4a7c-87e5-8511723d7c9b service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:29.032894 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1242/2471] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:28:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:28:34.293287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c7bcd-78a6-4a73-b7af-d0582055d8f0 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:34.294871 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a37c7bcd-78a6-4a73-b7af-d0582055d8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:34.359142 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76c235-3c15-4a7c-87e5-8511723d7c9b service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:34.360831 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2e76c235-3c15-4a7c-87e5-8511723d7c9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:34.382663 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c7bcd-78a6-4a73-b7af-d0582055d8f0 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:34.396363 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6349b8e-bae3-43ed-aa66-29d10be946c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3474e40117440498f0fe99f743df50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:34.400017 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:34.401233 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6349b8e-bae3-43ed-aa66-29d10be946c6 service placement] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:34.401662 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6349b8e-bae3-43ed-aa66-29d10be946c6 service placement] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:34.401992 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6349b8e-bae3-43ed-aa66-29d10be946c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:34.410032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d6349b8e-bae3-43ed-aa66-29d10be946c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:34.425986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6349b8e-bae3-43ed-aa66-29d10be946c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:34.427635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6349b8e-bae3-43ed-aa66-29d10be946c6 service placement] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:34.439647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1230/2472] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:28:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:28:34.489894 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76c235-3c15-4a7c-87e5-8511723d7c9b service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:34.494840 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b4a16-a8a6-46d2-83a8-6b9e63a51e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:34.495726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b4a16-a8a6-46d2-83a8-6b9e63a51e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:34.496206 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b4a16-a8a6-46d2-83a8-6b9e63a51e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:34.497266 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b4a16-a8a6-46d2-83a8-6b9e63a51e2f admin admin] PATH_INFO: `/v3/users/1f570f01d2cf4ec782fd28ffdbad8a0d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:34.499317 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b4a16-a8a6-46d2-83a8-6b9e63a51e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f570f01d2cf4ec782fd28ffdbad8a0d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:34.501942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b4a16-a8a6-46d2-83a8-6b9e63a51e2f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:34.564935 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ba3b4a16-a8a6-46d2-83a8-6b9e63a51e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f570f01d2cf4ec782fd28ffdbad8a0d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:34.565621 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ba3b4a16-a8a6-46d2-83a8-6b9e63a51e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f570f01d2cf4ec782fd28ffdbad8a0d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:34.566294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ba3b4a16-a8a6-46d2-83a8-6b9e63a51e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f570f01d2cf4ec782fd28ffdbad8a0d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:34.575361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ba3b4a16-a8a6-46d2-83a8-6b9e63a51e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f570f01d2cf4ec782fd28ffdbad8a0d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:34.587444 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ba3b4a16-a8a6-46d2-83a8-6b9e63a51e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f570f01d2cf4ec782fd28ffdbad8a0d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:34.609910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1243/2473] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:28:34 2022] DELETE /identity/v3/users/1f570f01d2cf4ec782fd28ffdbad8a0d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:28:34.664086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6349b8e-bae3-43ed-aa66-29d10be946c6 service placement] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:34.665976 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d6349b8e-bae3-43ed-aa66-29d10be946c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:34.731982 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6349b8e-bae3-43ed-aa66-29d10be946c6 service placement] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:34.787876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9acf9d-34af-4ab2-b845-b3f7b7812c08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '623c97746d304c6ba971e79e4dbeb730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:34.788927 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9acf9d-34af-4ab2-b845-b3f7b7812c08 service glance] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:34.789220 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9acf9d-34af-4ab2-b845-b3f7b7812c08 service glance] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:34.789502 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9acf9d-34af-4ab2-b845-b3f7b7812c08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:34.791409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ad9acf9d-34af-4ab2-b845-b3f7b7812c08 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:34.816073 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:34.889203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b4a16-a8a6-46d2-83a8-6b9e63a51e2f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:34.890855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ba3b4a16-a8a6-46d2-83a8-6b9e63a51e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:34.908634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9acf9d-34af-4ab2-b845-b3f7b7812c08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:34.910496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9acf9d-34af-4ab2-b845-b3f7b7812c08 service glance] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:34.934523 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1231/2474] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:28:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:28:34.964974 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b4a16-a8a6-46d2-83a8-6b9e63a51e2f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:34.969686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:34.971010 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:34.971010 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:34.971382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc admin admin] PATH_INFO: `/v3/projects/da8d69531b814363bf338262397fc5e9` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:34.972377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=da8d69531b814363bf338262397fc5e9)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:34.974338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:35.004734 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9acf9d-34af-4ab2-b845-b3f7b7812c08 service glance] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:35.006365 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ad9acf9d-34af-4ab2-b845-b3f7b7812c08 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:35.024122 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:35.033483 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da8d69531b814363bf338262397fc5e9', 'request_id': 'req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:35.043828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da8d69531b814363bf338262397fc5e9', 'request_id': 'req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:35.051626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da8d69531b814363bf338262397fc5e9', 'request_id': 'req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:35.068520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9acf9d-34af-4ab2-b845-b3f7b7812c08 service glance] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:35.071891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc admin admin] The token cache is being invalidate because project da8d69531b814363bf338262397fc5e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:28:35.072076 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:35.072812 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:35.075322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1244/2475] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:28:34 2022] DELETE /identity/v3/projects/da8d69531b814363bf338262397fc5e9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:28:35.079209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:35.080717 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:35.130384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecb432-d137-4377-9498-ff98ede3d6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:35.131206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecb432-d137-4377-9498-ff98ede3d6fa service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:35.131524 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecb432-d137-4377-9498-ff98ede3d6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:35.131774 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecb432-d137-4377-9498-ff98ede3d6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:35.134506 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-57ecb432-d137-4377-9498-ff98ede3d6fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:35.144281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecb432-d137-4377-9498-ff98ede3d6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:35.145740 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecb432-d137-4377-9498-ff98ede3d6fa service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:35.153712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed86ca-3c79-4ec6-b9f0-5c49b1438ddc admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:35.154225 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1232/2476] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:28:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:28:35.165579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9189fe1-c189-475b-9f55-0ffc008129e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:35.166729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9189fe1-c189-475b-9f55-0ffc008129e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:35.167107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9189fe1-c189-475b-9f55-0ffc008129e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:35.167533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9189fe1-c189-475b-9f55-0ffc008129e1 admin admin] PATH_INFO: `/v3/users/e12395eba04842aba77235ea43b89c32` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:35.169651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9189fe1-c189-475b-9f55-0ffc008129e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e12395eba04842aba77235ea43b89c32)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:35.173025 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9189fe1-c189-475b-9f55-0ffc008129e1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:35.231486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c9189fe1-c189-475b-9f55-0ffc008129e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e12395eba04842aba77235ea43b89c32'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:35.232808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c9189fe1-c189-475b-9f55-0ffc008129e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e12395eba04842aba77235ea43b89c32'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:35.234018 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c9189fe1-c189-475b-9f55-0ffc008129e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e12395eba04842aba77235ea43b89c32'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:35.243798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecb432-d137-4377-9498-ff98ede3d6fa service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:35.244862 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c9189fe1-c189-475b-9f55-0ffc008129e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e12395eba04842aba77235ea43b89c32'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:35.246178 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-57ecb432-d137-4377-9498-ff98ede3d6fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:35.254659 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c9189fe1-c189-475b-9f55-0ffc008129e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e12395eba04842aba77235ea43b89c32'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:35.258829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecb432-d137-4377-9498-ff98ede3d6fa service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:35.262527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51384c2e-5440-4a70-89a3-7c0f21e0dafb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:35.263173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51384c2e-5440-4a70-89a3-7c0f21e0dafb service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:35.263460 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51384c2e-5440-4a70-89a3-7c0f21e0dafb service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:35.263736 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51384c2e-5440-4a70-89a3-7c0f21e0dafb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:35.265586 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-51384c2e-5440-4a70-89a3-7c0f21e0dafb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:35.277826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1245/2477] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:28:35 2022] DELETE /identity/v3/users/e12395eba04842aba77235ea43b89c32 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:28:35.318661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:35.346753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51384c2e-5440-4a70-89a3-7c0f21e0dafb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:35.348218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51384c2e-5440-4a70-89a3-7c0f21e0dafb service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:35.360706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1233/2478] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:28:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:28:35.487225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9189fe1-c189-475b-9f55-0ffc008129e1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:35.488030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c9189fe1-c189-475b-9f55-0ffc008129e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:35.563480 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:35.591704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9189fe1-c189-475b-9f55-0ffc008129e1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:35.596982 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:35.597925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:35.598287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:35.598672 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64 admin admin] PATH_INFO: `/v3/projects/c2911299b1e746fdb8395c18e134aa6d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:35.600119 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2911299b1e746fdb8395c18e134aa6d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:35.602835 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:35.681088 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2911299b1e746fdb8395c18e134aa6d', 'request_id': 'req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:35.692808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2911299b1e746fdb8395c18e134aa6d', 'request_id': 'req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:35.700228 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2911299b1e746fdb8395c18e134aa6d', 'request_id': 'req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:35.720817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64 admin admin] The token cache is being invalidate because project c2911299b1e746fdb8395c18e134aa6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:28:35.722561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:35.723586 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:28:35.726214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1246/2479] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:28:35 2022] DELETE /identity/v3/projects/c2911299b1e746fdb8395c18e134aa6d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:28:37.370366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b866f0b-67b4-4b5c-ba16-b07a0f0c02ca None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:37.371088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b866f0b-67b4-4b5c-ba16-b07a0f0c02ca None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:37.371088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b866f0b-67b4-4b5c-ba16-b07a0f0c02ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:37.402197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-7b866f0b-67b4-4b5c-ba16-b07a0f0c02ca None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:28:37.403413 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7b866f0b-67b4-4b5c-ba16-b07a0f0c02ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:37.476958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1234/2480] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 25 16:28:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:28:37.489480 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:28:37.491167 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:28:37.563798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a1663-bb17-48c3-bb9a-4e282bd3cd64 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:28:37.568695 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b4d7d-3244-4c5b-9861-5d40bc5d7ab8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:28:37.569346 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b4d7d-3244-4c5b-9861-5d40bc5d7ab8 service swift] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:28:37.569673 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b4d7d-3244-4c5b-9861-5d40bc5d7ab8 service swift] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:28:37.569942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b4d7d-3244-4c5b-9861-5d40bc5d7ab8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:28:37.578390 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b4d7d-3244-4c5b-9861-5d40bc5d7ab8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:28:37.580781 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b4d7d-3244-4c5b-9861-5d40bc5d7ab8 service swift] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:28:37.590835 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1247/2481] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:28:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 16:28:47.467735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=37 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:47.585050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=61,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:04.462151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aa6f7-8c4d-4aed-bab3-2441c9e6c7b8 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:04.462669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aa6f7-8c4d-4aed-bab3-2441c9e6c7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:04.462773 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aa6f7-8c4d-4aed-bab3-2441c9e6c7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:04.481953 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-0e6aa6f7-8c4d-4aed-bab3-2441c9e6c7b8 None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:04.483158 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0e6aa6f7-8c4d-4aed-bab3-2441c9e6c7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:04.490383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1235/2482] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jul 25 16:29:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:04.503139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b4d7d-3244-4c5b-9861-5d40bc5d7ab8 service swift] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:04.513474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b4d7d-3244-4c5b-9861-5d40bc5d7ab8 service swift] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:04.518443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcb798-b9fe-4272-8f1d-c89c8a028fde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:04.519083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcb798-b9fe-4272-8f1d-c89c8a028fde service swift] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:04.519364 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcb798-b9fe-4272-8f1d-c89c8a028fde service swift] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:04.519640 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcb798-b9fe-4272-8f1d-c89c8a028fde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:04.528024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcb798-b9fe-4272-8f1d-c89c8a028fde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:04.529861 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcb798-b9fe-4272-8f1d-c89c8a028fde service swift] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:04.538618 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1248/2483] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:29:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:11.217387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aa6f7-8c4d-4aed-bab3-2441c9e6c7b8 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:11.218865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0e6aa6f7-8c4d-4aed-bab3-2441c9e6c7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:11.285496 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aa6f7-8c4d-4aed-bab3-2441c9e6c7b8 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:11.290587 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9205be-bbb7-450b-ab8e-0c241a6c4f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:11.291485 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9205be-bbb7-450b-ab8e-0c241a6c4f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:11.291767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9205be-bbb7-450b-ab8e-0c241a6c4f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:11.292045 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9205be-bbb7-450b-ab8e-0c241a6c4f29 admin admin] PATH_INFO: `/v3/users/17f48784df644a6faa59a4dcd446f7ac` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:11.293287 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9205be-bbb7-450b-ab8e-0c241a6c4f29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f48784df644a6faa59a4dcd446f7ac)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:11.295218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9205be-bbb7-450b-ab8e-0c241a6c4f29 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:11.347501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-de9205be-bbb7-450b-ab8e-0c241a6c4f29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f48784df644a6faa59a4dcd446f7ac'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:11.359571 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-de9205be-bbb7-450b-ab8e-0c241a6c4f29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f48784df644a6faa59a4dcd446f7ac'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:11.360318 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-de9205be-bbb7-450b-ab8e-0c241a6c4f29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f48784df644a6faa59a4dcd446f7ac'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:11.361665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-de9205be-bbb7-450b-ab8e-0c241a6c4f29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f48784df644a6faa59a4dcd446f7ac'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:11.374527 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-de9205be-bbb7-450b-ab8e-0c241a6c4f29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f48784df644a6faa59a4dcd446f7ac'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:11.387320 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1236/2484] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:29:11 2022] DELETE /identity/v3/users/17f48784df644a6faa59a4dcd446f7ac => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:29:11.392184 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f1078-eb5b-4ad4-a721-8f8b409f0202 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:11.392731 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f1078-eb5b-4ad4-a721-8f8b409f0202 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:11.392830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f1078-eb5b-4ad4-a721-8f8b409f0202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:11.413281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-969f1078-eb5b-4ad4-a721-8f8b409f0202 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:11.414584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-969f1078-eb5b-4ad4-a721-8f8b409f0202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:11.482452 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1249/2485] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:11.492898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9205be-bbb7-450b-ab8e-0c241a6c4f29 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:11.494372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-de9205be-bbb7-450b-ab8e-0c241a6c4f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:11.554097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9205be-bbb7-450b-ab8e-0c241a6c4f29 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:11.557936 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b75d7-ab8a-46a5-9f5e-adc77b1de998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:11.558583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b75d7-ab8a-46a5-9f5e-adc77b1de998 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:11.558867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b75d7-ab8a-46a5-9f5e-adc77b1de998 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:11.559153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b75d7-ab8a-46a5-9f5e-adc77b1de998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:11.568691 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b75d7-ab8a-46a5-9f5e-adc77b1de998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:11.569876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b75d7-ab8a-46a5-9f5e-adc77b1de998 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:11.579924 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1237/2486] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:29:11.861014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f1078-eb5b-4ad4-a721-8f8b409f0202 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:11.862470 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-969f1078-eb5b-4ad4-a721-8f8b409f0202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:11.875060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f1078-eb5b-4ad4-a721-8f8b409f0202 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:11.880371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cb713-0712-431f-9fd0-ddba21d2407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:11.881834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cb713-0712-431f-9fd0-ddba21d2407f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:11.882254 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cb713-0712-431f-9fd0-ddba21d2407f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:11.882414 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cb713-0712-431f-9fd0-ddba21d2407f admin admin] PATH_INFO: `/v3/projects/b67731587ec0478aa737429572417ed1` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:11.883812 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cb713-0712-431f-9fd0-ddba21d2407f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b67731587ec0478aa737429572417ed1)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:11.885945 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cb713-0712-431f-9fd0-ddba21d2407f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:11.940848 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7c4cb713-0712-431f-9fd0-ddba21d2407f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b67731587ec0478aa737429572417ed1', 'request_id': 'req-7c4cb713-0712-431f-9fd0-ddba21d2407f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:11.947754 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7c4cb713-0712-431f-9fd0-ddba21d2407f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b67731587ec0478aa737429572417ed1', 'request_id': 'req-7c4cb713-0712-431f-9fd0-ddba21d2407f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:11.954989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7c4cb713-0712-431f-9fd0-ddba21d2407f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b67731587ec0478aa737429572417ed1', 'request_id': 'req-7c4cb713-0712-431f-9fd0-ddba21d2407f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:11.968718 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7c4cb713-0712-431f-9fd0-ddba21d2407f admin admin] The token cache is being invalidate because project b67731587ec0478aa737429572417ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:29:11.969011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7c4cb713-0712-431f-9fd0-ddba21d2407f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:11.969649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7c4cb713-0712-431f-9fd0-ddba21d2407f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:11.971218 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1250/2487] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:29:11 2022] DELETE /identity/v3/projects/b67731587ec0478aa737429572417ed1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:29:11.977130 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972a44c-8c35-49e0-9ee7-166e7fc1c4f4 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:11.977445 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972a44c-8c35-49e0-9ee7-166e7fc1c4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:11.977720 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972a44c-8c35-49e0-9ee7-166e7fc1c4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:11.999567 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e972a44c-8c35-49e0-9ee7-166e7fc1c4f4 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:12.000970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e972a44c-8c35-49e0-9ee7-166e7fc1c4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:12.012431 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:12.098581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1238/2488] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:12.106266 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649be42c-5329-47f4-922a-37ecea66cdde None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:12.106509 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649be42c-5329-47f4-922a-37ecea66cdde None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:12.106798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649be42c-5329-47f4-922a-37ecea66cdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:12.135663 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-649be42c-5329-47f4-922a-37ecea66cdde None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:12.137518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-649be42c-5329-47f4-922a-37ecea66cdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:12.152426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1251/2489] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:29:12.156638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972a44c-8c35-49e0-9ee7-166e7fc1c4f4 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:12.175166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972a44c-8c35-49e0-9ee7-166e7fc1c4f4 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:12.181977 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd44ab-42d9-46f5-906a-bc1712a977ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:12.182801 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd44ab-42d9-46f5-906a-bc1712a977ab admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:12.183183 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd44ab-42d9-46f5-906a-bc1712a977ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:12.183514 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd44ab-42d9-46f5-906a-bc1712a977ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:12.184408 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd44ab-42d9-46f5-906a-bc1712a977ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:29:12.184813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd44ab-42d9-46f5-906a-bc1712a977ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:12.187264 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd44ab-42d9-46f5-906a-bc1712a977ab admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:12.202291 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1239/2490] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:29:12.206765 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649be42c-5329-47f4-922a-37ecea66cdde None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:12.219014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649be42c-5329-47f4-922a-37ecea66cdde None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:12.224374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910c169-c586-4925-afcb-9b504e3bc1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:12.225161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910c169-c586-4925-afcb-9b504e3bc1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:12.225543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910c169-c586-4925-afcb-9b504e3bc1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:12.225827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910c169-c586-4925-afcb-9b504e3bc1d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:12.226519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910c169-c586-4925-afcb-9b504e3bc1d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:12.228491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910c169-c586-4925-afcb-9b504e3bc1d2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:12.273897 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1252/2491] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:29:12 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:29:12.275459 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd44ab-42d9-46f5-906a-bc1712a977ab admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:12.287145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd44ab-42d9-46f5-906a-bc1712a977ab admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:12.351455 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5c8dd-1ce9-48df-bcd2-2dd2a7bdb04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:12.352133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5c8dd-1ce9-48df-bcd2-2dd2a7bdb04c admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:12.352449 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5c8dd-1ce9-48df-bcd2-2dd2a7bdb04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:12.352731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5c8dd-1ce9-48df-bcd2-2dd2a7bdb04c admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:12.353421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5c8dd-1ce9-48df-bcd2-2dd2a7bdb04c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:12.355353 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5c8dd-1ce9-48df-bcd2-2dd2a7bdb04c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:12.377627 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1240/2492] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:29:12 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:29:12.382141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910c169-c586-4925-afcb-9b504e3bc1d2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:12.392132 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910c169-c586-4925-afcb-9b504e3bc1d2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:12.399071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecdb60-2123-4a5f-aec4-c5b2e2ba1d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:12.399071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecdb60-2123-4a5f-aec4-c5b2e2ba1d85 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:12.399071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecdb60-2123-4a5f-aec4-c5b2e2ba1d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:12.399071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecdb60-2123-4a5f-aec4-c5b2e2ba1d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:12.400426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ecdb60-2123-4a5f-aec4-c5b2e2ba1d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:12.400869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ecdb60-2123-4a5f-aec4-c5b2e2ba1d85 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:12.411024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1253/2493] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:29:12.415797 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5c8dd-1ce9-48df-bcd2-2dd2a7bdb04c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:12.425927 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5c8dd-1ce9-48df-bcd2-2dd2a7bdb04c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:12.430913 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf619f-1235-4352-a1aa-0b2f22eb887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:12.431575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf619f-1235-4352-a1aa-0b2f22eb887d admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:12.431855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf619f-1235-4352-a1aa-0b2f22eb887d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:12.432134 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf619f-1235-4352-a1aa-0b2f22eb887d admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:12.432882 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf619f-1235-4352-a1aa-0b2f22eb887d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:12.434518 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf619f-1235-4352-a1aa-0b2f22eb887d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:12.445396 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1241/2494] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:29:12.449555 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecdb60-2123-4a5f-aec4-c5b2e2ba1d85 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:12.460050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecdb60-2123-4a5f-aec4-c5b2e2ba1d85 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:12.464690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97703a33-f3ca-4784-b970-c77ea4a2716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:12.465575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703a33-f3ca-4784-b970-c77ea4a2716e admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:12.465860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703a33-f3ca-4784-b970-c77ea4a2716e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:12.466132 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703a33-f3ca-4784-b970-c77ea4a2716e admin admin] PATH_INFO: `/v3/projects/b1ffec46100d4fef9eb2c5730306e668/users/95f5629761ed4d5c8d576876043cbcd5/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:12.482264 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97703a33-f3ca-4784-b970-c77ea4a2716e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ffec46100d4fef9eb2c5730306e668, user_id=95f5629761ed4d5c8d576876043cbcd5, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:12.484960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97703a33-f3ca-4784-b970-c77ea4a2716e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:12.493636 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:12.501987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1254/2495] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:29:12 2022] PUT /identity/v3/projects/b1ffec46100d4fef9eb2c5730306e668/users/95f5629761ed4d5c8d576876043cbcd5/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:29:12.513695 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d1c47-54ea-4ee4-af7a-ca64a99f53d5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:12.514126 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d1c47-54ea-4ee4-af7a-ca64a99f53d5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:12.514509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d1c47-54ea-4ee4-af7a-ca64a99f53d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:12.545434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-176d1c47-54ea-4ee4-af7a-ca64a99f53d5 None None] MFA Rules not processed for user `95f5629761ed4d5c8d576876043cbcd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:12.546572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-176d1c47-54ea-4ee4-af7a-ca64a99f53d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:12.623254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1242/2496] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:29:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:12.634879 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97703a33-f3ca-4784-b970-c77ea4a2716e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:12.637840 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-97703a33-f3ca-4784-b970-c77ea4a2716e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:12.701062 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97703a33-f3ca-4784-b970-c77ea4a2716e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:12.705575 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a63816-4cb9-408a-b89c-c4099f5169b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:12.706343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a63816-4cb9-408a-b89c-c4099f5169b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:12.706769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a63816-4cb9-408a-b89c-c4099f5169b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:12.707142 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a63816-4cb9-408a-b89c-c4099f5169b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:12.717022 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a63816-4cb9-408a-b89c-c4099f5169b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:12.718491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a63816-4cb9-408a-b89c-c4099f5169b4 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:12.728044 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1255/2497] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:29:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:29:15.076366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d1c47-54ea-4ee4-af7a-ca64a99f53d5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:15.085991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d1c47-54ea-4ee4-af7a-ca64a99f53d5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:15.089570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18423b49-c38f-4d71-bce1-79d804dfd792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:15.090312 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18423b49-c38f-4d71-bce1-79d804dfd792 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:15.090641 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18423b49-c38f-4d71-bce1-79d804dfd792 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:15.090954 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18423b49-c38f-4d71-bce1-79d804dfd792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:15.093207 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-18423b49-c38f-4d71-bce1-79d804dfd792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:15.104023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:15.170763 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18423b49-c38f-4d71-bce1-79d804dfd792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:15.172225 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18423b49-c38f-4d71-bce1-79d804dfd792 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:15.188836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1243/2498] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:29:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:29:15.202541 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc324b6-4a15-429a-a93b-e5495df013a4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:15.203114 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc324b6-4a15-429a-a93b-e5495df013a4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:15.203228 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc324b6-4a15-429a-a93b-e5495df013a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:15.224493 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9cc324b6-4a15-429a-a93b-e5495df013a4 None None] MFA Rules not processed for user `95f5629761ed4d5c8d576876043cbcd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:15.226496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9cc324b6-4a15-429a-a93b-e5495df013a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:15.241929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1256/2499] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:29:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:15.354135 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18423b49-c38f-4d71-bce1-79d804dfd792 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:15.355531 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-18423b49-c38f-4d71-bce1-79d804dfd792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:15.411078 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18423b49-c38f-4d71-bce1-79d804dfd792 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:15.414857 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4a8b6-b696-478b-9b81-c05ec586960c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:15.415512 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4a8b6-b696-478b-9b81-c05ec586960c service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:15.415798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4a8b6-b696-478b-9b81-c05ec586960c service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:15.416074 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4a8b6-b696-478b-9b81-c05ec586960c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:15.417940 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-45e4a8b6-b696-478b-9b81-c05ec586960c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:15.432836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4a8b6-b696-478b-9b81-c05ec586960c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:15.434401 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4a8b6-b696-478b-9b81-c05ec586960c service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:15.447116 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1244/2500] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:29:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:29:25.218831 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=30 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:25.441408 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=55 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:33.500194 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abb15b-e66a-4f85-af50-44c9f1181dda None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:33.500743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abb15b-e66a-4f85-af50-44c9f1181dda None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:33.500842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abb15b-e66a-4f85-af50-44c9f1181dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:33.520282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-07abb15b-e66a-4f85-af50-44c9f1181dda None None] MFA Rules not processed for user `10c3b4f5766449c19198efc35dc80429`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:33.521517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-07abb15b-e66a-4f85-af50-44c9f1181dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:33.578573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1257/2501] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:29:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:29:35.094371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4a8b6-b696-478b-9b81-c05ec586960c service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:35.096346 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-45e4a8b6-b696-478b-9b81-c05ec586960c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:35.108949 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4a8b6-b696-478b-9b81-c05ec586960c service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:35.113062 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f3954-b618-4803-87a7-f17daf662b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:35.113710 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f3954-b618-4803-87a7-f17daf662b08 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:35.114047 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f3954-b618-4803-87a7-f17daf662b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:35.114271 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f3954-b618-4803-87a7-f17daf662b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:35.116469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2c8f3954-b618-4803-87a7-f17daf662b08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:35.127407 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f3954-b618-4803-87a7-f17daf662b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:35.128935 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f3954-b618-4803-87a7-f17daf662b08 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:35.138524 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1245/2502] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:29:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:29:41.053339 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abb15b-e66a-4f85-af50-44c9f1181dda None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:41.054794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-07abb15b-e66a-4f85-af50-44c9f1181dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:41.074475 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abb15b-e66a-4f85-af50-44c9f1181dda None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:41.080426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7be58c-c50e-476f-b7da-ee300ad440ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:41.081095 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7be58c-c50e-476f-b7da-ee300ad440ce service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:41.081380 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7be58c-c50e-476f-b7da-ee300ad440ce service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:41.081649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7be58c-c50e-476f-b7da-ee300ad440ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:41.084516 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7e7be58c-c50e-476f-b7da-ee300ad440ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:41.200530 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7be58c-c50e-476f-b7da-ee300ad440ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:41.202802 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7be58c-c50e-476f-b7da-ee300ad440ce service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:41.241465 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1258/2503] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:29:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:29:43.364178 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4c5fa-f0df-4edb-8c54-d1d66db976ce None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:43.365038 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4c5fa-f0df-4edb-8c54-d1d66db976ce None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:43.365038 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4c5fa-f0df-4edb-8c54-d1d66db976ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:43.443273 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-0ce4c5fa-f0df-4edb-8c54-d1d66db976ce None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:43.444660 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0ce4c5fa-f0df-4edb-8c54-d1d66db976ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:43.533433 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1246/2504] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 25 16:29:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:43.556440 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7be58c-c50e-476f-b7da-ee300ad440ce service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:43.557902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7e7be58c-c50e-476f-b7da-ee300ad440ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:43.654671 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:43.668408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7be58c-c50e-476f-b7da-ee300ad440ce service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:43.673959 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d5701-b32b-40e6-8afa-79a68657361f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:43.674622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d5701-b32b-40e6-8afa-79a68657361f service swift] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:43.675008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d5701-b32b-40e6-8afa-79a68657361f service swift] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:43.675191 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d5701-b32b-40e6-8afa-79a68657361f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:43.688403 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d5701-b32b-40e6-8afa-79a68657361f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:43.690948 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d5701-b32b-40e6-8afa-79a68657361f service swift] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:43.700752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1259/2505] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:29:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:44.249863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8ce6e-719d-4b87-abba-5677648172d3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:44.250149 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8ce6e-719d-4b87-abba-5677648172d3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:44.250429 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8ce6e-719d-4b87-abba-5677648172d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:44.269854 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a0f8ce6e-719d-4b87-abba-5677648172d3 None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:44.271684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a0f8ce6e-719d-4b87-abba-5677648172d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:44.280690 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1247/2506] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jul 25 16:29:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:44.293060 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d5701-b32b-40e6-8afa-79a68657361f service swift] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:44.303465 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d5701-b32b-40e6-8afa-79a68657361f service swift] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:44.308624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c889-6745-4d33-b6be-d57435ba8b17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:44.309204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c889-6745-4d33-b6be-d57435ba8b17 service swift] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:44.309489 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c889-6745-4d33-b6be-d57435ba8b17 service swift] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:44.309769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c889-6745-4d33-b6be-d57435ba8b17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:44.318486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c889-6745-4d33-b6be-d57435ba8b17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:44.320059 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c889-6745-4d33-b6be-d57435ba8b17 service swift] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:44.328418 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1260/2507] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:29:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:44.545068 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e0307-5432-4905-adb3-e0e20cc0a526 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:44.545577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e0307-5432-4905-adb3-e0e20cc0a526 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:44.545732 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e0307-5432-4905-adb3-e0e20cc0a526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:44.565696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6e1e0307-5432-4905-adb3-e0e20cc0a526 None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:44.566848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6e1e0307-5432-4905-adb3-e0e20cc0a526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:44.575246 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1248/2508] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Jul 25 16:29:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:44.587259 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c889-6745-4d33-b6be-d57435ba8b17 service swift] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:44.598784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c889-6745-4d33-b6be-d57435ba8b17 service swift] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:44.603996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88330fe2-7be3-434a-aae9-42d055276a02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:44.604668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330fe2-7be3-434a-aae9-42d055276a02 service swift] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:44.604950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330fe2-7be3-434a-aae9-42d055276a02 service swift] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:44.605225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330fe2-7be3-434a-aae9-42d055276a02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:44.613799 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88330fe2-7be3-434a-aae9-42d055276a02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:44.616067 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88330fe2-7be3-434a-aae9-42d055276a02 service swift] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:44.624141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1261/2509] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:29:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:44.942501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf6507-2d51-4fcf-9afa-c1dc9e970d5d None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:44.943286 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf6507-2d51-4fcf-9afa-c1dc9e970d5d None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:44.943564 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf6507-2d51-4fcf-9afa-c1dc9e970d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:44.963481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-badf6507-2d51-4fcf-9afa-c1dc9e970d5d None None] MFA Rules not processed for user `ea56b6a25f8e46949e6deb8443b20673`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:44.964828 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-badf6507-2d51-4fcf-9afa-c1dc9e970d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:44.971847 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1249/2510] 10.222.0.70 () {58 vars in 967 bytes} [Mon Jul 25 16:29:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:44.984412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88330fe2-7be3-434a-aae9-42d055276a02 service swift] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:44.995594 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88330fe2-7be3-434a-aae9-42d055276a02 service swift] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:45.000799 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874aaa7-2295-4c2f-8147-7d820f709623 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dbc2609b13f45dc883ae18d3d056e76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:45.001437 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874aaa7-2295-4c2f-8147-7d820f709623 service swift] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:45.001717 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874aaa7-2295-4c2f-8147-7d820f709623 service swift] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:45.001991 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874aaa7-2295-4c2f-8147-7d820f709623 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:45.010035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874aaa7-2295-4c2f-8147-7d820f709623 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:45.011592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874aaa7-2295-4c2f-8147-7d820f709623 service swift] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:45.019452 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1262/2511] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Jul 25 16:29:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:46.528117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf6507-2d51-4fcf-9afa-c1dc9e970d5d None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:46.538403 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf6507-2d51-4fcf-9afa-c1dc9e970d5d None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:46.541995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771b925-29eb-4b22-8b8e-c654a4938b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:46.542663 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771b925-29eb-4b22-8b8e-c654a4938b1d service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:46.542947 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771b925-29eb-4b22-8b8e-c654a4938b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:46.543228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771b925-29eb-4b22-8b8e-c654a4938b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:46.544965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5771b925-29eb-4b22-8b8e-c654a4938b1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:46.612707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771b925-29eb-4b22-8b8e-c654a4938b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:46.614299 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771b925-29eb-4b22-8b8e-c654a4938b1d service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:46.627443 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1250/2512] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:29:47.144474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874aaa7-2295-4c2f-8147-7d820f709623 service swift] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:47.154896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874aaa7-2295-4c2f-8147-7d820f709623 service swift] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:47.159386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f625d7b-8fb4-4218-ba00-037a8cc726e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:47.160525 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f625d7b-8fb4-4218-ba00-037a8cc726e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:47.160807 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f625d7b-8fb4-4218-ba00-037a8cc726e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:47.161078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f625d7b-8fb4-4218-ba00-037a8cc726e7 admin admin] PATH_INFO: `/v3/users/95f5629761ed4d5c8d576876043cbcd5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:47.162752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f625d7b-8fb4-4218-ba00-037a8cc726e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95f5629761ed4d5c8d576876043cbcd5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:47.164697 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f625d7b-8fb4-4218-ba00-037a8cc726e7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:47.229439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5f625d7b-8fb4-4218-ba00-037a8cc726e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95f5629761ed4d5c8d576876043cbcd5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:47.230130 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5f625d7b-8fb4-4218-ba00-037a8cc726e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95f5629761ed4d5c8d576876043cbcd5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:47.231046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5f625d7b-8fb4-4218-ba00-037a8cc726e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95f5629761ed4d5c8d576876043cbcd5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:47.243502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5f625d7b-8fb4-4218-ba00-037a8cc726e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95f5629761ed4d5c8d576876043cbcd5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:47.252063 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5f625d7b-8fb4-4218-ba00-037a8cc726e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95f5629761ed4d5c8d576876043cbcd5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:47.272592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1263/2513] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:29:47 2022] DELETE /identity/v3/users/95f5629761ed4d5c8d576876043cbcd5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:29:47.277815 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee5f70-1337-4546-8eac-104198ff7ecd None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:47.278183 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee5f70-1337-4546-8eac-104198ff7ecd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:47.278955 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee5f70-1337-4546-8eac-104198ff7ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:47.298851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-40ee5f70-1337-4546-8eac-104198ff7ecd None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:47.300185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-40ee5f70-1337-4546-8eac-104198ff7ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:47.330852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:47.362722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1251/2514] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:29:47.372829 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f625d7b-8fb4-4218-ba00-037a8cc726e7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:47.374259 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5f625d7b-8fb4-4218-ba00-037a8cc726e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:47.442747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f625d7b-8fb4-4218-ba00-037a8cc726e7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:47.446259 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e9e21-3013-4cfe-867e-952538c8126e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:47.446990 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e9e21-3013-4cfe-867e-952538c8126e service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:47.447277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e9e21-3013-4cfe-867e-952538c8126e service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:47.447605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e9e21-3013-4cfe-867e-952538c8126e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:47.459347 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e9e21-3013-4cfe-867e-952538c8126e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:47.460856 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e9e21-3013-4cfe-867e-952538c8126e service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:47.473089 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1264/2515] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:29:47.758613 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee5f70-1337-4546-8eac-104198ff7ecd None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:47.760395 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-40ee5f70-1337-4546-8eac-104198ff7ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:47.776825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee5f70-1337-4546-8eac-104198ff7ecd None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:47.781779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f1561-365a-407e-a826-6e154cf34490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:47.783192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f1561-365a-407e-a826-6e154cf34490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:47.783475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f1561-365a-407e-a826-6e154cf34490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:47.783750 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f1561-365a-407e-a826-6e154cf34490 admin admin] PATH_INFO: `/v3/projects/b1ffec46100d4fef9eb2c5730306e668` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:47.786704 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f1561-365a-407e-a826-6e154cf34490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ffec46100d4fef9eb2c5730306e668)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:47.789398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f1561-365a-407e-a826-6e154cf34490 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:47.845051 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b51f1561-365a-407e-a826-6e154cf34490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ffec46100d4fef9eb2c5730306e668', 'request_id': 'req-b51f1561-365a-407e-a826-6e154cf34490'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:47.853618 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b51f1561-365a-407e-a826-6e154cf34490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ffec46100d4fef9eb2c5730306e668', 'request_id': 'req-b51f1561-365a-407e-a826-6e154cf34490'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:47.860546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b51f1561-365a-407e-a826-6e154cf34490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ffec46100d4fef9eb2c5730306e668', 'request_id': 'req-b51f1561-365a-407e-a826-6e154cf34490'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:47.871829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b51f1561-365a-407e-a826-6e154cf34490 admin admin] The token cache is being invalidate because project b1ffec46100d4fef9eb2c5730306e668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:29:47.872115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b51f1561-365a-407e-a826-6e154cf34490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:47.872846 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-b51f1561-365a-407e-a826-6e154cf34490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:47.874586 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1252/2516] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:29:47 2022] DELETE /identity/v3/projects/b1ffec46100d4fef9eb2c5730306e668 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:29:49.840112 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e9e21-3013-4cfe-867e-952538c8126e service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:49.841778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-179e9e21-3013-4cfe-867e-952538c8126e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:49.856287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e9e21-3013-4cfe-867e-952538c8126e service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:49.874083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:49.919039 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19995cd0-b86c-49bc-8e28-41b582d65873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:49.920059 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19995cd0-b86c-49bc-8e28-41b582d65873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:49.920433 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19995cd0-b86c-49bc-8e28-41b582d65873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:49.920712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19995cd0-b86c-49bc-8e28-41b582d65873 admin admin] PATH_INFO: `/v3/users/6fa2cda90dc54933a3fe22880bebb478` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:49.921934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19995cd0-b86c-49bc-8e28-41b582d65873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fa2cda90dc54933a3fe22880bebb478)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:49.923936 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19995cd0-b86c-49bc-8e28-41b582d65873 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:49.978258 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-19995cd0-b86c-49bc-8e28-41b582d65873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fa2cda90dc54933a3fe22880bebb478'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:49.978828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-19995cd0-b86c-49bc-8e28-41b582d65873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fa2cda90dc54933a3fe22880bebb478'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:49.979420 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-19995cd0-b86c-49bc-8e28-41b582d65873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fa2cda90dc54933a3fe22880bebb478'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:49.986318 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-19995cd0-b86c-49bc-8e28-41b582d65873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fa2cda90dc54933a3fe22880bebb478'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:49.994013 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-19995cd0-b86c-49bc-8e28-41b582d65873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fa2cda90dc54933a3fe22880bebb478'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:50.012288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1265/2517] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:29:49 2022] DELETE /identity/v3/users/6fa2cda90dc54933a3fe22880bebb478 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:29:50.223502 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f1561-365a-407e-a826-6e154cf34490 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:50.225625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b51f1561-365a-407e-a826-6e154cf34490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:50.250324 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f1561-365a-407e-a826-6e154cf34490 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:50.306942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88352bb2-7bda-41fa-9605-e3c9aace310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:50.307827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352bb2-7bda-41fa-9605-e3c9aace310c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:50.308089 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352bb2-7bda-41fa-9605-e3c9aace310c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:50.308428 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352bb2-7bda-41fa-9605-e3c9aace310c admin admin] PATH_INFO: `/v3/projects/8792efde9b484a8d9716cd45afed3f2c` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:50.309631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88352bb2-7bda-41fa-9605-e3c9aace310c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8792efde9b484a8d9716cd45afed3f2c)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:50.311541 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88352bb2-7bda-41fa-9605-e3c9aace310c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:50.358434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-88352bb2-7bda-41fa-9605-e3c9aace310c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8792efde9b484a8d9716cd45afed3f2c', 'request_id': 'req-88352bb2-7bda-41fa-9605-e3c9aace310c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:50.365035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-88352bb2-7bda-41fa-9605-e3c9aace310c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8792efde9b484a8d9716cd45afed3f2c', 'request_id': 'req-88352bb2-7bda-41fa-9605-e3c9aace310c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:50.367044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:50.372786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-88352bb2-7bda-41fa-9605-e3c9aace310c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8792efde9b484a8d9716cd45afed3f2c', 'request_id': 'req-88352bb2-7bda-41fa-9605-e3c9aace310c'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:50.386970 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-88352bb2-7bda-41fa-9605-e3c9aace310c admin admin] The token cache is being invalidate because project 8792efde9b484a8d9716cd45afed3f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:29:50.387256 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-88352bb2-7bda-41fa-9605-e3c9aace310c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:50.387920 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-88352bb2-7bda-41fa-9605-e3c9aace310c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:50.389495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1253/2518] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:29:50 2022] DELETE /identity/v3/projects/8792efde9b484a8d9716cd45afed3f2c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:29:50.394557 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebca071-31d5-414d-bdef-1aca01f6b6db None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:50.394853 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebca071-31d5-414d-bdef-1aca01f6b6db None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:50.395138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebca071-31d5-414d-bdef-1aca01f6b6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:50.422020 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1ebca071-31d5-414d-bdef-1aca01f6b6db None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:50.423910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1ebca071-31d5-414d-bdef-1aca01f6b6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:50.483449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1266/2519] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:50.491432 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279a848-5933-4867-9424-cb7a0715eb62 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:50.491717 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279a848-5933-4867-9424-cb7a0715eb62 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:50.491994 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d279a848-5933-4867-9424-cb7a0715eb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:50.511802 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-d279a848-5933-4867-9424-cb7a0715eb62 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:50.513031 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d279a848-5933-4867-9424-cb7a0715eb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:50.521533 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1254/2520] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:29:50.525767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebca071-31d5-414d-bdef-1aca01f6b6db None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:50.535710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebca071-31d5-414d-bdef-1aca01f6b6db None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:50.540306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a601533-7ddb-49a2-b07a-e675e6acb1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:50.540960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a601533-7ddb-49a2-b07a-e675e6acb1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:50.541242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a601533-7ddb-49a2-b07a-e675e6acb1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:50.541517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a601533-7ddb-49a2-b07a-e675e6acb1a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:50.542235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a601533-7ddb-49a2-b07a-e675e6acb1a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:29:50.542542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a601533-7ddb-49a2-b07a-e675e6acb1a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:50.544137 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a601533-7ddb-49a2-b07a-e675e6acb1a5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:50.555966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1267/2521] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:29:50.560268 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279a848-5933-4867-9424-cb7a0715eb62 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:50.570068 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d279a848-5933-4867-9424-cb7a0715eb62 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:50.574732 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2772e34-1e86-4741-8d9b-ac2e1476a1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:50.575347 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2772e34-1e86-4741-8d9b-ac2e1476a1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:50.575626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2772e34-1e86-4741-8d9b-ac2e1476a1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:50.575896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2772e34-1e86-4741-8d9b-ac2e1476a1f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:50.576607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2772e34-1e86-4741-8d9b-ac2e1476a1f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:50.578487 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2772e34-1e86-4741-8d9b-ac2e1476a1f8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:50.605085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1255/2522] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:29:50 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:29:50.609430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a601533-7ddb-49a2-b07a-e675e6acb1a5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:50.620993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a601533-7ddb-49a2-b07a-e675e6acb1a5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:50.645246 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:50.689687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48256efc-3599-423e-b2da-db4714f4ab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:50.690532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256efc-3599-423e-b2da-db4714f4ab1d admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:50.690823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256efc-3599-423e-b2da-db4714f4ab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:50.691094 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256efc-3599-423e-b2da-db4714f4ab1d admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:50.691805 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48256efc-3599-423e-b2da-db4714f4ab1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:50.694353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48256efc-3599-423e-b2da-db4714f4ab1d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:50.716168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1268/2523] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:29:50 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:29:50.720045 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2772e34-1e86-4741-8d9b-ac2e1476a1f8 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:50.730637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2772e34-1e86-4741-8d9b-ac2e1476a1f8 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:50.735361 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f7142-e04d-49b2-a690-49db403d0d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:50.735963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f7142-e04d-49b2-a690-49db403d0d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:50.736243 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f7142-e04d-49b2-a690-49db403d0d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:50.736545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f7142-e04d-49b2-a690-49db403d0d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:50.737269 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f7142-e04d-49b2-a690-49db403d0d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:50.738914 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f7142-e04d-49b2-a690-49db403d0d87 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:50.750217 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1256/2524] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:29:50.754083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48256efc-3599-423e-b2da-db4714f4ab1d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:50.764945 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48256efc-3599-423e-b2da-db4714f4ab1d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:50.769649 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046a752-ec43-45b0-a7e2-dfe3218e3d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:50.770338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046a752-ec43-45b0-a7e2-dfe3218e3d6b admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:50.770607 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046a752-ec43-45b0-a7e2-dfe3218e3d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:50.770887 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046a752-ec43-45b0-a7e2-dfe3218e3d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:50.771604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046a752-ec43-45b0-a7e2-dfe3218e3d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:50.773343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046a752-ec43-45b0-a7e2-dfe3218e3d6b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:50.787474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1269/2525] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:29:50.789266 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f7142-e04d-49b2-a690-49db403d0d87 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:50.799790 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f7142-e04d-49b2-a690-49db403d0d87 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:50.806827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f85c4f-126f-4c77-b1e0-6275f23dfeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:50.808187 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f85c4f-126f-4c77-b1e0-6275f23dfeda admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:50.808739 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f85c4f-126f-4c77-b1e0-6275f23dfeda admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:50.809025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f85c4f-126f-4c77-b1e0-6275f23dfeda admin admin] PATH_INFO: `/v3/projects/7b62d064ef3b4ac4976568137a83e834/users/84eb2bb7355e481ea53dd5cd6b3be4e2/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:50.825831 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f85c4f-126f-4c77-b1e0-6275f23dfeda admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b62d064ef3b4ac4976568137a83e834, user_id=84eb2bb7355e481ea53dd5cd6b3be4e2, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:50.828566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f85c4f-126f-4c77-b1e0-6275f23dfeda admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:50.846563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1257/2526] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:29:50 2022] PUT /identity/v3/projects/7b62d064ef3b4ac4976568137a83e834/users/84eb2bb7355e481ea53dd5cd6b3be4e2/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:29:50.858752 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd21a52-5e80-4c3b-a294-7d5f72b216b9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:50.859284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd21a52-5e80-4c3b-a294-7d5f72b216b9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:50.859398 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd21a52-5e80-4c3b-a294-7d5f72b216b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:50.888353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ffd21a52-5e80-4c3b-a294-7d5f72b216b9 None None] MFA Rules not processed for user `84eb2bb7355e481ea53dd5cd6b3be4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:50.889667 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ffd21a52-5e80-4c3b-a294-7d5f72b216b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:50.955940 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1270/2527] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:29:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:50.961114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f85c4f-126f-4c77-b1e0-6275f23dfeda admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:51.026154 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f85c4f-126f-4c77-b1e0-6275f23dfeda admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:51.030618 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a6059-f16b-4247-b252-0562c5e9f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:51.031277 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a6059-f16b-4247-b252-0562c5e9f579 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:51.031559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a6059-f16b-4247-b252-0562c5e9f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:51.031832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a6059-f16b-4247-b252-0562c5e9f579 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:51.032549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a6059-f16b-4247-b252-0562c5e9f579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:51.034574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a6059-f16b-4247-b252-0562c5e9f579 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:51.061898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1258/2528] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:29:50 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:29:51.065825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd21a52-5e80-4c3b-a294-7d5f72b216b9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:51.077208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd21a52-5e80-4c3b-a294-7d5f72b216b9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:51.138194 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a945e45-bf07-495f-8d46-f497810de441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:51.138895 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a945e45-bf07-495f-8d46-f497810de441 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:51.139179 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a945e45-bf07-495f-8d46-f497810de441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:51.139458 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a945e45-bf07-495f-8d46-f497810de441 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:51.140151 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a945e45-bf07-495f-8d46-f497810de441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:51.142110 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a945e45-bf07-495f-8d46-f497810de441 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:51.165255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1271/2529] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:29:51 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:29:51.169350 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a6059-f16b-4247-b252-0562c5e9f579 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:51.180580 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a6059-f16b-4247-b252-0562c5e9f579 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:51.185206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48ba6d-5574-4a97-8558-ed92c9c2eb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:51.185856 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48ba6d-5574-4a97-8558-ed92c9c2eb28 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:51.186138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48ba6d-5574-4a97-8558-ed92c9c2eb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:51.186410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48ba6d-5574-4a97-8558-ed92c9c2eb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:51.187124 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48ba6d-5574-4a97-8558-ed92c9c2eb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:51.188741 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48ba6d-5574-4a97-8558-ed92c9c2eb28 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:51.199121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1259/2530] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:29:51.203294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a945e45-bf07-495f-8d46-f497810de441 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:51.213306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a945e45-bf07-495f-8d46-f497810de441 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:51.217896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade1edf-27e1-455c-b783-a04d58db5fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:51.218780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade1edf-27e1-455c-b783-a04d58db5fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:51.219066 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade1edf-27e1-455c-b783-a04d58db5fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:51.219486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade1edf-27e1-455c-b783-a04d58db5fc5 admin admin] PATH_INFO: `/v3/projects/fb5723fb7bf54efabab52eb8e71e7e02/users/3eaed97de38e431bb6355ce5ac28d9d0/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:51.236556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade1edf-27e1-455c-b783-a04d58db5fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5723fb7bf54efabab52eb8e71e7e02, user_id=3eaed97de38e431bb6355ce5ac28d9d0, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:51.239668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade1edf-27e1-455c-b783-a04d58db5fc5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:51.249209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:51.255683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1272/2531] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:29:51 2022] PUT /identity/v3/projects/fb5723fb7bf54efabab52eb8e71e7e02/users/3eaed97de38e431bb6355ce5ac28d9d0/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:29:51.259444 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48ba6d-5574-4a97-8558-ed92c9c2eb28 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:51.269695 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48ba6d-5574-4a97-8558-ed92c9c2eb28 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:51.324288 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:51.331842 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaefb2c-099a-4c9e-b397-9b1d0be55d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:51.332808 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaefb2c-099a-4c9e-b397-9b1d0be55d09 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:51.334453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaefb2c-099a-4c9e-b397-9b1d0be55d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:51.335140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaefb2c-099a-4c9e-b397-9b1d0be55d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:51.336099 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaefb2c-099a-4c9e-b397-9b1d0be55d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:51.338219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaefb2c-099a-4c9e-b397-9b1d0be55d09 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:51.350610 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1260/2532] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:29:51.355015 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade1edf-27e1-455c-b783-a04d58db5fc5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:51.365791 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade1edf-27e1-455c-b783-a04d58db5fc5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:51.370413 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09241ce7-1542-411e-b448-19e0adedf385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:51.371300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09241ce7-1542-411e-b448-19e0adedf385 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:51.371576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09241ce7-1542-411e-b448-19e0adedf385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:51.371846 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09241ce7-1542-411e-b448-19e0adedf385 admin admin] PATH_INFO: `/v3/projects/fb5723fb7bf54efabab52eb8e71e7e02/users/3eaed97de38e431bb6355ce5ac28d9d0/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:51.373841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09241ce7-1542-411e-b448-19e0adedf385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5723fb7bf54efabab52eb8e71e7e02, user_id=3eaed97de38e431bb6355ce5ac28d9d0, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:51.376694 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09241ce7-1542-411e-b448-19e0adedf385 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:51.387595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1273/2533] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:29:51 2022] PUT /identity/v3/projects/fb5723fb7bf54efabab52eb8e71e7e02/users/3eaed97de38e431bb6355ce5ac28d9d0/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:29:51.400102 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29555520-9878-4034-be7e-64339b84df44 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:51.400427 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29555520-9878-4034-be7e-64339b84df44 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:51.400707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29555520-9878-4034-be7e-64339b84df44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:51.429065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-29555520-9878-4034-be7e-64339b84df44 None None] MFA Rules not processed for user `3eaed97de38e431bb6355ce5ac28d9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:51.430296 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-29555520-9878-4034-be7e-64339b84df44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:51.499448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1261/2534] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:29:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:51.510891 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09241ce7-1542-411e-b448-19e0adedf385 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:51.512647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-09241ce7-1542-411e-b448-19e0adedf385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:51.569812 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09241ce7-1542-411e-b448-19e0adedf385 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:51.573358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b66c9-b94d-4d01-ad61-4ef3ffd2f1c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:51.573998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b66c9-b94d-4d01-ad61-4ef3ffd2f1c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:51.574274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b66c9-b94d-4d01-ad61-4ef3ffd2f1c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:51.574547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b66c9-b94d-4d01-ad61-4ef3ffd2f1c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:51.584224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b66c9-b94d-4d01-ad61-4ef3ffd2f1c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:51.585688 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b66c9-b94d-4d01-ad61-4ef3ffd2f1c8 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:51.595779 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1274/2535] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:29:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:29:51.988437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29555520-9878-4034-be7e-64339b84df44 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:52.049314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29555520-9878-4034-be7e-64339b84df44 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:52.054353 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280ec20-9d28-4107-b78f-72b86b7a11fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:52.055221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280ec20-9d28-4107-b78f-72b86b7a11fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:52.055504 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280ec20-9d28-4107-b78f-72b86b7a11fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:52.055780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280ec20-9d28-4107-b78f-72b86b7a11fb admin admin] PATH_INFO: `/v3/users/84eb2bb7355e481ea53dd5cd6b3be4e2` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:52.056972 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280ec20-9d28-4107-b78f-72b86b7a11fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=84eb2bb7355e481ea53dd5cd6b3be4e2)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:52.058893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280ec20-9d28-4107-b78f-72b86b7a11fb admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:52.102937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-6280ec20-9d28-4107-b78f-72b86b7a11fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84eb2bb7355e481ea53dd5cd6b3be4e2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:52.110626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-6280ec20-9d28-4107-b78f-72b86b7a11fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84eb2bb7355e481ea53dd5cd6b3be4e2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:52.111242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-6280ec20-9d28-4107-b78f-72b86b7a11fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84eb2bb7355e481ea53dd5cd6b3be4e2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:52.111895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-6280ec20-9d28-4107-b78f-72b86b7a11fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84eb2bb7355e481ea53dd5cd6b3be4e2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:52.124243 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-6280ec20-9d28-4107-b78f-72b86b7a11fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84eb2bb7355e481ea53dd5cd6b3be4e2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:52.132394 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:52.138589 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1262/2536] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:29:51 2022] DELETE /identity/v3/users/84eb2bb7355e481ea53dd5cd6b3be4e2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:29:52.143209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760c63e-9f51-4281-8dad-d21a46a8c72d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:52.143732 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760c63e-9f51-4281-8dad-d21a46a8c72d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:52.143842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760c63e-9f51-4281-8dad-d21a46a8c72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:52.162684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f760c63e-9f51-4281-8dad-d21a46a8c72d None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:52.163910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f760c63e-9f51-4281-8dad-d21a46a8c72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:52.221989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1275/2537] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:52.231984 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280ec20-9d28-4107-b78f-72b86b7a11fb admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:52.233631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6280ec20-9d28-4107-b78f-72b86b7a11fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:52.290292 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280ec20-9d28-4107-b78f-72b86b7a11fb admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:52.293977 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3c9ac-1caa-4efb-bcbd-d5eeff1cb36f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:52.294625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3c9ac-1caa-4efb-bcbd-d5eeff1cb36f service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:52.294903 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3c9ac-1caa-4efb-bcbd-d5eeff1cb36f service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:52.295180 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3c9ac-1caa-4efb-bcbd-d5eeff1cb36f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:52.304772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3c9ac-1caa-4efb-bcbd-d5eeff1cb36f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:52.306201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3c9ac-1caa-4efb-bcbd-d5eeff1cb36f service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:52.315585 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1263/2538] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:29:52.592118 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760c63e-9f51-4281-8dad-d21a46a8c72d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:52.593621 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f760c63e-9f51-4281-8dad-d21a46a8c72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:52.607457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760c63e-9f51-4281-8dad-d21a46a8c72d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:52.612232 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:52.613125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:52.613413 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:52.613691 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d admin admin] PATH_INFO: `/v3/projects/7b62d064ef3b4ac4976568137a83e834` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:52.616100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b62d064ef3b4ac4976568137a83e834)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:52.618084 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:52.670392 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b62d064ef3b4ac4976568137a83e834', 'request_id': 'req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:52.678622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b62d064ef3b4ac4976568137a83e834', 'request_id': 'req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:52.684715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b62d064ef3b4ac4976568137a83e834', 'request_id': 'req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:52.697403 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d admin admin] The token cache is being invalidate because project 7b62d064ef3b4ac4976568137a83e834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:29:52.697682 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:52.698344 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:52.699883 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1276/2539] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:29:52 2022] DELETE /identity/v3/projects/7b62d064ef3b4ac4976568137a83e834 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:29:52.703975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3c9ac-1caa-4efb-bcbd-d5eeff1cb36f service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:52.713905 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3c9ac-1caa-4efb-bcbd-d5eeff1cb36f service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:52.769890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68429a-ff5f-4352-85c5-ec1980b4f6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:52.771272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68429a-ff5f-4352-85c5-ec1980b4f6b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:52.771549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68429a-ff5f-4352-85c5-ec1980b4f6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:52.771866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68429a-ff5f-4352-85c5-ec1980b4f6b1 admin admin] PATH_INFO: `/v3/users/3eaed97de38e431bb6355ce5ac28d9d0` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:52.773119 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68429a-ff5f-4352-85c5-ec1980b4f6b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eaed97de38e431bb6355ce5ac28d9d0)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:52.775032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68429a-ff5f-4352-85c5-ec1980b4f6b1 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:52.821581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8c68429a-ff5f-4352-85c5-ec1980b4f6b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eaed97de38e431bb6355ce5ac28d9d0'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:52.828880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8c68429a-ff5f-4352-85c5-ec1980b4f6b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eaed97de38e431bb6355ce5ac28d9d0'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:52.829608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8c68429a-ff5f-4352-85c5-ec1980b4f6b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eaed97de38e431bb6355ce5ac28d9d0'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:52.830350 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8c68429a-ff5f-4352-85c5-ec1980b4f6b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eaed97de38e431bb6355ce5ac28d9d0'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:52.842849 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8c68429a-ff5f-4352-85c5-ec1980b4f6b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eaed97de38e431bb6355ce5ac28d9d0'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:52.855629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1264/2540] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:29:52 2022] DELETE /identity/v3/users/3eaed97de38e431bb6355ce5ac28d9d0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:29:53.141588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:53.143114 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:53.156962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847cc6d-7b26-4f81-b982-6c073ebc3e0d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:53.167568 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:53.220511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf79dd-cf8b-4584-9e19-032f967a0aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:53.221295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf79dd-cf8b-4584-9e19-032f967a0aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:53.221581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf79dd-cf8b-4584-9e19-032f967a0aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:53.221854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf79dd-cf8b-4584-9e19-032f967a0aec admin admin] PATH_INFO: `/v3/projects/fb5723fb7bf54efabab52eb8e71e7e02` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:53.223032 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf79dd-cf8b-4584-9e19-032f967a0aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb5723fb7bf54efabab52eb8e71e7e02)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:53.225001 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf79dd-cf8b-4584-9e19-032f967a0aec admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:53.272775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6cbf79dd-cf8b-4584-9e19-032f967a0aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb5723fb7bf54efabab52eb8e71e7e02', 'request_id': 'req-6cbf79dd-cf8b-4584-9e19-032f967a0aec'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:53.279048 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6cbf79dd-cf8b-4584-9e19-032f967a0aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb5723fb7bf54efabab52eb8e71e7e02', 'request_id': 'req-6cbf79dd-cf8b-4584-9e19-032f967a0aec'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:53.285082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6cbf79dd-cf8b-4584-9e19-032f967a0aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb5723fb7bf54efabab52eb8e71e7e02', 'request_id': 'req-6cbf79dd-cf8b-4584-9e19-032f967a0aec'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:53.297298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6cbf79dd-cf8b-4584-9e19-032f967a0aec admin admin] The token cache is being invalidate because project fb5723fb7bf54efabab52eb8e71e7e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:29:53.297647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6cbf79dd-cf8b-4584-9e19-032f967a0aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:53.298267 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6cbf79dd-cf8b-4584-9e19-032f967a0aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:29:53.299811 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1277/2541] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:29:53 2022] DELETE /identity/v3/projects/fb5723fb7bf54efabab52eb8e71e7e02 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:29:53.304902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1ac3b-77fc-46fc-a974-6c9441254485 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:53.305365 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1ac3b-77fc-46fc-a974-6c9441254485 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:53.305476 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1ac3b-77fc-46fc-a974-6c9441254485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:53.325339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e3d1ac3b-77fc-46fc-a974-6c9441254485 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:53.326546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e3d1ac3b-77fc-46fc-a974-6c9441254485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:53.339682 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:53.388800 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1265/2542] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:53.397544 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc355-f5ee-48a7-ad3f-849c65488825 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:53.397835 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc355-f5ee-48a7-ad3f-849c65488825 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:53.398117 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc355-f5ee-48a7-ad3f-849c65488825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:53.418498 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8bfcc355-f5ee-48a7-ad3f-849c65488825 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:53.419699 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8bfcc355-f5ee-48a7-ad3f-849c65488825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:53.428114 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1278/2543] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:53.432569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1ac3b-77fc-46fc-a974-6c9441254485 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:53.443643 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1ac3b-77fc-46fc-a974-6c9441254485 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:53.448684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de45d74-dba8-4492-91a1-d906bd0bd11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:53.449373 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de45d74-dba8-4492-91a1-d906bd0bd11c admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:53.449685 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de45d74-dba8-4492-91a1-d906bd0bd11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:53.449982 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de45d74-dba8-4492-91a1-d906bd0bd11c admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:53.450795 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de45d74-dba8-4492-91a1-d906bd0bd11c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:29:53.451115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de45d74-dba8-4492-91a1-d906bd0bd11c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:53.452835 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de45d74-dba8-4492-91a1-d906bd0bd11c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:53.465603 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1266/2544] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:29:53.470036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcc355-f5ee-48a7-ad3f-849c65488825 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:53.479455 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcc355-f5ee-48a7-ad3f-849c65488825 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:53.484064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbc8ee-7890-415a-8eee-8cb49209ab95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:53.484751 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbc8ee-7890-415a-8eee-8cb49209ab95 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:53.485032 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbc8ee-7890-415a-8eee-8cb49209ab95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:53.485306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbc8ee-7890-415a-8eee-8cb49209ab95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:53.485985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbc8ee-7890-415a-8eee-8cb49209ab95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:53.487899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbc8ee-7890-415a-8eee-8cb49209ab95 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:53.514492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1279/2545] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:29:53 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:29:53.519068 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de45d74-dba8-4492-91a1-d906bd0bd11c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:53.529715 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de45d74-dba8-4492-91a1-d906bd0bd11c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:53.587204 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fccfd-742e-4da2-926f-885cc26b25b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:53.588013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fccfd-742e-4da2-926f-885cc26b25b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:53.588407 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fccfd-742e-4da2-926f-885cc26b25b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:53.590022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fccfd-742e-4da2-926f-885cc26b25b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:53.590022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082fccfd-742e-4da2-926f-885cc26b25b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:53.591659 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082fccfd-742e-4da2-926f-885cc26b25b8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:53.624201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1267/2546] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:29:53 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:29:53.628724 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbc8ee-7890-415a-8eee-8cb49209ab95 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:53.640071 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbc8ee-7890-415a-8eee-8cb49209ab95 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:53.645118 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ee3d9-c8e5-4794-9f66-1d937ebc97d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:53.645793 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ee3d9-c8e5-4794-9f66-1d937ebc97d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:53.646076 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ee3d9-c8e5-4794-9f66-1d937ebc97d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:53.646350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ee3d9-c8e5-4794-9f66-1d937ebc97d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:53.647075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ee3d9-c8e5-4794-9f66-1d937ebc97d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:53.648725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ee3d9-c8e5-4794-9f66-1d937ebc97d8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:53.662653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1280/2547] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:29:53.664421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fccfd-742e-4da2-926f-885cc26b25b8 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:53.676009 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fccfd-742e-4da2-926f-885cc26b25b8 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:53.682363 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc430d3-516d-46ab-a8bd-7ad633c7d7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:53.683032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc430d3-516d-46ab-a8bd-7ad633c7d7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:53.683320 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc430d3-516d-46ab-a8bd-7ad633c7d7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:53.683612 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc430d3-516d-46ab-a8bd-7ad633c7d7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:53.684366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc430d3-516d-46ab-a8bd-7ad633c7d7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:53.686003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc430d3-516d-46ab-a8bd-7ad633c7d7d5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:53.699598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1268/2548] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:29:53.703801 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ee3d9-c8e5-4794-9f66-1d937ebc97d8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:53.714486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ee3d9-c8e5-4794-9f66-1d937ebc97d8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:53.719092 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c4b72-c221-4580-9498-44c9b2f76947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:53.720057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c4b72-c221-4580-9498-44c9b2f76947 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:53.720363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c4b72-c221-4580-9498-44c9b2f76947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:53.720639 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c4b72-c221-4580-9498-44c9b2f76947 admin admin] PATH_INFO: `/v3/projects/e772deb4161549ccb7172d9b90ac55e3/users/b1e265fec07a412bb9726a3490c7a8a5/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:53.735980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c4b72-c221-4580-9498-44c9b2f76947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e772deb4161549ccb7172d9b90ac55e3, user_id=b1e265fec07a412bb9726a3490c7a8a5, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:53.738582 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c4b72-c221-4580-9498-44c9b2f76947 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:53.754056 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1281/2549] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:29:53 2022] PUT /identity/v3/projects/e772deb4161549ccb7172d9b90ac55e3/users/b1e265fec07a412bb9726a3490c7a8a5/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:29:53.765886 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d275a26-15f5-4eec-897a-172e71cc8be7 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:53.766201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d275a26-15f5-4eec-897a-172e71cc8be7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:53.766448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d275a26-15f5-4eec-897a-172e71cc8be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:53.796860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-0d275a26-15f5-4eec-897a-172e71cc8be7 None None] MFA Rules not processed for user `b1e265fec07a412bb9726a3490c7a8a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:53.798138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0d275a26-15f5-4eec-897a-172e71cc8be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:53.867276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1269/2550] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:29:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:53.871960 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c4b72-c221-4580-9498-44c9b2f76947 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:53.915925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:53.936068 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c4b72-c221-4580-9498-44c9b2f76947 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:53.940690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992dc33-f9bd-40cc-958f-673191fb8d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:53.941443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992dc33-f9bd-40cc-958f-673191fb8d9b admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:53.941729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992dc33-f9bd-40cc-958f-673191fb8d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:53.942005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992dc33-f9bd-40cc-958f-673191fb8d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:53.943218 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992dc33-f9bd-40cc-958f-673191fb8d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:53.945136 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992dc33-f9bd-40cc-958f-673191fb8d9b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:53.976743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1282/2551] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:29:53 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:29:53.978117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d275a26-15f5-4eec-897a-172e71cc8be7 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:53.989986 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d275a26-15f5-4eec-897a-172e71cc8be7 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:54.002419 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:54.051009 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004ae57-1b96-4e13-bf8d-0864857071cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:54.051709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004ae57-1b96-4e13-bf8d-0864857071cb admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:54.051991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004ae57-1b96-4e13-bf8d-0864857071cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:54.052293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004ae57-1b96-4e13-bf8d-0864857071cb admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:54.053006 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004ae57-1b96-4e13-bf8d-0864857071cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:54.054910 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004ae57-1b96-4e13-bf8d-0864857071cb admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:54.077570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1270/2552] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:29:53 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:29:54.081532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992dc33-f9bd-40cc-958f-673191fb8d9b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:54.092781 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992dc33-f9bd-40cc-958f-673191fb8d9b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:54.098547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32052b79-b76f-49c9-af53-f94813fb66a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:54.099214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32052b79-b76f-49c9-af53-f94813fb66a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:54.099500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32052b79-b76f-49c9-af53-f94813fb66a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:54.099777 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32052b79-b76f-49c9-af53-f94813fb66a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:54.100544 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32052b79-b76f-49c9-af53-f94813fb66a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:54.102150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32052b79-b76f-49c9-af53-f94813fb66a8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:54.113231 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1283/2553] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:29:54.118076 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004ae57-1b96-4e13-bf8d-0864857071cb admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:54.128459 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004ae57-1b96-4e13-bf8d-0864857071cb admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:54.133629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0a40f-36aa-4714-8274-b5bac2543e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:54.134532 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0a40f-36aa-4714-8274-b5bac2543e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:54.134813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0a40f-36aa-4714-8274-b5bac2543e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:54.135091 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0a40f-36aa-4714-8274-b5bac2543e55 admin admin] PATH_INFO: `/v3/projects/15f47deb1ed840c6b8b9e2e0585e4519/users/c0fdd2075172437894df3ff9eb77f638/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:54.151089 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0a40f-36aa-4714-8274-b5bac2543e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f47deb1ed840c6b8b9e2e0585e4519, user_id=c0fdd2075172437894df3ff9eb77f638, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:54.153934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0a40f-36aa-4714-8274-b5bac2543e55 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:54.168975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1271/2554] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:29:54 2022] PUT /identity/v3/projects/15f47deb1ed840c6b8b9e2e0585e4519/users/c0fdd2075172437894df3ff9eb77f638/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:29:54.173326 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32052b79-b76f-49c9-af53-f94813fb66a8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:54.183817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32052b79-b76f-49c9-af53-f94813fb66a8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:54.248879 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043394f-b4a4-42e1-a9a6-29ba99929730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:54.249518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043394f-b4a4-42e1-a9a6-29ba99929730 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:54.249817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043394f-b4a4-42e1-a9a6-29ba99929730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:54.250125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043394f-b4a4-42e1-a9a6-29ba99929730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:54.250832 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043394f-b4a4-42e1-a9a6-29ba99929730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:54.252492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043394f-b4a4-42e1-a9a6-29ba99929730 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:54.264276 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1284/2555] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:29:54.268733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0a40f-36aa-4714-8274-b5bac2543e55 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:54.280058 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0a40f-36aa-4714-8274-b5bac2543e55 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:54.285085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e86d6-4bea-49e1-bc56-3411d854bd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:54.285966 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e86d6-4bea-49e1-bc56-3411d854bd95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:54.286242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e86d6-4bea-49e1-bc56-3411d854bd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:54.286515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e86d6-4bea-49e1-bc56-3411d854bd95 admin admin] PATH_INFO: `/v3/projects/15f47deb1ed840c6b8b9e2e0585e4519/users/c0fdd2075172437894df3ff9eb77f638/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:54.288532 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e86d6-4bea-49e1-bc56-3411d854bd95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f47deb1ed840c6b8b9e2e0585e4519, user_id=c0fdd2075172437894df3ff9eb77f638, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:54.291376 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e86d6-4bea-49e1-bc56-3411d854bd95 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:54.302860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1272/2556] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:29:54 2022] PUT /identity/v3/projects/15f47deb1ed840c6b8b9e2e0585e4519/users/c0fdd2075172437894df3ff9eb77f638/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:29:54.313570 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5443571-4a66-403f-bcbf-b142117510ac None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:54.313860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5443571-4a66-403f-bcbf-b142117510ac None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:54.314138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5443571-4a66-403f-bcbf-b142117510ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:54.342529 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f5443571-4a66-403f-bcbf-b142117510ac None None] MFA Rules not processed for user `c0fdd2075172437894df3ff9eb77f638`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:29:54.343767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f5443571-4a66-403f-bcbf-b142117510ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:54.424361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1285/2557] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:29:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:29:54.435956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e86d6-4bea-49e1-bc56-3411d854bd95 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:54.438306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-841e86d6-4bea-49e1-bc56-3411d854bd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:29:54.511363 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e86d6-4bea-49e1-bc56-3411d854bd95 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:54.515199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b9d65-ed53-4d6d-af65-a28ea07bd556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:54.515871 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b9d65-ed53-4d6d-af65-a28ea07bd556 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:54.516152 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b9d65-ed53-4d6d-af65-a28ea07bd556 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:54.516451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b9d65-ed53-4d6d-af65-a28ea07bd556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:54.578709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b9d65-ed53-4d6d-af65-a28ea07bd556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:54.580520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b9d65-ed53-4d6d-af65-a28ea07bd556 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:54.591696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1273/2558] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:29:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:29:57.267559 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5443571-4a66-403f-bcbf-b142117510ac None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:29:57.277620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5443571-4a66-403f-bcbf-b142117510ac None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:29:57.281292 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd082b4-b9c1-4479-9b30-7f57b9a1bb89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:29:57.281927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd082b4-b9c1-4479-9b30-7f57b9a1bb89 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:29:57.282209 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd082b4-b9c1-4479-9b30-7f57b9a1bb89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:29:57.282485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd082b4-b9c1-4479-9b30-7f57b9a1bb89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:29:57.292533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd082b4-b9c1-4479-9b30-7f57b9a1bb89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:29:57.294004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd082b4-b9c1-4479-9b30-7f57b9a1bb89 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:29:57.303366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1286/2559] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:29:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:04.586293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=85,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:07.299123 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:09.843484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b9d65-ed53-4d6d-af65-a28ea07bd556 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:09.905033 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b9d65-ed53-4d6d-af65-a28ea07bd556 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:09.909602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d223c0-510b-4bb2-8a28-bc5235ab94fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:09.911216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d223c0-510b-4bb2-8a28-bc5235ab94fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:09.911494 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d223c0-510b-4bb2-8a28-bc5235ab94fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:09.911768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d223c0-510b-4bb2-8a28-bc5235ab94fc admin admin] PATH_INFO: `/v3/users/b1e265fec07a412bb9726a3490c7a8a5` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:09.912975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d223c0-510b-4bb2-8a28-bc5235ab94fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e265fec07a412bb9726a3490c7a8a5)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:09.914896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d223c0-510b-4bb2-8a28-bc5235ab94fc admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:09.959664 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-99d223c0-510b-4bb2-8a28-bc5235ab94fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e265fec07a412bb9726a3490c7a8a5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:09.966654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-99d223c0-510b-4bb2-8a28-bc5235ab94fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e265fec07a412bb9726a3490c7a8a5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:09.967386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-99d223c0-510b-4bb2-8a28-bc5235ab94fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e265fec07a412bb9726a3490c7a8a5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:09.967993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-99d223c0-510b-4bb2-8a28-bc5235ab94fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e265fec07a412bb9726a3490c7a8a5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:09.980602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-99d223c0-510b-4bb2-8a28-bc5235ab94fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e265fec07a412bb9726a3490c7a8a5'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:09.995435 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1274/2560] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:30:09 2022] DELETE /identity/v3/users/b1e265fec07a412bb9726a3490c7a8a5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:10.000215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70ae39-aa9b-4924-afe4-802bd7c9978f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:10.000706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70ae39-aa9b-4924-afe4-802bd7c9978f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:10.000802 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70ae39-aa9b-4924-afe4-802bd7c9978f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:10.021473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ec70ae39-aa9b-4924-afe4-802bd7c9978f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:10.022673 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ec70ae39-aa9b-4924-afe4-802bd7c9978f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:10.080736 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1287/2561] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:10.090888 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d223c0-510b-4bb2-8a28-bc5235ab94fc admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:10.092339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-99d223c0-510b-4bb2-8a28-bc5235ab94fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:10.155285 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d223c0-510b-4bb2-8a28-bc5235ab94fc admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:10.158860 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a0962-f339-439a-b551-5f074fae1ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:10.159557 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a0962-f339-439a-b551-5f074fae1ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:10.160109 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a0962-f339-439a-b551-5f074fae1ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:10.160416 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a0962-f339-439a-b551-5f074fae1ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:10.170126 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a0962-f339-439a-b551-5f074fae1ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:10.171562 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a0962-f339-439a-b551-5f074fae1ea0 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:10.183419 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1275/2562] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:10.474838 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70ae39-aa9b-4924-afe4-802bd7c9978f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:10.476463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ec70ae39-aa9b-4924-afe4-802bd7c9978f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:10.488048 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70ae39-aa9b-4924-afe4-802bd7c9978f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:10.495874 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481b9ef-b7c9-43e9-9677-6c2773c3948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:10.496873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481b9ef-b7c9-43e9-9677-6c2773c3948c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:10.497362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481b9ef-b7c9-43e9-9677-6c2773c3948c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:10.497782 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481b9ef-b7c9-43e9-9677-6c2773c3948c admin admin] PATH_INFO: `/v3/projects/e772deb4161549ccb7172d9b90ac55e3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:10.499178 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481b9ef-b7c9-43e9-9677-6c2773c3948c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e772deb4161549ccb7172d9b90ac55e3)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:10.501909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481b9ef-b7c9-43e9-9677-6c2773c3948c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:10.550687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a481b9ef-b7c9-43e9-9677-6c2773c3948c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e772deb4161549ccb7172d9b90ac55e3', 'request_id': 'req-a481b9ef-b7c9-43e9-9677-6c2773c3948c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:10.556834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a481b9ef-b7c9-43e9-9677-6c2773c3948c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e772deb4161549ccb7172d9b90ac55e3', 'request_id': 'req-a481b9ef-b7c9-43e9-9677-6c2773c3948c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:10.562474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a481b9ef-b7c9-43e9-9677-6c2773c3948c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e772deb4161549ccb7172d9b90ac55e3', 'request_id': 'req-a481b9ef-b7c9-43e9-9677-6c2773c3948c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:10.575421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a481b9ef-b7c9-43e9-9677-6c2773c3948c admin admin] The token cache is being invalidate because project e772deb4161549ccb7172d9b90ac55e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:30:10.575710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a481b9ef-b7c9-43e9-9677-6c2773c3948c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:10.576391 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a481b9ef-b7c9-43e9-9677-6c2773c3948c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:10.577921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1288/2563] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:30:10 2022] DELETE /identity/v3/projects/e772deb4161549ccb7172d9b90ac55e3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:10.581958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a0962-f339-439a-b551-5f074fae1ea0 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:10.592156 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a0962-f339-439a-b551-5f074fae1ea0 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:10.610807 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:10.656075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdb8ad-fa4b-42d5-9392-79802cf30180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:10.656977 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdb8ad-fa4b-42d5-9392-79802cf30180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:10.657259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdb8ad-fa4b-42d5-9392-79802cf30180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:10.657534 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdb8ad-fa4b-42d5-9392-79802cf30180 admin admin] PATH_INFO: `/v3/users/c0fdd2075172437894df3ff9eb77f638` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:10.658796 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdb8ad-fa4b-42d5-9392-79802cf30180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0fdd2075172437894df3ff9eb77f638)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:10.661070 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdb8ad-fa4b-42d5-9392-79802cf30180 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:10.710630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5fcdb8ad-fa4b-42d5-9392-79802cf30180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0fdd2075172437894df3ff9eb77f638'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:10.718028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5fcdb8ad-fa4b-42d5-9392-79802cf30180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0fdd2075172437894df3ff9eb77f638'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:10.718748 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5fcdb8ad-fa4b-42d5-9392-79802cf30180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0fdd2075172437894df3ff9eb77f638'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:10.719448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5fcdb8ad-fa4b-42d5-9392-79802cf30180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0fdd2075172437894df3ff9eb77f638'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:10.731633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-5fcdb8ad-fa4b-42d5-9392-79802cf30180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0fdd2075172437894df3ff9eb77f638'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:10.744018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1276/2564] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:30:10 2022] DELETE /identity/v3/users/c0fdd2075172437894df3ff9eb77f638 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:11.024239 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481b9ef-b7c9-43e9-9677-6c2773c3948c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:11.025867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a481b9ef-b7c9-43e9-9677-6c2773c3948c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:11.041061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481b9ef-b7c9-43e9-9677-6c2773c3948c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:11.101275 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d89ec5-f85f-44d4-be4d-34c01ef96dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:11.102158 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d89ec5-f85f-44d4-be4d-34c01ef96dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:11.102446 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d89ec5-f85f-44d4-be4d-34c01ef96dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:11.102728 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d89ec5-f85f-44d4-be4d-34c01ef96dde admin admin] PATH_INFO: `/v3/projects/15f47deb1ed840c6b8b9e2e0585e4519` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:11.103950 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d89ec5-f85f-44d4-be4d-34c01ef96dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f47deb1ed840c6b8b9e2e0585e4519)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:11.105903 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d89ec5-f85f-44d4-be4d-34c01ef96dde admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:11.138715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:11.156664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-96d89ec5-f85f-44d4-be4d-34c01ef96dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f47deb1ed840c6b8b9e2e0585e4519', 'request_id': 'req-96d89ec5-f85f-44d4-be4d-34c01ef96dde'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:11.162997 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-96d89ec5-f85f-44d4-be4d-34c01ef96dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f47deb1ed840c6b8b9e2e0585e4519', 'request_id': 'req-96d89ec5-f85f-44d4-be4d-34c01ef96dde'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:11.169200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-96d89ec5-f85f-44d4-be4d-34c01ef96dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f47deb1ed840c6b8b9e2e0585e4519', 'request_id': 'req-96d89ec5-f85f-44d4-be4d-34c01ef96dde'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:11.181929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-96d89ec5-f85f-44d4-be4d-34c01ef96dde admin admin] The token cache is being invalidate because project 15f47deb1ed840c6b8b9e2e0585e4519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:30:11.182218 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-96d89ec5-f85f-44d4-be4d-34c01ef96dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:11.182834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-96d89ec5-f85f-44d4-be4d-34c01ef96dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:11.184425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1289/2565] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:30:11 2022] DELETE /identity/v3/projects/15f47deb1ed840c6b8b9e2e0585e4519 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:11.189544 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c37119-69a4-421c-a5d4-87856ec5df97 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:11.190047 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c37119-69a4-421c-a5d4-87856ec5df97 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:11.190160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c37119-69a4-421c-a5d4-87856ec5df97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:11.210702 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a3c37119-69a4-421c-a5d4-87856ec5df97 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:11.211914 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a3c37119-69a4-421c-a5d4-87856ec5df97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:11.269097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1277/2566] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:11.278821 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1de03-e04d-481b-a8c8-32f0460db241 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:11.279131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1de03-e04d-481b-a8c8-32f0460db241 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:11.279413 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1de03-e04d-481b-a8c8-32f0460db241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:11.299631 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-24d1de03-e04d-481b-a8c8-32f0460db241 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:11.300945 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-24d1de03-e04d-481b-a8c8-32f0460db241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:11.308857 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1290/2567] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:11.313096 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c37119-69a4-421c-a5d4-87856ec5df97 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:11.323392 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c37119-69a4-421c-a5d4-87856ec5df97 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:11.328184 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669521e-a8e5-450e-83c1-7e4d47b37b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:11.328865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669521e-a8e5-450e-83c1-7e4d47b37b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:11.329150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669521e-a8e5-450e-83c1-7e4d47b37b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:11.329426 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669521e-a8e5-450e-83c1-7e4d47b37b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:11.330147 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669521e-a8e5-450e-83c1-7e4d47b37b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:30:11.330454 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669521e-a8e5-450e-83c1-7e4d47b37b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:11.332054 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669521e-a8e5-450e-83c1-7e4d47b37b63 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:11.344336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1278/2568] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:30:11.348637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1de03-e04d-481b-a8c8-32f0460db241 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:11.357985 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1de03-e04d-481b-a8c8-32f0460db241 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:11.362674 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684f43e-9a19-4017-ad21-1c920486a8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:11.363319 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684f43e-9a19-4017-ad21-1c920486a8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:11.363622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684f43e-9a19-4017-ad21-1c920486a8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:11.363887 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684f43e-9a19-4017-ad21-1c920486a8c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:11.364717 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684f43e-9a19-4017-ad21-1c920486a8c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:11.366620 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684f43e-9a19-4017-ad21-1c920486a8c2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:11.396778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1291/2569] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:30:11 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:11.401249 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669521e-a8e5-450e-83c1-7e4d47b37b63 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:11.411525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669521e-a8e5-450e-83c1-7e4d47b37b63 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:11.436480 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:11.470007 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff8c93-740c-4993-a35a-6d710076f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:11.470808 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff8c93-740c-4993-a35a-6d710076f03f admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:11.471191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff8c93-740c-4993-a35a-6d710076f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:11.471569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff8c93-740c-4993-a35a-6d710076f03f admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:11.472386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff8c93-740c-4993-a35a-6d710076f03f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:11.474446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff8c93-740c-4993-a35a-6d710076f03f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:11.496040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1279/2570] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:30:11 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:11.500434 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684f43e-9a19-4017-ad21-1c920486a8c2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:11.511712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684f43e-9a19-4017-ad21-1c920486a8c2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:11.516340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094634e-8caf-4b83-8b91-ed8d7a1dbf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:11.517001 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094634e-8caf-4b83-8b91-ed8d7a1dbf4e admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:11.517279 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094634e-8caf-4b83-8b91-ed8d7a1dbf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:11.517549 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094634e-8caf-4b83-8b91-ed8d7a1dbf4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:11.518429 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094634e-8caf-4b83-8b91-ed8d7a1dbf4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:11.520800 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094634e-8caf-4b83-8b91-ed8d7a1dbf4e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:11.530618 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1292/2571] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:11.534600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff8c93-740c-4993-a35a-6d710076f03f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:11.544894 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff8c93-740c-4993-a35a-6d710076f03f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:11.549474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7545d5-a025-4d6d-ae69-4787c274839d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:11.550128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7545d5-a025-4d6d-ae69-4787c274839d admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:11.550412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7545d5-a025-4d6d-ae69-4787c274839d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:11.550692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7545d5-a025-4d6d-ae69-4787c274839d admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:11.551928 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7545d5-a025-4d6d-ae69-4787c274839d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:11.553581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7545d5-a025-4d6d-ae69-4787c274839d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:11.563624 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1280/2572] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:11.568350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094634e-8caf-4b83-8b91-ed8d7a1dbf4e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:11.578145 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094634e-8caf-4b83-8b91-ed8d7a1dbf4e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:11.582617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd4eac-91b2-4397-9244-3ffb8f096255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:11.583664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd4eac-91b2-4397-9244-3ffb8f096255 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:11.583946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd4eac-91b2-4397-9244-3ffb8f096255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:11.584221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd4eac-91b2-4397-9244-3ffb8f096255 admin admin] PATH_INFO: `/v3/projects/23f10c5b368a4c829ee1e3e60b75451c/users/8e51eb8b669b4f308b6665d76a21983f/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:11.598254 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd4eac-91b2-4397-9244-3ffb8f096255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f10c5b368a4c829ee1e3e60b75451c, user_id=8e51eb8b669b4f308b6665d76a21983f, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:11.600929 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd4eac-91b2-4397-9244-3ffb8f096255 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:11.613182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1293/2573] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:30:11 2022] PUT /identity/v3/projects/23f10c5b368a4c829ee1e3e60b75451c/users/8e51eb8b669b4f308b6665d76a21983f/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:11.623935 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8457658-a70a-4d73-96d6-0c69a49ba6b3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:11.624227 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8457658-a70a-4d73-96d6-0c69a49ba6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:11.624540 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8457658-a70a-4d73-96d6-0c69a49ba6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:11.653247 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-e8457658-a70a-4d73-96d6-0c69a49ba6b3 None None] MFA Rules not processed for user `8e51eb8b669b4f308b6665d76a21983f`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:11.654456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e8457658-a70a-4d73-96d6-0c69a49ba6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:11.719379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1281/2574] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:30:11.734558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd4eac-91b2-4397-9244-3ffb8f096255 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:11.736295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-85fd4eac-91b2-4397-9244-3ffb8f096255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:11.795465 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd4eac-91b2-4397-9244-3ffb8f096255 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:11.799061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7e638-c8f9-498d-9f63-c4805efc2614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:11.799923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7e638-c8f9-498d-9f63-c4805efc2614 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:11.800204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7e638-c8f9-498d-9f63-c4805efc2614 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:11.800514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7e638-c8f9-498d-9f63-c4805efc2614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:11.809348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7e638-c8f9-498d-9f63-c4805efc2614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:11.810840 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7e638-c8f9-498d-9f63-c4805efc2614 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:11.820151 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1294/2575] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:21.716467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:21.816061 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:25.381164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8457658-a70a-4d73-96d6-0c69a49ba6b3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:25.442218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8457658-a70a-4d73-96d6-0c69a49ba6b3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:25.446771 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21bf95-88a4-4021-9c25-fa60a83fa08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:25.447635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21bf95-88a4-4021-9c25-fa60a83fa08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:25.447921 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21bf95-88a4-4021-9c25-fa60a83fa08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:25.448199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21bf95-88a4-4021-9c25-fa60a83fa08c admin admin] PATH_INFO: `/v3/users/8e51eb8b669b4f308b6665d76a21983f` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:25.449423 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21bf95-88a4-4021-9c25-fa60a83fa08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e51eb8b669b4f308b6665d76a21983f)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:25.451344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21bf95-88a4-4021-9c25-fa60a83fa08c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:25.498401 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ae21bf95-88a4-4021-9c25-fa60a83fa08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e51eb8b669b4f308b6665d76a21983f'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:25.506684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ae21bf95-88a4-4021-9c25-fa60a83fa08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e51eb8b669b4f308b6665d76a21983f'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:25.507298 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ae21bf95-88a4-4021-9c25-fa60a83fa08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e51eb8b669b4f308b6665d76a21983f'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:25.507895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ae21bf95-88a4-4021-9c25-fa60a83fa08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e51eb8b669b4f308b6665d76a21983f'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:25.520948 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ae21bf95-88a4-4021-9c25-fa60a83fa08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e51eb8b669b4f308b6665d76a21983f'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:25.532845 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1282/2576] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:30:25 2022] DELETE /identity/v3/users/8e51eb8b669b4f308b6665d76a21983f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:25.537680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a3446-f202-411e-9bc4-b6d26e87b454 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:25.538163 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a3446-f202-411e-9bc4-b6d26e87b454 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:25.538266 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a3446-f202-411e-9bc4-b6d26e87b454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:25.557238 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-fc7a3446-f202-411e-9bc4-b6d26e87b454 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:25.558448 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fc7a3446-f202-411e-9bc4-b6d26e87b454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:25.617332 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1295/2577] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:25.627117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21bf95-88a4-4021-9c25-fa60a83fa08c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:25.628565 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ae21bf95-88a4-4021-9c25-fa60a83fa08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:25.689520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21bf95-88a4-4021-9c25-fa60a83fa08c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:25.693746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fe1c6-1a5c-485e-a7ca-f5cf40a47341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:25.694427 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fe1c6-1a5c-485e-a7ca-f5cf40a47341 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:25.694713 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fe1c6-1a5c-485e-a7ca-f5cf40a47341 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:25.694991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fe1c6-1a5c-485e-a7ca-f5cf40a47341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:25.704598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fe1c6-1a5c-485e-a7ca-f5cf40a47341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:25.706045 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fe1c6-1a5c-485e-a7ca-f5cf40a47341 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:25.716498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1283/2578] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:30:26.000327 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a3446-f202-411e-9bc4-b6d26e87b454 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:26.002173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fc7a3446-f202-411e-9bc4-b6d26e87b454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:26.030421 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a3446-f202-411e-9bc4-b6d26e87b454 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:26.038173 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009a5d7-c984-4b59-ab72-aa63064de631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:26.039198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009a5d7-c984-4b59-ab72-aa63064de631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:26.039515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009a5d7-c984-4b59-ab72-aa63064de631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:26.039823 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009a5d7-c984-4b59-ab72-aa63064de631 admin admin] PATH_INFO: `/v3/projects/23f10c5b368a4c829ee1e3e60b75451c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:26.041375 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009a5d7-c984-4b59-ab72-aa63064de631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f10c5b368a4c829ee1e3e60b75451c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:26.043303 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009a5d7-c984-4b59-ab72-aa63064de631 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:26.091720 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b009a5d7-c984-4b59-ab72-aa63064de631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f10c5b368a4c829ee1e3e60b75451c', 'request_id': 'req-b009a5d7-c984-4b59-ab72-aa63064de631'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:26.099275 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b009a5d7-c984-4b59-ab72-aa63064de631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f10c5b368a4c829ee1e3e60b75451c', 'request_id': 'req-b009a5d7-c984-4b59-ab72-aa63064de631'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:26.105227 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b009a5d7-c984-4b59-ab72-aa63064de631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f10c5b368a4c829ee1e3e60b75451c', 'request_id': 'req-b009a5d7-c984-4b59-ab72-aa63064de631'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:26.120236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b009a5d7-c984-4b59-ab72-aa63064de631 admin admin] The token cache is being invalidate because project 23f10c5b368a4c829ee1e3e60b75451c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:30:26.120545 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b009a5d7-c984-4b59-ab72-aa63064de631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:26.121200 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b009a5d7-c984-4b59-ab72-aa63064de631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:26.122757 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1296/2579] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:30:25 2022] DELETE /identity/v3/projects/23f10c5b368a4c829ee1e3e60b75451c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:26.130178 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff67da7-d93d-43ec-8143-56a44445cf9f None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:26.130470 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff67da7-d93d-43ec-8143-56a44445cf9f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:26.130918 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff67da7-d93d-43ec-8143-56a44445cf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:26.158734 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-eff67da7-d93d-43ec-8143-56a44445cf9f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:26.161459 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-eff67da7-d93d-43ec-8143-56a44445cf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:26.181707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:26.227172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1284/2580] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:30:26.239967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea2461-8add-4e14-a17a-71eb60baed18 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:26.240628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea2461-8add-4e14-a17a-71eb60baed18 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:26.240754 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea2461-8add-4e14-a17a-71eb60baed18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:26.263654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a7ea2461-8add-4e14-a17a-71eb60baed18 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:26.265167 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a7ea2461-8add-4e14-a17a-71eb60baed18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:26.277041 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1297/2581] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:26.282057 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff67da7-d93d-43ec-8143-56a44445cf9f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:26.294275 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff67da7-d93d-43ec-8143-56a44445cf9f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:26.299088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33114e5c-845f-4f2b-9937-57b89f17cc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:26.299770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33114e5c-845f-4f2b-9937-57b89f17cc79 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:26.300048 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33114e5c-845f-4f2b-9937-57b89f17cc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:26.300361 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33114e5c-845f-4f2b-9937-57b89f17cc79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:26.301862 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33114e5c-845f-4f2b-9937-57b89f17cc79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:30:26.302162 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33114e5c-845f-4f2b-9937-57b89f17cc79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:26.303798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33114e5c-845f-4f2b-9937-57b89f17cc79 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:26.316151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1285/2582] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:30:26.321100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea2461-8add-4e14-a17a-71eb60baed18 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:26.331100 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea2461-8add-4e14-a17a-71eb60baed18 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:26.336159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed939868-e5a8-4845-bf33-b4e2bf9231a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:26.336875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed939868-e5a8-4845-bf33-b4e2bf9231a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:26.337158 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed939868-e5a8-4845-bf33-b4e2bf9231a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:26.337434 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed939868-e5a8-4845-bf33-b4e2bf9231a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:26.338146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed939868-e5a8-4845-bf33-b4e2bf9231a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:26.340055 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed939868-e5a8-4845-bf33-b4e2bf9231a0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:26.376826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1298/2583] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:30:26 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:30:26.386269 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33114e5c-845f-4f2b-9937-57b89f17cc79 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:26.396896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33114e5c-845f-4f2b-9937-57b89f17cc79 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:26.453146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe65f8a-c467-4f49-868e-56a96945608b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:26.453819 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe65f8a-c467-4f49-868e-56a96945608b admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:26.454107 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe65f8a-c467-4f49-868e-56a96945608b admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:26.454507 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe65f8a-c467-4f49-868e-56a96945608b admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:26.455195 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe65f8a-c467-4f49-868e-56a96945608b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:26.457212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe65f8a-c467-4f49-868e-56a96945608b admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:26.478786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1286/2584] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:30:26 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:26.482991 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed939868-e5a8-4845-bf33-b4e2bf9231a0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:26.493881 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed939868-e5a8-4845-bf33-b4e2bf9231a0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:26.498487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad3176-1a4d-449d-9507-139ccaaeb836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:26.499238 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad3176-1a4d-449d-9507-139ccaaeb836 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:26.499516 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad3176-1a4d-449d-9507-139ccaaeb836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:26.499794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad3176-1a4d-449d-9507-139ccaaeb836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:26.500615 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad3176-1a4d-449d-9507-139ccaaeb836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:26.502214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad3176-1a4d-449d-9507-139ccaaeb836 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:26.512239 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1299/2585] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:26.516332 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe65f8a-c467-4f49-868e-56a96945608b admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:26.527305 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe65f8a-c467-4f49-868e-56a96945608b admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:26.531947 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13487f07-ce98-4a7c-b8c3-afa45a08092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:26.532645 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13487f07-ce98-4a7c-b8c3-afa45a08092b admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:26.532929 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13487f07-ce98-4a7c-b8c3-afa45a08092b admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:26.533214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13487f07-ce98-4a7c-b8c3-afa45a08092b admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:26.533928 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13487f07-ce98-4a7c-b8c3-afa45a08092b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:26.536407 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13487f07-ce98-4a7c-b8c3-afa45a08092b admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:26.547261 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1287/2586] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:26.551425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad3176-1a4d-449d-9507-139ccaaeb836 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:26.561975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad3176-1a4d-449d-9507-139ccaaeb836 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:26.566668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2dd39-55cd-4d16-8fc5-3415db1c2507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:26.567561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2dd39-55cd-4d16-8fc5-3415db1c2507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:26.567855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2dd39-55cd-4d16-8fc5-3415db1c2507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:26.568134 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2dd39-55cd-4d16-8fc5-3415db1c2507 admin admin] PATH_INFO: `/v3/projects/1e171d9da34049a1966ca0f258225d35/users/943162197aeb48f8aaaa64829ae58a75/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:26.583647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2dd39-55cd-4d16-8fc5-3415db1c2507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e171d9da34049a1966ca0f258225d35, user_id=943162197aeb48f8aaaa64829ae58a75, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:26.586289 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2dd39-55cd-4d16-8fc5-3415db1c2507 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:26.600034 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1300/2587] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:30:26 2022] PUT /identity/v3/projects/1e171d9da34049a1966ca0f258225d35/users/943162197aeb48f8aaaa64829ae58a75/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:26.610197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db8cbe-ae2d-42b7-88eb-d15e35a7cffc None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:26.610494 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db8cbe-ae2d-42b7-88eb-d15e35a7cffc None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:26.610801 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db8cbe-ae2d-42b7-88eb-d15e35a7cffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:26.639122 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c0db8cbe-ae2d-42b7-88eb-d15e35a7cffc None None] MFA Rules not processed for user `943162197aeb48f8aaaa64829ae58a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:26.640386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c0db8cbe-ae2d-42b7-88eb-d15e35a7cffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:26.714945 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1288/2588] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:26.726912 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2dd39-55cd-4d16-8fc5-3415db1c2507 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:26.728726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bdd2dd39-55cd-4d16-8fc5-3415db1c2507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:26.750596 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:26.790091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2dd39-55cd-4d16-8fc5-3415db1c2507 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:26.793711 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9774d-4487-4e16-8f2f-c829320dea4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:26.794362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9774d-4487-4e16-8f2f-c829320dea4d service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:26.794650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9774d-4487-4e16-8f2f-c829320dea4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:26.794930 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9774d-4487-4e16-8f2f-c829320dea4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:26.803527 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9774d-4487-4e16-8f2f-c829320dea4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:26.804984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9774d-4487-4e16-8f2f-c829320dea4d service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:26.813794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1301/2589] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:26.838524 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db8cbe-ae2d-42b7-88eb-d15e35a7cffc None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:26.858086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:26.903737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db8cbe-ae2d-42b7-88eb-d15e35a7cffc None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:26.908412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532a16f-8a58-4a0e-b841-d610f75953e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:26.909293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532a16f-8a58-4a0e-b841-d610f75953e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:26.909577 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532a16f-8a58-4a0e-b841-d610f75953e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:26.909855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532a16f-8a58-4a0e-b841-d610f75953e2 admin admin] PATH_INFO: `/v3/users/943162197aeb48f8aaaa64829ae58a75` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:26.911364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532a16f-8a58-4a0e-b841-d610f75953e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=943162197aeb48f8aaaa64829ae58a75)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:26.913329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532a16f-8a58-4a0e-b841-d610f75953e2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:26.962200 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e532a16f-8a58-4a0e-b841-d610f75953e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943162197aeb48f8aaaa64829ae58a75'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:26.969711 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e532a16f-8a58-4a0e-b841-d610f75953e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943162197aeb48f8aaaa64829ae58a75'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:26.970291 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e532a16f-8a58-4a0e-b841-d610f75953e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943162197aeb48f8aaaa64829ae58a75'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:26.970909 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e532a16f-8a58-4a0e-b841-d610f75953e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943162197aeb48f8aaaa64829ae58a75'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:26.982769 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e532a16f-8a58-4a0e-b841-d610f75953e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943162197aeb48f8aaaa64829ae58a75'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:26.995351 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1289/2590] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:30:26 2022] DELETE /identity/v3/users/943162197aeb48f8aaaa64829ae58a75 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:27.000005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86abea7-0f81-4ecc-962f-9c3e57d7af78 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:27.000317 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86abea7-0f81-4ecc-962f-9c3e57d7af78 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:27.000598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86abea7-0f81-4ecc-962f-9c3e57d7af78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:27.022026 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f86abea7-0f81-4ecc-962f-9c3e57d7af78 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:27.023647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f86abea7-0f81-4ecc-962f-9c3e57d7af78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:27.093826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1302/2591] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:30:27.104098 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532a16f-8a58-4a0e-b841-d610f75953e2 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:27.105600 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-e532a16f-8a58-4a0e-b841-d610f75953e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:27.162203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532a16f-8a58-4a0e-b841-d610f75953e2 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:27.165868 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e86ee-943d-47df-88d2-1bbbabe7ae17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:27.166508 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e86ee-943d-47df-88d2-1bbbabe7ae17 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:27.166786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e86ee-943d-47df-88d2-1bbbabe7ae17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:27.167059 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e86ee-943d-47df-88d2-1bbbabe7ae17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:27.175991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e86ee-943d-47df-88d2-1bbbabe7ae17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:27.177543 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e86ee-943d-47df-88d2-1bbbabe7ae17 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:27.187763 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1290/2592] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:27.531179 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86abea7-0f81-4ecc-962f-9c3e57d7af78 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:27.532837 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f86abea7-0f81-4ecc-962f-9c3e57d7af78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:27.546128 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86abea7-0f81-4ecc-962f-9c3e57d7af78 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:27.551682 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a582d-343c-4b70-aad8-d07cbe37eba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:27.552717 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a582d-343c-4b70-aad8-d07cbe37eba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:27.559939 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a582d-343c-4b70-aad8-d07cbe37eba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:27.560342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a582d-343c-4b70-aad8-d07cbe37eba6 admin admin] PATH_INFO: `/v3/projects/1e171d9da34049a1966ca0f258225d35` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:27.562265 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a582d-343c-4b70-aad8-d07cbe37eba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e171d9da34049a1966ca0f258225d35)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:27.564482 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a582d-343c-4b70-aad8-d07cbe37eba6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:27.618731 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-619a582d-343c-4b70-aad8-d07cbe37eba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e171d9da34049a1966ca0f258225d35', 'request_id': 'req-619a582d-343c-4b70-aad8-d07cbe37eba6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:27.625226 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-619a582d-343c-4b70-aad8-d07cbe37eba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e171d9da34049a1966ca0f258225d35', 'request_id': 'req-619a582d-343c-4b70-aad8-d07cbe37eba6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:27.632729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-619a582d-343c-4b70-aad8-d07cbe37eba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e171d9da34049a1966ca0f258225d35', 'request_id': 'req-619a582d-343c-4b70-aad8-d07cbe37eba6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:27.645615 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-619a582d-343c-4b70-aad8-d07cbe37eba6 admin admin] The token cache is being invalidate because project 1e171d9da34049a1966ca0f258225d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:30:27.645907 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-619a582d-343c-4b70-aad8-d07cbe37eba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:27.646523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-619a582d-343c-4b70-aad8-d07cbe37eba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:27.648235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1303/2593] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:30:27 2022] DELETE /identity/v3/projects/1e171d9da34049a1966ca0f258225d35 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:27.653262 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f317ae-464e-45cf-8d66-9dc9fbf4be1c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:27.653744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f317ae-464e-45cf-8d66-9dc9fbf4be1c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:27.653845 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f317ae-464e-45cf-8d66-9dc9fbf4be1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:27.674085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-71f317ae-464e-45cf-8d66-9dc9fbf4be1c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:27.675296 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-71f317ae-464e-45cf-8d66-9dc9fbf4be1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:27.708742 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:27.735456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1291/2594] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:27.744115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44002e6b-fc14-44af-b669-52f06db2d0df None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:27.744460 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44002e6b-fc14-44af-b669-52f06db2d0df None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:27.744738 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44002e6b-fc14-44af-b669-52f06db2d0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:27.764487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-44002e6b-fc14-44af-b669-52f06db2d0df None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:27.765684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-44002e6b-fc14-44af-b669-52f06db2d0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:27.773855 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1304/2595] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:27.778229 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f317ae-464e-45cf-8d66-9dc9fbf4be1c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:27.788898 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f317ae-464e-45cf-8d66-9dc9fbf4be1c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:27.793618 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faf799-a6bc-4d07-8981-97aece41bf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:27.794272 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faf799-a6bc-4d07-8981-97aece41bf36 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:27.794561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faf799-a6bc-4d07-8981-97aece41bf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:27.794841 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faf799-a6bc-4d07-8981-97aece41bf36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:27.795565 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faf799-a6bc-4d07-8981-97aece41bf36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:30:27.795873 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faf799-a6bc-4d07-8981-97aece41bf36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:27.797520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faf799-a6bc-4d07-8981-97aece41bf36 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:27.809629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1292/2596] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:30:27.814038 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44002e6b-fc14-44af-b669-52f06db2d0df None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:27.823338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44002e6b-fc14-44af-b669-52f06db2d0df None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:27.827928 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712eea0-46e5-4e2f-a1cd-42f652034faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:27.828608 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712eea0-46e5-4e2f-a1cd-42f652034faa admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:27.828887 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712eea0-46e5-4e2f-a1cd-42f652034faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:27.829161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712eea0-46e5-4e2f-a1cd-42f652034faa admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:27.829854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712eea0-46e5-4e2f-a1cd-42f652034faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:27.831744 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712eea0-46e5-4e2f-a1cd-42f652034faa admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:27.861101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1305/2597] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:30:27 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:27.866172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faf799-a6bc-4d07-8981-97aece41bf36 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:27.876195 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faf799-a6bc-4d07-8981-97aece41bf36 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:27.932137 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f419854-5e3d-44de-9fbe-3d5395fec229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:27.932839 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f419854-5e3d-44de-9fbe-3d5395fec229 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:27.933234 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f419854-5e3d-44de-9fbe-3d5395fec229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:27.933520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f419854-5e3d-44de-9fbe-3d5395fec229 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:27.934201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f419854-5e3d-44de-9fbe-3d5395fec229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:27.936123 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f419854-5e3d-44de-9fbe-3d5395fec229 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:27.959052 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1293/2598] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:30:27 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:27.963318 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712eea0-46e5-4e2f-a1cd-42f652034faa admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:27.974486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712eea0-46e5-4e2f-a1cd-42f652034faa admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:27.979050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e27872-459f-4e0b-8ecf-dd315a271eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:27.979700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e27872-459f-4e0b-8ecf-dd315a271eff admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:27.979979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e27872-459f-4e0b-8ecf-dd315a271eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:27.980278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e27872-459f-4e0b-8ecf-dd315a271eff admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:27.980986 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e27872-459f-4e0b-8ecf-dd315a271eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:27.982573 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e27872-459f-4e0b-8ecf-dd315a271eff admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:27.993433 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1306/2599] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:27.997629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f419854-5e3d-44de-9fbe-3d5395fec229 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:28.008090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f419854-5e3d-44de-9fbe-3d5395fec229 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:28.012981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46610aaf-5f22-401b-9b7d-14f336fab0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:28.013633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46610aaf-5f22-401b-9b7d-14f336fab0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:28.013916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46610aaf-5f22-401b-9b7d-14f336fab0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:28.014188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46610aaf-5f22-401b-9b7d-14f336fab0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:28.014908 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46610aaf-5f22-401b-9b7d-14f336fab0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:28.016680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46610aaf-5f22-401b-9b7d-14f336fab0a2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:28.027941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1294/2600] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:30:28.032202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e27872-459f-4e0b-8ecf-dd315a271eff admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:28.044010 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e27872-459f-4e0b-8ecf-dd315a271eff admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:28.048687 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57662252-1d85-4f85-8eb1-32f63d45672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:28.049557 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57662252-1d85-4f85-8eb1-32f63d45672c admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:28.049841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57662252-1d85-4f85-8eb1-32f63d45672c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:28.050113 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57662252-1d85-4f85-8eb1-32f63d45672c admin admin] PATH_INFO: `/v3/projects/ff63dce8c9324a68ad9b8b46523b7b82/users/71ba8cc4f00946feb7457eac3c61e044/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:28.052504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:28.068016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57662252-1d85-4f85-8eb1-32f63d45672c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff63dce8c9324a68ad9b8b46523b7b82, user_id=71ba8cc4f00946feb7457eac3c61e044, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:28.070689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57662252-1d85-4f85-8eb1-32f63d45672c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:28.089846 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1307/2601] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:30:28 2022] PUT /identity/v3/projects/ff63dce8c9324a68ad9b8b46523b7b82/users/71ba8cc4f00946feb7457eac3c61e044/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:28.095095 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49bc29-8c8e-4d2c-b991-f4454e86af54 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:28.095383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49bc29-8c8e-4d2c-b991-f4454e86af54 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:28.095666 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49bc29-8c8e-4d2c-b991-f4454e86af54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:28.116544 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-dc49bc29-8c8e-4d2c-b991-f4454e86af54 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:28.117777 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-dc49bc29-8c8e-4d2c-b991-f4454e86af54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:28.180991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1295/2602] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:28.190883 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57662252-1d85-4f85-8eb1-32f63d45672c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:28.192663 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-57662252-1d85-4f85-8eb1-32f63d45672c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:28.249222 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57662252-1d85-4f85-8eb1-32f63d45672c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:28.252905 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92fbbb-0957-4210-b92f-c727faa8815c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:28.253558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92fbbb-0957-4210-b92f-c727faa8815c service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:28.253857 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92fbbb-0957-4210-b92f-c727faa8815c service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:28.254137 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92fbbb-0957-4210-b92f-c727faa8815c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:28.262982 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92fbbb-0957-4210-b92f-c727faa8815c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:28.264448 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92fbbb-0957-4210-b92f-c727faa8815c service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:28.274452 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1308/2603] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:28.603591 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49bc29-8c8e-4d2c-b991-f4454e86af54 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:28.605169 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-dc49bc29-8c8e-4d2c-b991-f4454e86af54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:28.630412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92fbbb-0957-4210-b92f-c727faa8815c service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:28.644811 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92fbbb-0957-4210-b92f-c727faa8815c service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:28.649015 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dcfe2-0928-4cf2-8f16-1dbbf6b67e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:28.649675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dcfe2-0928-4cf2-8f16-1dbbf6b67e54 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:28.649962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dcfe2-0928-4cf2-8f16-1dbbf6b67e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:28.650243 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dcfe2-0928-4cf2-8f16-1dbbf6b67e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:28.652284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-504dcfe2-0928-4cf2-8f16-1dbbf6b67e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:28.676933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:28.714723 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49bc29-8c8e-4d2c-b991-f4454e86af54 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:28.725776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3506fb-e7d8-4ce5-a818-4977c06c2268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:28.726512 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3506fb-e7d8-4ce5-a818-4977c06c2268 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:28.727076 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3506fb-e7d8-4ce5-a818-4977c06c2268 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:28.727389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3506fb-e7d8-4ce5-a818-4977c06c2268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:28.729883 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2d3506fb-e7d8-4ce5-a818-4977c06c2268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:28.769884 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504dcfe2-0928-4cf2-8f16-1dbbf6b67e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:28.771532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504dcfe2-0928-4cf2-8f16-1dbbf6b67e54 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:28.793164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1309/2604] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:30:28.804055 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3506fb-e7d8-4ce5-a818-4977c06c2268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:28.805912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3506fb-e7d8-4ce5-a818-4977c06c2268 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:28.816155 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1296/2605] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:30:29.195437 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdb094-de2e-4749-b70e-a9f28eb1853b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:29.195731 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdb094-de2e-4749-b70e-a9f28eb1853b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:29.196014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdb094-de2e-4749-b70e-a9f28eb1853b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:29.241040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-67cdb094-de2e-4749-b70e-a9f28eb1853b None None] MFA Rules not processed for user `71ba8cc4f00946feb7457eac3c61e044`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:29.242294 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-67cdb094-de2e-4749-b70e-a9f28eb1853b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:29.291641 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:29.320359 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1310/2606] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:29.331558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3506fb-e7d8-4ce5-a818-4977c06c2268 service nova] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:29.333388 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2d3506fb-e7d8-4ce5-a818-4977c06c2268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:29.403927 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3506fb-e7d8-4ce5-a818-4977c06c2268 service nova] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:29.407721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15f075-5e0c-44b1-bbf9-05b04be29a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:29.408408 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15f075-5e0c-44b1-bbf9-05b04be29a8c service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:29.408693 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15f075-5e0c-44b1-bbf9-05b04be29a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:29.408971 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15f075-5e0c-44b1-bbf9-05b04be29a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:29.417812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15f075-5e0c-44b1-bbf9-05b04be29a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:29.419258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15f075-5e0c-44b1-bbf9-05b04be29a8c service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:29.428909 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1297/2607] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:30.845956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b94a57-37af-469c-bb24-e531122d99bf None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:30.846538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b94a57-37af-469c-bb24-e531122d99bf None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:30.846663 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b94a57-37af-469c-bb24-e531122d99bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:30.872105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-22b94a57-37af-469c-bb24-e531122d99bf None None] MFA Rules not processed for user `71ba8cc4f00946feb7457eac3c61e044`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:30.873570 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-22b94a57-37af-469c-bb24-e531122d99bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:30.881467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1311/2608] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:34.169811 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15f075-5e0c-44b1-bbf9-05b04be29a8c service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:34.172181 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ef15f075-5e0c-44b1-bbf9-05b04be29a8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:34.194401 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15f075-5e0c-44b1-bbf9-05b04be29a8c service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:34.199807 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce62840-5617-46d1-b46f-46936e113f93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:34.200476 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce62840-5617-46d1-b46f-46936e113f93 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:34.200757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce62840-5617-46d1-b46f-46936e113f93 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:34.201031 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce62840-5617-46d1-b46f-46936e113f93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:34.202773 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4ce62840-5617-46d1-b46f-46936e113f93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:34.215753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce62840-5617-46d1-b46f-46936e113f93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:34.217371 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce62840-5617-46d1-b46f-46936e113f93 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:34.232696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1298/2609] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:34.437854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b94a57-37af-469c-bb24-e531122d99bf None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:34.447747 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b94a57-37af-469c-bb24-e531122d99bf None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:34.451370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a807ac2-772b-4e72-8dc1-dc480e6aa2ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:34.452019 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a807ac2-772b-4e72-8dc1-dc480e6aa2ee service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:34.452325 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a807ac2-772b-4e72-8dc1-dc480e6aa2ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:34.452607 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a807ac2-772b-4e72-8dc1-dc480e6aa2ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:34.454398 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2a807ac2-772b-4e72-8dc1-dc480e6aa2ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:34.470979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a807ac2-772b-4e72-8dc1-dc480e6aa2ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:34.472997 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a807ac2-772b-4e72-8dc1-dc480e6aa2ee service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:34.485642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1312/2610] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:37.947284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce62840-5617-46d1-b46f-46936e113f93 service nova] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:37.949627 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4ce62840-5617-46d1-b46f-46936e113f93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:37.966933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce62840-5617-46d1-b46f-46936e113f93 service nova] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:37.971918 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9273c-5b72-4d44-841f-84c9f6fa84fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:37.972876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9273c-5b72-4d44-841f-84c9f6fa84fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:37.973160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9273c-5b72-4d44-841f-84c9f6fa84fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:37.973435 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9273c-5b72-4d44-841f-84c9f6fa84fe admin admin] PATH_INFO: `/v3/users/13ea16d9dcaa4c00b26e166b9a639077` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:37.974753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9273c-5b72-4d44-841f-84c9f6fa84fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ea16d9dcaa4c00b26e166b9a639077)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:37.976995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9273c-5b72-4d44-841f-84c9f6fa84fe admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:38.036738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-20d9273c-5b72-4d44-841f-84c9f6fa84fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ea16d9dcaa4c00b26e166b9a639077'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:38.046561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-20d9273c-5b72-4d44-841f-84c9f6fa84fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ea16d9dcaa4c00b26e166b9a639077'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:38.047211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-20d9273c-5b72-4d44-841f-84c9f6fa84fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ea16d9dcaa4c00b26e166b9a639077'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:38.047941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-20d9273c-5b72-4d44-841f-84c9f6fa84fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ea16d9dcaa4c00b26e166b9a639077'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:38.059091 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:38.061607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-20d9273c-5b72-4d44-841f-84c9f6fa84fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ea16d9dcaa4c00b26e166b9a639077'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:38.076727 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1299/2611] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:30:37 2022] DELETE /identity/v3/users/13ea16d9dcaa4c00b26e166b9a639077 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:38.441537 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a807ac2-772b-4e72-8dc1-dc480e6aa2ee service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:38.453095 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a807ac2-772b-4e72-8dc1-dc480e6aa2ee service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:38.518939 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da6465-0cae-4d6e-a317-18d37f14b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:38.520375 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da6465-0cae-4d6e-a317-18d37f14b494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:38.520652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da6465-0cae-4d6e-a317-18d37f14b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:38.520925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da6465-0cae-4d6e-a317-18d37f14b494 admin admin] PATH_INFO: `/v3/projects/2cca364a5fbf4c178d2d13c503544279` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:38.522131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da6465-0cae-4d6e-a317-18d37f14b494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cca364a5fbf4c178d2d13c503544279)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:38.524027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da6465-0cae-4d6e-a317-18d37f14b494 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:38.569567 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-61da6465-0cae-4d6e-a317-18d37f14b494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cca364a5fbf4c178d2d13c503544279', 'request_id': 'req-61da6465-0cae-4d6e-a317-18d37f14b494'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:38.575907 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-61da6465-0cae-4d6e-a317-18d37f14b494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cca364a5fbf4c178d2d13c503544279', 'request_id': 'req-61da6465-0cae-4d6e-a317-18d37f14b494'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:38.582539 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-61da6465-0cae-4d6e-a317-18d37f14b494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cca364a5fbf4c178d2d13c503544279', 'request_id': 'req-61da6465-0cae-4d6e-a317-18d37f14b494'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:38.595108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-61da6465-0cae-4d6e-a317-18d37f14b494 admin admin] The token cache is being invalidate because project 2cca364a5fbf4c178d2d13c503544279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:30:38.595501 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-61da6465-0cae-4d6e-a317-18d37f14b494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:38.596262 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-61da6465-0cae-4d6e-a317-18d37f14b494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:38.598544 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1313/2612] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:30:38 2022] DELETE /identity/v3/projects/2cca364a5fbf4c178d2d13c503544279 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:38.603661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a83f2a-e860-4196-be6a-e694e61ed01e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:38.604055 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a83f2a-e860-4196-be6a-e694e61ed01e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:38.604368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a83f2a-e860-4196-be6a-e694e61ed01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:38.625091 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-10a83f2a-e860-4196-be6a-e694e61ed01e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:38.626437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-10a83f2a-e860-4196-be6a-e694e61ed01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:38.689248 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1300/2613] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:38.698345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd12fad-afa7-467a-ace0-dfda0323f353 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:38.698641 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd12fad-afa7-467a-ace0-dfda0323f353 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:38.698922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd12fad-afa7-467a-ace0-dfda0323f353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:38.718538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1cd12fad-afa7-467a-ace0-dfda0323f353 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:38.719831 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1cd12fad-afa7-467a-ace0-dfda0323f353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:38.728233 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1314/2614] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:38.732764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a83f2a-e860-4196-be6a-e694e61ed01e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:38.743001 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a83f2a-e860-4196-be6a-e694e61ed01e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:38.747672 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c1075-24b7-419c-aca4-b58e737c178c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:38.748357 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c1075-24b7-419c-aca4-b58e737c178c admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:38.748638 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c1075-24b7-419c-aca4-b58e737c178c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:38.748910 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c1075-24b7-419c-aca4-b58e737c178c admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:38.749628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c1075-24b7-419c-aca4-b58e737c178c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:30:38.749930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c1075-24b7-419c-aca4-b58e737c178c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:38.751519 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c1075-24b7-419c-aca4-b58e737c178c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:38.763280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1301/2615] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:30:38.767907 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd12fad-afa7-467a-ace0-dfda0323f353 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:38.777876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd12fad-afa7-467a-ace0-dfda0323f353 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:38.782569 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc48f27-0e31-4c78-bc63-70600c4616b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:38.783221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc48f27-0e31-4c78-bc63-70600c4616b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:38.783502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc48f27-0e31-4c78-bc63-70600c4616b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:38.783775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc48f27-0e31-4c78-bc63-70600c4616b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:38.784657 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc48f27-0e31-4c78-bc63-70600c4616b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:38.787172 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc48f27-0e31-4c78-bc63-70600c4616b8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:38.816286 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1315/2616] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:30:38 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:38.820906 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c1075-24b7-419c-aca4-b58e737c178c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:38.830958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c1075-24b7-419c-aca4-b58e737c178c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:38.890321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a84e6e-8940-45d4-9691-8920da06d461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:38.891003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a84e6e-8940-45d4-9691-8920da06d461 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:38.891286 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a84e6e-8940-45d4-9691-8920da06d461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:38.891563 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a84e6e-8940-45d4-9691-8920da06d461 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:38.892294 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a84e6e-8940-45d4-9691-8920da06d461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:38.894897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a84e6e-8940-45d4-9691-8920da06d461 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:38.917468 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1302/2617] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:30:38 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:38.921528 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc48f27-0e31-4c78-bc63-70600c4616b8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:38.931861 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc48f27-0e31-4c78-bc63-70600c4616b8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:38.937248 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f82720-b4a0-49d9-bedf-65a79be60379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:38.937930 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f82720-b4a0-49d9-bedf-65a79be60379 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:38.938217 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f82720-b4a0-49d9-bedf-65a79be60379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:38.938509 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f82720-b4a0-49d9-bedf-65a79be60379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:38.939225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f82720-b4a0-49d9-bedf-65a79be60379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:38.940872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f82720-b4a0-49d9-bedf-65a79be60379 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:38.951788 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1316/2618] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:38.957290 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a84e6e-8940-45d4-9691-8920da06d461 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:38.973483 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a84e6e-8940-45d4-9691-8920da06d461 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:38.980177 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3486b-ba04-47a5-b2b3-f43f8c340165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:38.981026 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3486b-ba04-47a5-b2b3-f43f8c340165 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:38.981378 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3486b-ba04-47a5-b2b3-f43f8c340165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:38.981724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3486b-ba04-47a5-b2b3-f43f8c340165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:38.982520 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3486b-ba04-47a5-b2b3-f43f8c340165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:38.984134 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3486b-ba04-47a5-b2b3-f43f8c340165 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:38.997151 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1303/2619] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:39.002328 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f82720-b4a0-49d9-bedf-65a79be60379 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:39.018954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f82720-b4a0-49d9-bedf-65a79be60379 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:39.024712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28f7ea-7e55-416c-bf49-46fcc38252d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:39.025692 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28f7ea-7e55-416c-bf49-46fcc38252d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:39.026138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28f7ea-7e55-416c-bf49-46fcc38252d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:39.026422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28f7ea-7e55-416c-bf49-46fcc38252d7 admin admin] PATH_INFO: `/v3/projects/b7096a0e74b449648b29058df384b504/users/ca314dacf4cd42b2bc9e47cbb0ba2f26/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:39.043949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:39.050347 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28f7ea-7e55-416c-bf49-46fcc38252d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7096a0e74b449648b29058df384b504, user_id=ca314dacf4cd42b2bc9e47cbb0ba2f26, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:39.053370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28f7ea-7e55-416c-bf49-46fcc38252d7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:39.071640 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1317/2620] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:30:39 2022] PUT /identity/v3/projects/b7096a0e74b449648b29058df384b504/users/ca314dacf4cd42b2bc9e47cbb0ba2f26/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:30:39.083672 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382ff1f-65cf-4b49-b6df-e84cad210890 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:39.083960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382ff1f-65cf-4b49-b6df-e84cad210890 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:39.084240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382ff1f-65cf-4b49-b6df-e84cad210890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:39.124776 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2382ff1f-65cf-4b49-b6df-e84cad210890 None None] MFA Rules not processed for user `ca314dacf4cd42b2bc9e47cbb0ba2f26`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:39.126006 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2382ff1f-65cf-4b49-b6df-e84cad210890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:39.178999 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:39.206196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1304/2621] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:39.218329 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28f7ea-7e55-416c-bf49-46fcc38252d7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:39.220189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9e28f7ea-7e55-416c-bf49-46fcc38252d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:39.299474 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28f7ea-7e55-416c-bf49-46fcc38252d7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:39.305934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d37a80-e363-4ac6-8880-0464ebd0f474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:39.306581 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d37a80-e363-4ac6-8880-0464ebd0f474 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:39.306864 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d37a80-e363-4ac6-8880-0464ebd0f474 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:39.307147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d37a80-e363-4ac6-8880-0464ebd0f474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:39.315572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d37a80-e363-4ac6-8880-0464ebd0f474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:39.317348 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d37a80-e363-4ac6-8880-0464ebd0f474 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:39.326946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1318/2622] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:39.583194 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382ff1f-65cf-4b49-b6df-e84cad210890 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:39.649079 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382ff1f-65cf-4b49-b6df-e84cad210890 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:39.653682 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f7410-24ac-4637-9eb0-1ac496b0c250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:39.654569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f7410-24ac-4637-9eb0-1ac496b0c250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:39.654856 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f7410-24ac-4637-9eb0-1ac496b0c250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:39.655139 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f7410-24ac-4637-9eb0-1ac496b0c250 admin admin] PATH_INFO: `/v3/users/ca314dacf4cd42b2bc9e47cbb0ba2f26` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:39.656411 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f7410-24ac-4637-9eb0-1ac496b0c250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca314dacf4cd42b2bc9e47cbb0ba2f26)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:39.658350 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f7410-24ac-4637-9eb0-1ac496b0c250 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:39.708683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-032f7410-24ac-4637-9eb0-1ac496b0c250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca314dacf4cd42b2bc9e47cbb0ba2f26'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:39.718365 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-032f7410-24ac-4637-9eb0-1ac496b0c250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca314dacf4cd42b2bc9e47cbb0ba2f26'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:39.719074 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-032f7410-24ac-4637-9eb0-1ac496b0c250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca314dacf4cd42b2bc9e47cbb0ba2f26'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:39.719798 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-032f7410-24ac-4637-9eb0-1ac496b0c250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca314dacf4cd42b2bc9e47cbb0ba2f26'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:39.735247 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-032f7410-24ac-4637-9eb0-1ac496b0c250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca314dacf4cd42b2bc9e47cbb0ba2f26'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:39.750475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1305/2623] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:30:39 2022] DELETE /identity/v3/users/ca314dacf4cd42b2bc9e47cbb0ba2f26 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:39.755016 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ac34f-c355-47ac-a689-a37cd803dfb2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:39.755545 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ac34f-c355-47ac-a689-a37cd803dfb2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:39.755644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ac34f-c355-47ac-a689-a37cd803dfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:39.781781 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-718ac34f-c355-47ac-a689-a37cd803dfb2 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:39.783108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-718ac34f-c355-47ac-a689-a37cd803dfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:39.894878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1319/2624] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:39.906765 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f7410-24ac-4637-9eb0-1ac496b0c250 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:39.911165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-032f7410-24ac-4637-9eb0-1ac496b0c250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:39.973661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f7410-24ac-4637-9eb0-1ac496b0c250 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:39.977481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b85456-4074-468a-89ef-4f34b3871bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:39.978141 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b85456-4074-468a-89ef-4f34b3871bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:39.978448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b85456-4074-468a-89ef-4f34b3871bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:39.978696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b85456-4074-468a-89ef-4f34b3871bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:39.989673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b85456-4074-468a-89ef-4f34b3871bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:39.991140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b85456-4074-468a-89ef-4f34b3871bf0 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:40.002372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1306/2625] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:40.310997 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ac34f-c355-47ac-a689-a37cd803dfb2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:40.315675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-718ac34f-c355-47ac-a689-a37cd803dfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:40.325705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ac34f-c355-47ac-a689-a37cd803dfb2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:40.331167 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd104311-5199-499b-b9b1-494154f674db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:40.332198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd104311-5199-499b-b9b1-494154f674db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:40.332582 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd104311-5199-499b-b9b1-494154f674db admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:40.332926 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd104311-5199-499b-b9b1-494154f674db admin admin] PATH_INFO: `/v3/projects/b7096a0e74b449648b29058df384b504` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:40.334250 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd104311-5199-499b-b9b1-494154f674db admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7096a0e74b449648b29058df384b504)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:40.339771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd104311-5199-499b-b9b1-494154f674db admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:40.390277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fd104311-5199-499b-b9b1-494154f674db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7096a0e74b449648b29058df384b504', 'request_id': 'req-fd104311-5199-499b-b9b1-494154f674db'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:40.397524 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fd104311-5199-499b-b9b1-494154f674db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7096a0e74b449648b29058df384b504', 'request_id': 'req-fd104311-5199-499b-b9b1-494154f674db'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:40.404125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fd104311-5199-499b-b9b1-494154f674db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7096a0e74b449648b29058df384b504', 'request_id': 'req-fd104311-5199-499b-b9b1-494154f674db'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:40.414755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:40.418922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fd104311-5199-499b-b9b1-494154f674db admin admin] The token cache is being invalidate because project b7096a0e74b449648b29058df384b504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:30:40.419539 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fd104311-5199-499b-b9b1-494154f674db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:40.420999 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fd104311-5199-499b-b9b1-494154f674db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:40.424344 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1320/2626] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:30:40 2022] DELETE /identity/v3/projects/b7096a0e74b449648b29058df384b504 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:40.428241 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ee2b9-81f5-4a62-b3f7-587eb3436d86 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:40.428576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ee2b9-81f5-4a62-b3f7-587eb3436d86 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:40.428859 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ee2b9-81f5-4a62-b3f7-587eb3436d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:40.438036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:40.452842 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-590ee2b9-81f5-4a62-b3f7-587eb3436d86 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:40.454822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-590ee2b9-81f5-4a62-b3f7-587eb3436d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:40.518050 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1307/2627] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:40.526203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190df89-e416-49fb-bf96-73be6afb8bd2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:40.526494 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190df89-e416-49fb-bf96-73be6afb8bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:40.526777 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190df89-e416-49fb-bf96-73be6afb8bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:40.551576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e190df89-e416-49fb-bf96-73be6afb8bd2 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:40.553087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e190df89-e416-49fb-bf96-73be6afb8bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:40.562006 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1321/2628] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:40.566065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ee2b9-81f5-4a62-b3f7-587eb3436d86 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:40.576975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ee2b9-81f5-4a62-b3f7-587eb3436d86 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:40.582078 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341023d4-2ee2-40b6-8888-b00114676237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:40.582751 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341023d4-2ee2-40b6-8888-b00114676237 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:40.583030 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341023d4-2ee2-40b6-8888-b00114676237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:40.583306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341023d4-2ee2-40b6-8888-b00114676237 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:40.584067 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341023d4-2ee2-40b6-8888-b00114676237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:30:40.585082 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341023d4-2ee2-40b6-8888-b00114676237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:40.586020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341023d4-2ee2-40b6-8888-b00114676237 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:40.599288 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1308/2629] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:30:40.603703 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190df89-e416-49fb-bf96-73be6afb8bd2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:40.614337 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190df89-e416-49fb-bf96-73be6afb8bd2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:40.619430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2c62b-3716-4763-bdd6-82005ddd158f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:40.620322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2c62b-3716-4763-bdd6-82005ddd158f admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:40.620452 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2c62b-3716-4763-bdd6-82005ddd158f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:40.620895 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2c62b-3716-4763-bdd6-82005ddd158f admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:40.621504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2c62b-3716-4763-bdd6-82005ddd158f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:40.623425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2c62b-3716-4763-bdd6-82005ddd158f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:40.653852 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1322/2630] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:30:40 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:30:40.658250 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341023d4-2ee2-40b6-8888-b00114676237 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:40.669550 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341023d4-2ee2-40b6-8888-b00114676237 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:40.732244 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8624f6-a306-4513-838c-89d9dde158c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:40.733041 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8624f6-a306-4513-838c-89d9dde158c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:40.733328 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8624f6-a306-4513-838c-89d9dde158c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:40.733614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8624f6-a306-4513-838c-89d9dde158c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:40.734320 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8624f6-a306-4513-838c-89d9dde158c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:40.736306 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8624f6-a306-4513-838c-89d9dde158c0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:40.759684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1309/2631] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:30:40 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:30:40.763998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2c62b-3716-4763-bdd6-82005ddd158f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:40.775221 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2c62b-3716-4763-bdd6-82005ddd158f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:40.781534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91e3ee-2c39-4735-a68b-fb032152212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:40.781534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91e3ee-2c39-4735-a68b-fb032152212f admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:40.781534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91e3ee-2c39-4735-a68b-fb032152212f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:40.781534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91e3ee-2c39-4735-a68b-fb032152212f admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:40.782734 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91e3ee-2c39-4735-a68b-fb032152212f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:40.784508 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91e3ee-2c39-4735-a68b-fb032152212f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:40.795511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1323/2632] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:40.799690 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8624f6-a306-4513-838c-89d9dde158c0 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:40.810398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8624f6-a306-4513-838c-89d9dde158c0 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:40.815117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9d291-edd2-41d6-8893-79d7c124b097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:40.815786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9d291-edd2-41d6-8893-79d7c124b097 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:40.816141 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9d291-edd2-41d6-8893-79d7c124b097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:40.816448 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9d291-edd2-41d6-8893-79d7c124b097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:40.817177 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9d291-edd2-41d6-8893-79d7c124b097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:40.818821 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9d291-edd2-41d6-8893-79d7c124b097 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:40.836126 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1310/2633] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:40.837383 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91e3ee-2c39-4735-a68b-fb032152212f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:40.848298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91e3ee-2c39-4735-a68b-fb032152212f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:40.853615 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc039a0b-382c-4445-8679-841f6a4529e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:40.854514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc039a0b-382c-4445-8679-841f6a4529e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:40.854801 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc039a0b-382c-4445-8679-841f6a4529e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:40.855078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc039a0b-382c-4445-8679-841f6a4529e3 admin admin] PATH_INFO: `/v3/projects/5f0b0ed50a524700b516854529062d27/users/a27b8f3c753e46f0bba8642ef8bc7413/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:40.873941 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc039a0b-382c-4445-8679-841f6a4529e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0b0ed50a524700b516854529062d27, user_id=a27b8f3c753e46f0bba8642ef8bc7413, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:40.876866 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc039a0b-382c-4445-8679-841f6a4529e3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:40.894609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1324/2634] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:30:40 2022] PUT /identity/v3/projects/5f0b0ed50a524700b516854529062d27/users/a27b8f3c753e46f0bba8642ef8bc7413/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:40.905292 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ba0c5-60cf-4b1b-a391-b1dec99c47e3 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:40.905631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ba0c5-60cf-4b1b-a391-b1dec99c47e3 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:40.905889 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ba0c5-60cf-4b1b-a391-b1dec99c47e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:40.943895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ac3ba0c5-60cf-4b1b-a391-b1dec99c47e3 None None] MFA Rules not processed for user `a27b8f3c753e46f0bba8642ef8bc7413`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:40.945400 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ac3ba0c5-60cf-4b1b-a391-b1dec99c47e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:41.017509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:41.026241 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1311/2635] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:30:41.029787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc039a0b-382c-4445-8679-841f6a4529e3 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:41.123806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc039a0b-382c-4445-8679-841f6a4529e3 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:41.130139 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489ecb9-e5d5-4d19-9fe6-64842191f0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:41.130907 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489ecb9-e5d5-4d19-9fe6-64842191f0fe admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:41.132156 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489ecb9-e5d5-4d19-9fe6-64842191f0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:41.132156 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489ecb9-e5d5-4d19-9fe6-64842191f0fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:41.133603 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489ecb9-e5d5-4d19-9fe6-64842191f0fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:41.135445 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489ecb9-e5d5-4d19-9fe6-64842191f0fe admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:41.174308 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1325/2636] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:30:41 2022] POST /identity/v3/projects => generated 363 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:41.178262 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ba0c5-60cf-4b1b-a391-b1dec99c47e3 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:41.192534 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ba0c5-60cf-4b1b-a391-b1dec99c47e3 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:41.266201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c70e92-f9d6-46c1-acd9-f481f476fe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:41.266925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c70e92-f9d6-46c1-acd9-f481f476fe68 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:41.267213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c70e92-f9d6-46c1-acd9-f481f476fe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:41.267500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c70e92-f9d6-46c1-acd9-f481f476fe68 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:41.268208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c70e92-f9d6-46c1-acd9-f481f476fe68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:41.270618 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c70e92-f9d6-46c1-acd9-f481f476fe68 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:41.295926 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1312/2637] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:30:41 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:41.300997 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489ecb9-e5d5-4d19-9fe6-64842191f0fe admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:41.312979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489ecb9-e5d5-4d19-9fe6-64842191f0fe admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:41.318680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84421f85-64b2-4ec5-9b06-04387cf397c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:41.319768 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84421f85-64b2-4ec5-9b06-04387cf397c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:41.319988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84421f85-64b2-4ec5-9b06-04387cf397c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:41.320290 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84421f85-64b2-4ec5-9b06-04387cf397c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:41.321026 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84421f85-64b2-4ec5-9b06-04387cf397c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:41.322714 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84421f85-64b2-4ec5-9b06-04387cf397c0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:41.335277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1326/2638] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:41.339225 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c70e92-f9d6-46c1-acd9-f481f476fe68 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:41.351347 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c70e92-f9d6-46c1-acd9-f481f476fe68 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:41.356707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8ee51-c1a2-43af-aace-c1242c46959e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:41.357664 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8ee51-c1a2-43af-aace-c1242c46959e admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:41.357965 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8ee51-c1a2-43af-aace-c1242c46959e admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:41.358268 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8ee51-c1a2-43af-aace-c1242c46959e admin admin] PATH_INFO: `/v3/projects/e746f8512d1b48c08bbe75d39a78a626/users/b062974af69d408a8239ce5e8033b56c/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:41.375720 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8ee51-c1a2-43af-aace-c1242c46959e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e746f8512d1b48c08bbe75d39a78a626, user_id=b062974af69d408a8239ce5e8033b56c, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:41.379301 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8ee51-c1a2-43af-aace-c1242c46959e admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:41.396414 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1313/2639] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:30:41 2022] PUT /identity/v3/projects/e746f8512d1b48c08bbe75d39a78a626/users/b062974af69d408a8239ce5e8033b56c/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:41.400466 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84421f85-64b2-4ec5-9b06-04387cf397c0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:41.415910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84421f85-64b2-4ec5-9b06-04387cf397c0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:41.485462 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1e474-e563-44f1-a20a-29690927ddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:41.486141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1e474-e563-44f1-a20a-29690927ddc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:41.486426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1e474-e563-44f1-a20a-29690927ddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:41.486735 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1e474-e563-44f1-a20a-29690927ddc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:41.487485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1e474-e563-44f1-a20a-29690927ddc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:41.489267 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1e474-e563-44f1-a20a-29690927ddc8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:41.499619 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1327/2640] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:41.504599 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8ee51-c1a2-43af-aace-c1242c46959e admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:41.516158 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8ee51-c1a2-43af-aace-c1242c46959e admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:41.522194 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b3594-3de5-4719-8033-1e819cc6358a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:41.523117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b3594-3de5-4719-8033-1e819cc6358a admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:41.523398 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b3594-3de5-4719-8033-1e819cc6358a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:41.523674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b3594-3de5-4719-8033-1e819cc6358a admin admin] PATH_INFO: `/v3/projects/e746f8512d1b48c08bbe75d39a78a626/users/b062974af69d408a8239ce5e8033b56c/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:41.527492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b3594-3de5-4719-8033-1e819cc6358a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e746f8512d1b48c08bbe75d39a78a626, user_id=b062974af69d408a8239ce5e8033b56c, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:41.530956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b3594-3de5-4719-8033-1e819cc6358a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:41.548283 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1314/2641] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:30:41 2022] PUT /identity/v3/projects/e746f8512d1b48c08bbe75d39a78a626/users/b062974af69d408a8239ce5e8033b56c/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:41.561295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbb2b5-85eb-44e4-9560-ea6db2fcbf9d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:41.561590 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbb2b5-85eb-44e4-9560-ea6db2fcbf9d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:41.561930 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbb2b5-85eb-44e4-9560-ea6db2fcbf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:41.578663 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:41.600558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-96cbb2b5-85eb-44e4-9560-ea6db2fcbf9d None None] MFA Rules not processed for user `b062974af69d408a8239ce5e8033b56c`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:41.602288 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-96cbb2b5-85eb-44e4-9560-ea6db2fcbf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:41.674868 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1328/2642] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:41 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:41.687865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b3594-3de5-4719-8033-1e819cc6358a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:41.689557 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-be7b3594-3de5-4719-8033-1e819cc6358a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:41.749232 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b3594-3de5-4719-8033-1e819cc6358a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:41.752813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb6cbd-d99a-4753-9883-68b08a081535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:41.753526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb6cbd-d99a-4753-9883-68b08a081535 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:41.753811 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb6cbd-d99a-4753-9883-68b08a081535 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:41.754090 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb6cbd-d99a-4753-9883-68b08a081535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:41.764015 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb6cbd-d99a-4753-9883-68b08a081535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:41.765648 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb6cbd-d99a-4753-9883-68b08a081535 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:41.776603 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1315/2643] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:41 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:42.266778 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbb2b5-85eb-44e4-9560-ea6db2fcbf9d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:42.345701 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbb2b5-85eb-44e4-9560-ea6db2fcbf9d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:42.352610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc4a6d-8812-417e-ae5f-1328b6ba7e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:42.354623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc4a6d-8812-417e-ae5f-1328b6ba7e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:42.354623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc4a6d-8812-417e-ae5f-1328b6ba7e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:42.354623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc4a6d-8812-417e-ae5f-1328b6ba7e39 admin admin] PATH_INFO: `/v3/users/a27b8f3c753e46f0bba8642ef8bc7413` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:42.355558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc4a6d-8812-417e-ae5f-1328b6ba7e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a27b8f3c753e46f0bba8642ef8bc7413)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:42.357570 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc4a6d-8812-417e-ae5f-1328b6ba7e39 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:42.414470 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c3fc4a6d-8812-417e-ae5f-1328b6ba7e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a27b8f3c753e46f0bba8642ef8bc7413'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:42.415133 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c3fc4a6d-8812-417e-ae5f-1328b6ba7e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a27b8f3c753e46f0bba8642ef8bc7413'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:42.415780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c3fc4a6d-8812-417e-ae5f-1328b6ba7e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a27b8f3c753e46f0bba8642ef8bc7413'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:42.423048 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c3fc4a6d-8812-417e-ae5f-1328b6ba7e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a27b8f3c753e46f0bba8642ef8bc7413'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:42.432325 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c3fc4a6d-8812-417e-ae5f-1328b6ba7e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a27b8f3c753e46f0bba8642ef8bc7413'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:42.451604 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1329/2644] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:30:42 2022] DELETE /identity/v3/users/a27b8f3c753e46f0bba8642ef8bc7413 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:42.456339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85038ea1-8d99-425b-8159-e91ca283635a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:42.457354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85038ea1-8d99-425b-8159-e91ca283635a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:42.457477 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85038ea1-8d99-425b-8159-e91ca283635a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:42.477677 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-85038ea1-8d99-425b-8159-e91ca283635a None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:42.478894 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-85038ea1-8d99-425b-8159-e91ca283635a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:42.529930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:42.545133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1316/2645] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:42.555260 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc4a6d-8812-417e-ae5f-1328b6ba7e39 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:42.556743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c3fc4a6d-8812-417e-ae5f-1328b6ba7e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:42.572089 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:42.622298 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc4a6d-8812-417e-ae5f-1328b6ba7e39 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:42.626047 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef33e5-a83c-4b62-921d-a09b522c7e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:42.626702 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef33e5-a83c-4b62-921d-a09b522c7e33 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:42.626989 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef33e5-a83c-4b62-921d-a09b522c7e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:42.627270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef33e5-a83c-4b62-921d-a09b522c7e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:42.642780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef33e5-a83c-4b62-921d-a09b522c7e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:42.645026 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef33e5-a83c-4b62-921d-a09b522c7e33 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:42.656344 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1330/2646] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:42.958632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85038ea1-8d99-425b-8159-e91ca283635a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:42.960216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-85038ea1-8d99-425b-8159-e91ca283635a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:42.978529 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85038ea1-8d99-425b-8159-e91ca283635a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:42.984101 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9bccc-8f44-499c-980a-b407dd0bb011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:42.985453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9bccc-8f44-499c-980a-b407dd0bb011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:42.985746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9bccc-8f44-499c-980a-b407dd0bb011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:42.986032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9bccc-8f44-499c-980a-b407dd0bb011 admin admin] PATH_INFO: `/v3/projects/5f0b0ed50a524700b516854529062d27` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:42.989669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9bccc-8f44-499c-980a-b407dd0bb011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0b0ed50a524700b516854529062d27)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:42.991899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9bccc-8f44-499c-980a-b407dd0bb011 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:43.043469 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bed9bccc-8f44-499c-980a-b407dd0bb011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0b0ed50a524700b516854529062d27', 'request_id': 'req-bed9bccc-8f44-499c-980a-b407dd0bb011'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:43.051510 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bed9bccc-8f44-499c-980a-b407dd0bb011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0b0ed50a524700b516854529062d27', 'request_id': 'req-bed9bccc-8f44-499c-980a-b407dd0bb011'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:43.058163 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bed9bccc-8f44-499c-980a-b407dd0bb011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0b0ed50a524700b516854529062d27', 'request_id': 'req-bed9bccc-8f44-499c-980a-b407dd0bb011'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:43.068915 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bed9bccc-8f44-499c-980a-b407dd0bb011 admin admin] The token cache is being invalidate because project 5f0b0ed50a524700b516854529062d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:30:43.069206 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bed9bccc-8f44-499c-980a-b407dd0bb011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:43.069950 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bed9bccc-8f44-499c-980a-b407dd0bb011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:43.071899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1317/2647] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:30:42 2022] DELETE /identity/v3/projects/5f0b0ed50a524700b516854529062d27 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:43.076275 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef33e5-a83c-4b62-921d-a09b522c7e33 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:43.087362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef33e5-a83c-4b62-921d-a09b522c7e33 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:43.154140 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3d27a-8a6d-4879-92d9-0e5aba5b826a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:43.155040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3d27a-8a6d-4879-92d9-0e5aba5b826a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:43.155316 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3d27a-8a6d-4879-92d9-0e5aba5b826a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:43.155595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3d27a-8a6d-4879-92d9-0e5aba5b826a admin admin] PATH_INFO: `/v3/users/b062974af69d408a8239ce5e8033b56c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:43.156842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3d27a-8a6d-4879-92d9-0e5aba5b826a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b062974af69d408a8239ce5e8033b56c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:43.158816 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3d27a-8a6d-4879-92d9-0e5aba5b826a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:43.211083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-21d3d27a-8a6d-4879-92d9-0e5aba5b826a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b062974af69d408a8239ce5e8033b56c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:43.211759 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-21d3d27a-8a6d-4879-92d9-0e5aba5b826a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b062974af69d408a8239ce5e8033b56c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:43.212554 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-21d3d27a-8a6d-4879-92d9-0e5aba5b826a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b062974af69d408a8239ce5e8033b56c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:43.219753 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-21d3d27a-8a6d-4879-92d9-0e5aba5b826a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b062974af69d408a8239ce5e8033b56c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:43.228728 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-21d3d27a-8a6d-4879-92d9-0e5aba5b826a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b062974af69d408a8239ce5e8033b56c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:43.251042 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1331/2648] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:30:43 2022] DELETE /identity/v3/users/b062974af69d408a8239ce5e8033b56c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:30:43.574484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9bccc-8f44-499c-980a-b407dd0bb011 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:43.576541 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bed9bccc-8f44-499c-980a-b407dd0bb011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:43.609111 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9bccc-8f44-499c-980a-b407dd0bb011 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:43.689107 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acf482-b9bd-499e-8943-cf4d733e1fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:43.689993 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acf482-b9bd-499e-8943-cf4d733e1fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:43.690276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acf482-b9bd-499e-8943-cf4d733e1fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:43.690549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acf482-b9bd-499e-8943-cf4d733e1fc2 admin admin] PATH_INFO: `/v3/projects/e746f8512d1b48c08bbe75d39a78a626` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:43.692403 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acf482-b9bd-499e-8943-cf4d733e1fc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e746f8512d1b48c08bbe75d39a78a626)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:43.694303 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acf482-b9bd-499e-8943-cf4d733e1fc2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:43.750284 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d6acf482-b9bd-499e-8943-cf4d733e1fc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e746f8512d1b48c08bbe75d39a78a626', 'request_id': 'req-d6acf482-b9bd-499e-8943-cf4d733e1fc2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:43.759692 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d6acf482-b9bd-499e-8943-cf4d733e1fc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e746f8512d1b48c08bbe75d39a78a626', 'request_id': 'req-d6acf482-b9bd-499e-8943-cf4d733e1fc2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:43.766669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d6acf482-b9bd-499e-8943-cf4d733e1fc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e746f8512d1b48c08bbe75d39a78a626', 'request_id': 'req-d6acf482-b9bd-499e-8943-cf4d733e1fc2'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:43.780198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d6acf482-b9bd-499e-8943-cf4d733e1fc2 admin admin] The token cache is being invalidate because project e746f8512d1b48c08bbe75d39a78a626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:30:43.780422 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d6acf482-b9bd-499e-8943-cf4d733e1fc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:43.781222 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d6acf482-b9bd-499e-8943-cf4d733e1fc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:43.783011 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1318/2649] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:30:43 2022] DELETE /identity/v3/projects/e746f8512d1b48c08bbe75d39a78a626 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:30:43.788485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a29969-d0c5-4548-9f72-c9b9a797bfea None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:43.789049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a29969-d0c5-4548-9f72-c9b9a797bfea None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:43.789320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a29969-d0c5-4548-9f72-c9b9a797bfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:43.810556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-84a29969-d0c5-4548-9f72-c9b9a797bfea None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:43.811841 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-84a29969-d0c5-4548-9f72-c9b9a797bfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:43.843916 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:43.879482 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1332/2650] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:43.887300 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c113d8-c469-4833-9295-affb7f23b089 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:43.887593 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c113d8-c469-4833-9295-affb7f23b089 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:43.887883 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c113d8-c469-4833-9295-affb7f23b089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:43.903897 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:43.911587 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-04c113d8-c469-4833-9295-affb7f23b089 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:43.913493 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-04c113d8-c469-4833-9295-affb7f23b089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:43.922289 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1319/2651] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:43.927105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a29969-d0c5-4548-9f72-c9b9a797bfea None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:43.937201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a29969-d0c5-4548-9f72-c9b9a797bfea None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:43.942746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b2663-52d6-49af-953a-799e02faa13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:43.943417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b2663-52d6-49af-953a-799e02faa13f admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:43.943705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b2663-52d6-49af-953a-799e02faa13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:43.943986 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b2663-52d6-49af-953a-799e02faa13f admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:43.944819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b2663-52d6-49af-953a-799e02faa13f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:30:43.945149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b2663-52d6-49af-953a-799e02faa13f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:43.946731 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b2663-52d6-49af-953a-799e02faa13f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:43.958962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1333/2652] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:30:43.963358 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c113d8-c469-4833-9295-affb7f23b089 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:43.973303 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c113d8-c469-4833-9295-affb7f23b089 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:43.978467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f527f-5f46-42b9-afca-ecb0c5f692f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:43.979350 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f527f-5f46-42b9-afca-ecb0c5f692f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:43.979872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f527f-5f46-42b9-afca-ecb0c5f692f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:43.980348 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f527f-5f46-42b9-afca-ecb0c5f692f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:43.981132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f527f-5f46-42b9-afca-ecb0c5f692f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:43.983170 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f527f-5f46-42b9-afca-ecb0c5f692f1 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:44.011399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1320/2653] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:30:43 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:44.015712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b2663-52d6-49af-953a-799e02faa13f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:44.027514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b2663-52d6-49af-953a-799e02faa13f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:44.091601 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14b041-7174-4f2f-9f1e-6b6c2f6f95f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:44.092418 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14b041-7174-4f2f-9f1e-6b6c2f6f95f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:44.092726 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14b041-7174-4f2f-9f1e-6b6c2f6f95f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:44.093026 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14b041-7174-4f2f-9f1e-6b6c2f6f95f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:44.093756 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14b041-7174-4f2f-9f1e-6b6c2f6f95f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:44.095771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14b041-7174-4f2f-9f1e-6b6c2f6f95f5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:44.126282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1334/2654] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:30:44 2022] POST /identity/v3/users => generated 282 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:44.131067 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f527f-5f46-42b9-afca-ecb0c5f692f1 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:44.141626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f527f-5f46-42b9-afca-ecb0c5f692f1 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:44.147509 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4b48a-7d74-4e63-8fd9-68490d811f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:44.148224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4b48a-7d74-4e63-8fd9-68490d811f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:44.148531 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4b48a-7d74-4e63-8fd9-68490d811f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:44.148809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4b48a-7d74-4e63-8fd9-68490d811f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:44.149539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4b48a-7d74-4e63-8fd9-68490d811f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:44.151190 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4b48a-7d74-4e63-8fd9-68490d811f73 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:44.166062 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1321/2655] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:44.167272 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14b041-7174-4f2f-9f1e-6b6c2f6f95f5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:44.179320 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14b041-7174-4f2f-9f1e-6b6c2f6f95f5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:44.184603 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4dcdd-f1dd-479c-9a8f-3e64f18a3410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:44.185282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4dcdd-f1dd-479c-9a8f-3e64f18a3410 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:44.185568 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4dcdd-f1dd-479c-9a8f-3e64f18a3410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:44.185843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4dcdd-f1dd-479c-9a8f-3e64f18a3410 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:44.186671 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4dcdd-f1dd-479c-9a8f-3e64f18a3410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:44.188450 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4dcdd-f1dd-479c-9a8f-3e64f18a3410 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:44.200082 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1335/2656] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:30:44.204677 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4b48a-7d74-4e63-8fd9-68490d811f73 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:44.215740 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4b48a-7d74-4e63-8fd9-68490d811f73 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:44.220524 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa984f0-7a59-4ae8-8136-41e463bc00eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:44.221408 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa984f0-7a59-4ae8-8136-41e463bc00eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:44.221681 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa984f0-7a59-4ae8-8136-41e463bc00eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:44.221948 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa984f0-7a59-4ae8-8136-41e463bc00eb admin admin] PATH_INFO: `/v3/projects/04b263991bd14be7b758fa65ba7b1319/users/cd1ea37ea8a54609a69bc3ed341b94d1/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:44.241286 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa984f0-7a59-4ae8-8136-41e463bc00eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b263991bd14be7b758fa65ba7b1319, user_id=cd1ea37ea8a54609a69bc3ed341b94d1, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:44.244063 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa984f0-7a59-4ae8-8136-41e463bc00eb admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:44.261352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1322/2657] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:30:44 2022] PUT /identity/v3/projects/04b263991bd14be7b758fa65ba7b1319/users/cd1ea37ea8a54609a69bc3ed341b94d1/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:30:44.272613 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c5a5e-de63-49e1-80d9-4e934d2d6dbe None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:44.272910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c5a5e-de63-49e1-80d9-4e934d2d6dbe None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:44.273215 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c5a5e-de63-49e1-80d9-4e934d2d6dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:44.303127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-fc6c5a5e-de63-49e1-80d9-4e934d2d6dbe None None] MFA Rules not processed for user `cd1ea37ea8a54609a69bc3ed341b94d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:44.304380 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fc6c5a5e-de63-49e1-80d9-4e934d2d6dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:44.371492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1336/2658] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:44.375755 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa984f0-7a59-4ae8-8136-41e463bc00eb admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:44.446380 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa984f0-7a59-4ae8-8136-41e463bc00eb admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:44.451130 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d2534-4293-498a-995f-135a74c1ade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:44.451788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d2534-4293-498a-995f-135a74c1ade7 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:44.452070 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d2534-4293-498a-995f-135a74c1ade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:44.452451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d2534-4293-498a-995f-135a74c1ade7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:44.453144 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d2534-4293-498a-995f-135a74c1ade7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:44.455077 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d2534-4293-498a-995f-135a74c1ade7 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:44.488418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1323/2659] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:30:44 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:30:44.492688 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c5a5e-de63-49e1-80d9-4e934d2d6dbe None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:44.504497 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c5a5e-de63-49e1-80d9-4e934d2d6dbe None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:44.532845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:44.566552 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391b2a9-9c87-439d-937b-580ed7e3cda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:44.567284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391b2a9-9c87-439d-937b-580ed7e3cda5 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:44.567574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391b2a9-9c87-439d-937b-580ed7e3cda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:44.567857 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391b2a9-9c87-439d-937b-580ed7e3cda5 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:44.568610 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391b2a9-9c87-439d-937b-580ed7e3cda5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:44.570623 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391b2a9-9c87-439d-937b-580ed7e3cda5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:44.595699 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1337/2660] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:30:44 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:44.604013 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d2534-4293-498a-995f-135a74c1ade7 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:44.615473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d2534-4293-498a-995f-135a74c1ade7 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:44.620791 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349b846-340e-492c-bded-aa021fc8fc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:44.621466 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349b846-340e-492c-bded-aa021fc8fc37 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:44.621752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349b846-340e-492c-bded-aa021fc8fc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:44.622030 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349b846-340e-492c-bded-aa021fc8fc37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:44.622762 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349b846-340e-492c-bded-aa021fc8fc37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:44.624524 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349b846-340e-492c-bded-aa021fc8fc37 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:44.636708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1324/2661] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:44.641362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391b2a9-9c87-439d-937b-580ed7e3cda5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:44.654133 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391b2a9-9c87-439d-937b-580ed7e3cda5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:44.659579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d1f70-c343-4199-856a-99a4c9d3dd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:44.660864 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d1f70-c343-4199-856a-99a4c9d3dd7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:44.661218 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d1f70-c343-4199-856a-99a4c9d3dd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:44.661502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d1f70-c343-4199-856a-99a4c9d3dd7f admin admin] PATH_INFO: `/v3/projects/b25881afb08d4aa68ad09f1ff8836bf9/users/ea38c5fdc3b4422a82ad2b38363794ba/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:44.679052 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d1f70-c343-4199-856a-99a4c9d3dd7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25881afb08d4aa68ad09f1ff8836bf9, user_id=ea38c5fdc3b4422a82ad2b38363794ba, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:44.681910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d1f70-c343-4199-856a-99a4c9d3dd7f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:44.699143 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1338/2662] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:30:44 2022] PUT /identity/v3/projects/b25881afb08d4aa68ad09f1ff8836bf9/users/ea38c5fdc3b4422a82ad2b38363794ba/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:44.703229 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349b846-340e-492c-bded-aa021fc8fc37 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:44.716368 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349b846-340e-492c-bded-aa021fc8fc37 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:44.793131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e9541-a5ba-4ac3-baa2-5d8e14c02074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:44.793822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e9541-a5ba-4ac3-baa2-5d8e14c02074 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:44.794104 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e9541-a5ba-4ac3-baa2-5d8e14c02074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:44.794405 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e9541-a5ba-4ac3-baa2-5d8e14c02074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:44.795130 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e9541-a5ba-4ac3-baa2-5d8e14c02074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:44.797365 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e9541-a5ba-4ac3-baa2-5d8e14c02074 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:44.809005 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1325/2663] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:44.813553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d1f70-c343-4199-856a-99a4c9d3dd7f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:44.826301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d1f70-c343-4199-856a-99a4c9d3dd7f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:44.832310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd7adf-6784-487e-beb5-6ca4e834bbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:44.833369 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd7adf-6784-487e-beb5-6ca4e834bbdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:44.833785 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd7adf-6784-487e-beb5-6ca4e834bbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:44.834131 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd7adf-6784-487e-beb5-6ca4e834bbdc admin admin] PATH_INFO: `/v3/projects/b25881afb08d4aa68ad09f1ff8836bf9/users/ea38c5fdc3b4422a82ad2b38363794ba/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:44.836315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd7adf-6784-487e-beb5-6ca4e834bbdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25881afb08d4aa68ad09f1ff8836bf9, user_id=ea38c5fdc3b4422a82ad2b38363794ba, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:44.839046 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd7adf-6784-487e-beb5-6ca4e834bbdc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:44.854787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1339/2664] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:30:44 2022] PUT /identity/v3/projects/b25881afb08d4aa68ad09f1ff8836bf9/users/ea38c5fdc3b4422a82ad2b38363794ba/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:30:44.866676 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f76fa-2abf-4a7e-9e27-f4c4100af990 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:44.867221 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f76fa-2abf-4a7e-9e27-f4c4100af990 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:44.867601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f76fa-2abf-4a7e-9e27-f4c4100af990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:44.898733 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:44.902205 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-f36f76fa-2abf-4a7e-9e27-f4c4100af990 None None] MFA Rules not processed for user `ea38c5fdc3b4422a82ad2b38363794ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:44.904934 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f36f76fa-2abf-4a7e-9e27-f4c4100af990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:44.994568 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1326/2665] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:45.006540 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd7adf-6784-487e-beb5-6ca4e834bbdc admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:45.008397 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bfcd7adf-6784-487e-beb5-6ca4e834bbdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:45.078987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd7adf-6784-487e-beb5-6ca4e834bbdc admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:45.083700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2064278-ce01-4856-9510-56e313551ee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:45.084537 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2064278-ce01-4856-9510-56e313551ee8 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:45.084863 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2064278-ce01-4856-9510-56e313551ee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:45.085159 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2064278-ce01-4856-9510-56e313551ee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:45.097448 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2064278-ce01-4856-9510-56e313551ee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:45.098939 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2064278-ce01-4856-9510-56e313551ee8 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:45.118460 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1340/2666] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:45.222943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f76fa-2abf-4a7e-9e27-f4c4100af990 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:45.234611 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f76fa-2abf-4a7e-9e27-f4c4100af990 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:45.239399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a692cf-0eee-49c8-ba89-5c13fd5dcb14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:45.240066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a692cf-0eee-49c8-ba89-5c13fd5dcb14 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:45.240389 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a692cf-0eee-49c8-ba89-5c13fd5dcb14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:45.240674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a692cf-0eee-49c8-ba89-5c13fd5dcb14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:45.330201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a692cf-0eee-49c8-ba89-5c13fd5dcb14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:45.332744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a692cf-0eee-49c8-ba89-5c13fd5dcb14 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:45.348309 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1327/2667] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:52.450459 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2064278-ce01-4856-9510-56e313551ee8 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:52.512946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2064278-ce01-4856-9510-56e313551ee8 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:52.517381 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c7995-56da-4207-b0fc-b4c24e6aa8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:52.518253 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c7995-56da-4207-b0fc-b4c24e6aa8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:52.518530 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c7995-56da-4207-b0fc-b4c24e6aa8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:52.519432 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c7995-56da-4207-b0fc-b4c24e6aa8ab admin admin] PATH_INFO: `/v3/users/cd1ea37ea8a54609a69bc3ed341b94d1` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:52.520660 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c7995-56da-4207-b0fc-b4c24e6aa8ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd1ea37ea8a54609a69bc3ed341b94d1)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:52.522550 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c7995-56da-4207-b0fc-b4c24e6aa8ab admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:52.551517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:52.573840 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0d0c7995-56da-4207-b0fc-b4c24e6aa8ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd1ea37ea8a54609a69bc3ed341b94d1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:52.574492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0d0c7995-56da-4207-b0fc-b4c24e6aa8ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd1ea37ea8a54609a69bc3ed341b94d1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:52.575086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0d0c7995-56da-4207-b0fc-b4c24e6aa8ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd1ea37ea8a54609a69bc3ed341b94d1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:52.584070 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0d0c7995-56da-4207-b0fc-b4c24e6aa8ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd1ea37ea8a54609a69bc3ed341b94d1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:52.592033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0d0c7995-56da-4207-b0fc-b4c24e6aa8ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd1ea37ea8a54609a69bc3ed341b94d1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:52.609527 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1341/2668] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:30:52 2022] DELETE /identity/v3/users/cd1ea37ea8a54609a69bc3ed341b94d1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:52.614198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a458dec-ceae-4117-a373-f1b937860234 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:52.614700 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a458dec-ceae-4117-a373-f1b937860234 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:52.614818 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a458dec-ceae-4117-a373-f1b937860234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:52.635235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-9a458dec-ceae-4117-a373-f1b937860234 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:52.636472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9a458dec-ceae-4117-a373-f1b937860234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:52.702735 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1328/2669] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:52.712890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c7995-56da-4207-b0fc-b4c24e6aa8ab admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:52.714515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0d0c7995-56da-4207-b0fc-b4c24e6aa8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:52.778743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c7995-56da-4207-b0fc-b4c24e6aa8ab admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:52.782420 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bb34d-a09f-4020-a88f-c38304096cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:52.783074 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bb34d-a09f-4020-a88f-c38304096cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:52.783362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bb34d-a09f-4020-a88f-c38304096cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:52.783642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bb34d-a09f-4020-a88f-c38304096cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:52.793033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bb34d-a09f-4020-a88f-c38304096cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:52.794463 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bb34d-a09f-4020-a88f-c38304096cc2 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:52.804629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1342/2670] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:53.091823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a458dec-ceae-4117-a373-f1b937860234 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:53.093327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9a458dec-ceae-4117-a373-f1b937860234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:53.110009 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a458dec-ceae-4117-a373-f1b937860234 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:53.116087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd136ae-14f0-43e9-9189-a97d5872254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:53.117319 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd136ae-14f0-43e9-9189-a97d5872254d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:53.117319 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd136ae-14f0-43e9-9189-a97d5872254d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:53.117807 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd136ae-14f0-43e9-9189-a97d5872254d admin admin] PATH_INFO: `/v3/projects/04b263991bd14be7b758fa65ba7b1319` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:53.118850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd136ae-14f0-43e9-9189-a97d5872254d admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b263991bd14be7b758fa65ba7b1319)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:53.120812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd136ae-14f0-43e9-9189-a97d5872254d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:53.160548 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:53.173738 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1fd136ae-14f0-43e9-9189-a97d5872254d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b263991bd14be7b758fa65ba7b1319', 'request_id': 'req-1fd136ae-14f0-43e9-9189-a97d5872254d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:53.182491 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1fd136ae-14f0-43e9-9189-a97d5872254d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b263991bd14be7b758fa65ba7b1319', 'request_id': 'req-1fd136ae-14f0-43e9-9189-a97d5872254d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:53.188930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1fd136ae-14f0-43e9-9189-a97d5872254d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b263991bd14be7b758fa65ba7b1319', 'request_id': 'req-1fd136ae-14f0-43e9-9189-a97d5872254d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:53.199541 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1fd136ae-14f0-43e9-9189-a97d5872254d admin admin] The token cache is being invalidate because project 04b263991bd14be7b758fa65ba7b1319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:30:53.199834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1fd136ae-14f0-43e9-9189-a97d5872254d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:53.200492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1fd136ae-14f0-43e9-9189-a97d5872254d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:53.202035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1329/2671] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:30:53 2022] DELETE /identity/v3/projects/04b263991bd14be7b758fa65ba7b1319 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:53.206051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bb34d-a09f-4020-a88f-c38304096cc2 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:53.216194 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bb34d-a09f-4020-a88f-c38304096cc2 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:53.273596 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25634f18-0e45-45ba-8848-ad8bb2d1a6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:53.274472 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25634f18-0e45-45ba-8848-ad8bb2d1a6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:53.274755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25634f18-0e45-45ba-8848-ad8bb2d1a6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:53.275033 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25634f18-0e45-45ba-8848-ad8bb2d1a6ee admin admin] PATH_INFO: `/v3/users/ea38c5fdc3b4422a82ad2b38363794ba` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:53.276203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25634f18-0e45-45ba-8848-ad8bb2d1a6ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea38c5fdc3b4422a82ad2b38363794ba)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:53.278127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25634f18-0e45-45ba-8848-ad8bb2d1a6ee admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:53.325252 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-25634f18-0e45-45ba-8848-ad8bb2d1a6ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea38c5fdc3b4422a82ad2b38363794ba'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:53.325833 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-25634f18-0e45-45ba-8848-ad8bb2d1a6ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea38c5fdc3b4422a82ad2b38363794ba'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:53.326436 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-25634f18-0e45-45ba-8848-ad8bb2d1a6ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea38c5fdc3b4422a82ad2b38363794ba'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:53.327693 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:53.336534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-25634f18-0e45-45ba-8848-ad8bb2d1a6ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea38c5fdc3b4422a82ad2b38363794ba'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:53.345394 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-25634f18-0e45-45ba-8848-ad8bb2d1a6ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea38c5fdc3b4422a82ad2b38363794ba'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:53.363784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1343/2672] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:30:53 2022] DELETE /identity/v3/users/ea38c5fdc3b4422a82ad2b38363794ba => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:53.649076 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd136ae-14f0-43e9-9189-a97d5872254d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:53.650901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1fd136ae-14f0-43e9-9189-a97d5872254d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:53.666386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd136ae-14f0-43e9-9189-a97d5872254d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:53.728542 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dd238-81e3-471b-bf98-b910a4269e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:53.729412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dd238-81e3-471b-bf98-b910a4269e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:53.729697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dd238-81e3-471b-bf98-b910a4269e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:53.730001 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dd238-81e3-471b-bf98-b910a4269e4b admin admin] PATH_INFO: `/v3/projects/b25881afb08d4aa68ad09f1ff8836bf9` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:53.731183 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dd238-81e3-471b-bf98-b910a4269e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25881afb08d4aa68ad09f1ff8836bf9)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:53.733205 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dd238-81e3-471b-bf98-b910a4269e4b admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:53.781409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-014dd238-81e3-471b-bf98-b910a4269e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25881afb08d4aa68ad09f1ff8836bf9', 'request_id': 'req-014dd238-81e3-471b-bf98-b910a4269e4b'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:53.791680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-014dd238-81e3-471b-bf98-b910a4269e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25881afb08d4aa68ad09f1ff8836bf9', 'request_id': 'req-014dd238-81e3-471b-bf98-b910a4269e4b'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:53.798947 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-014dd238-81e3-471b-bf98-b910a4269e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25881afb08d4aa68ad09f1ff8836bf9', 'request_id': 'req-014dd238-81e3-471b-bf98-b910a4269e4b'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:53.817404 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-014dd238-81e3-471b-bf98-b910a4269e4b admin admin] The token cache is being invalidate because project b25881afb08d4aa68ad09f1ff8836bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:30:53.817780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-014dd238-81e3-471b-bf98-b910a4269e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:53.818442 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-014dd238-81e3-471b-bf98-b910a4269e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:53.820098 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1330/2673] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:30:53 2022] DELETE /identity/v3/projects/b25881afb08d4aa68ad09f1ff8836bf9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:53.825086 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fdc96-aa46-49e3-90ee-d39efcceda78 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:53.825612 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fdc96-aa46-49e3-90ee-d39efcceda78 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:53.825711 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fdc96-aa46-49e3-90ee-d39efcceda78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:53.848282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c62fdc96-aa46-49e3-90ee-d39efcceda78 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:53.849418 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c62fdc96-aa46-49e3-90ee-d39efcceda78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:53.912038 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1344/2674] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:53.920226 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d689b0a-307c-4c3d-a576-1d3b1ee89265 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:53.920644 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d689b0a-307c-4c3d-a576-1d3b1ee89265 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:53.921020 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d689b0a-307c-4c3d-a576-1d3b1ee89265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:53.942471 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-2d689b0a-307c-4c3d-a576-1d3b1ee89265 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:53.943697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2d689b0a-307c-4c3d-a576-1d3b1ee89265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:53.951766 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1331/2675] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:53.956354 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fdc96-aa46-49e3-90ee-d39efcceda78 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:53.965971 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fdc96-aa46-49e3-90ee-d39efcceda78 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:53.970653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c67ab1-5b28-44ac-88af-9db8a51254d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:53.971330 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c67ab1-5b28-44ac-88af-9db8a51254d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:53.971606 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c67ab1-5b28-44ac-88af-9db8a51254d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:53.972455 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c67ab1-5b28-44ac-88af-9db8a51254d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:53.973165 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c67ab1-5b28-44ac-88af-9db8a51254d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:30:53.973465 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c67ab1-5b28-44ac-88af-9db8a51254d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:53.975040 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c67ab1-5b28-44ac-88af-9db8a51254d4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:53.988933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1345/2676] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:30:53.993168 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d689b0a-307c-4c3d-a576-1d3b1ee89265 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:54.002436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d689b0a-307c-4c3d-a576-1d3b1ee89265 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:54.007073 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31a962-4698-4624-b1d2-294a3c636192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:54.007722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31a962-4698-4624-b1d2-294a3c636192 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:54.008002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31a962-4698-4624-b1d2-294a3c636192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:54.008302 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31a962-4698-4624-b1d2-294a3c636192 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:54.008983 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31a962-4698-4624-b1d2-294a3c636192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:54.010882 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31a962-4698-4624-b1d2-294a3c636192 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:54.039254 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1332/2677] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:30:53 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:54.043455 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c67ab1-5b28-44ac-88af-9db8a51254d4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:54.054080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c67ab1-5b28-44ac-88af-9db8a51254d4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:54.120602 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc730f-40ff-4297-a4d6-8316ad04dc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:54.121187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc730f-40ff-4297-a4d6-8316ad04dc69 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:54.121476 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc730f-40ff-4297-a4d6-8316ad04dc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:54.121794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc730f-40ff-4297-a4d6-8316ad04dc69 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:54.122450 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc730f-40ff-4297-a4d6-8316ad04dc69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:54.124443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc730f-40ff-4297-a4d6-8316ad04dc69 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:54.151395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1346/2678] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:30:54 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:54.155872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31a962-4698-4624-b1d2-294a3c636192 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:54.167325 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31a962-4698-4624-b1d2-294a3c636192 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:54.172088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47a46f-9d97-41bf-8fd9-9c7d1355b905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:54.172803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47a46f-9d97-41bf-8fd9-9c7d1355b905 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:54.173180 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47a46f-9d97-41bf-8fd9-9c7d1355b905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:54.173358 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47a46f-9d97-41bf-8fd9-9c7d1355b905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:54.174205 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47a46f-9d97-41bf-8fd9-9c7d1355b905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:54.176962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47a46f-9d97-41bf-8fd9-9c7d1355b905 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:54.188108 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1333/2679] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:54.192447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc730f-40ff-4297-a4d6-8316ad04dc69 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:54.202635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc730f-40ff-4297-a4d6-8316ad04dc69 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:54.207280 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaed97c-bd08-4918-b82f-8e4daa16abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:54.207947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaed97c-bd08-4918-b82f-8e4daa16abd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:54.208233 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaed97c-bd08-4918-b82f-8e4daa16abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:54.208542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaed97c-bd08-4918-b82f-8e4daa16abd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:54.209270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaed97c-bd08-4918-b82f-8e4daa16abd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:54.210854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaed97c-bd08-4918-b82f-8e4daa16abd8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:54.221511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1347/2680] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:54.226320 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47a46f-9d97-41bf-8fd9-9c7d1355b905 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:54.236512 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47a46f-9d97-41bf-8fd9-9c7d1355b905 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:54.241878 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a631a-47d1-45a6-9218-414807b85bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:54.242876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a631a-47d1-45a6-9218-414807b85bce admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:54.243207 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a631a-47d1-45a6-9218-414807b85bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:54.243489 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a631a-47d1-45a6-9218-414807b85bce admin admin] PATH_INFO: `/v3/projects/2edbedca83aa4147b72053d696eb6535/users/d9cb7f1ba24d45b88bec5db3211d0c39/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:54.253366 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:54.261839 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a631a-47d1-45a6-9218-414807b85bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=2edbedca83aa4147b72053d696eb6535, user_id=d9cb7f1ba24d45b88bec5db3211d0c39, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:54.265132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a631a-47d1-45a6-9218-414807b85bce admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:54.278299 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1334/2681] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:30:54 2022] PUT /identity/v3/projects/2edbedca83aa4147b72053d696eb6535/users/d9cb7f1ba24d45b88bec5db3211d0c39/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:54.290956 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ad363-4c55-46f2-87c6-57309dc50aa6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:54.291285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ad363-4c55-46f2-87c6-57309dc50aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:54.291571 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ad363-4c55-46f2-87c6-57309dc50aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:54.318953 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-261ad363-4c55-46f2-87c6-57309dc50aa6 None None] MFA Rules not processed for user `d9cb7f1ba24d45b88bec5db3211d0c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:54.320417 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-261ad363-4c55-46f2-87c6-57309dc50aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:54.339966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:54.388753 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1348/2682] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:54.393276 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a631a-47d1-45a6-9218-414807b85bce admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:54.458418 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a631a-47d1-45a6-9218-414807b85bce admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:54.463631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d778d1-0ffb-4194-8dfd-6c72dea6e57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:54.464334 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d778d1-0ffb-4194-8dfd-6c72dea6e57b admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:54.464617 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d778d1-0ffb-4194-8dfd-6c72dea6e57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:54.464902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d778d1-0ffb-4194-8dfd-6c72dea6e57b admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:54.465670 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d778d1-0ffb-4194-8dfd-6c72dea6e57b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:54.467766 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d778d1-0ffb-4194-8dfd-6c72dea6e57b admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:54.498275 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1335/2683] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:30:54 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:54.502391 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ad363-4c55-46f2-87c6-57309dc50aa6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:54.513505 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ad363-4c55-46f2-87c6-57309dc50aa6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:54.570340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce40aa-1ee5-4487-b13f-efbcb460c66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:54.571019 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce40aa-1ee5-4487-b13f-efbcb460c66d admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:54.571304 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce40aa-1ee5-4487-b13f-efbcb460c66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:54.571583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce40aa-1ee5-4487-b13f-efbcb460c66d admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:54.572302 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce40aa-1ee5-4487-b13f-efbcb460c66d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:54.574228 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce40aa-1ee5-4487-b13f-efbcb460c66d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:54.599373 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1349/2684] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:30:54 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:54.601442 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d778d1-0ffb-4194-8dfd-6c72dea6e57b admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:54.612193 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d778d1-0ffb-4194-8dfd-6c72dea6e57b admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:54.617009 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a3422-a2ef-45c1-af52-4e16fa7ed208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:54.617676 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a3422-a2ef-45c1-af52-4e16fa7ed208 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:54.617961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a3422-a2ef-45c1-af52-4e16fa7ed208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:54.618241 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a3422-a2ef-45c1-af52-4e16fa7ed208 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:54.618966 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a3422-a2ef-45c1-af52-4e16fa7ed208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:54.620714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a3422-a2ef-45c1-af52-4e16fa7ed208 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:54.632033 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1336/2685] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:54.636353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce40aa-1ee5-4487-b13f-efbcb460c66d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:54.647404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce40aa-1ee5-4487-b13f-efbcb460c66d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:54.652141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9777af-8951-4784-9580-851aa43e0cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:54.653079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9777af-8951-4784-9580-851aa43e0cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:54.653351 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9777af-8951-4784-9580-851aa43e0cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:54.653624 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9777af-8951-4784-9580-851aa43e0cc0 admin admin] PATH_INFO: `/v3/projects/b333a68b13c44d15ac1b118addeb6c59/users/22394a8288db42718ddfef7c175e7a93/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:54.669405 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9777af-8951-4784-9580-851aa43e0cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b333a68b13c44d15ac1b118addeb6c59, user_id=22394a8288db42718ddfef7c175e7a93, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:54.672106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9777af-8951-4784-9580-851aa43e0cc0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:54.686101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1350/2686] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:30:54 2022] PUT /identity/v3/projects/b333a68b13c44d15ac1b118addeb6c59/users/22394a8288db42718ddfef7c175e7a93/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:54.690127 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a3422-a2ef-45c1-af52-4e16fa7ed208 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:54.700895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a3422-a2ef-45c1-af52-4e16fa7ed208 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:54.763023 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae92eb-a73a-4698-8f74-2e69231ef141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:54.763694 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae92eb-a73a-4698-8f74-2e69231ef141 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:54.763987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae92eb-a73a-4698-8f74-2e69231ef141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:54.764291 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae92eb-a73a-4698-8f74-2e69231ef141 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:54.765014 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae92eb-a73a-4698-8f74-2e69231ef141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:54.766621 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae92eb-a73a-4698-8f74-2e69231ef141 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:54.777497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1337/2687] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:54.781708 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9777af-8951-4784-9580-851aa43e0cc0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:54.792106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9777af-8951-4784-9580-851aa43e0cc0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:54.796613 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95c379-324d-4188-8bdd-f19f41ed62a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:54.797504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c379-324d-4188-8bdd-f19f41ed62a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:54.797781 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c379-324d-4188-8bdd-f19f41ed62a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:54.798054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c379-324d-4188-8bdd-f19f41ed62a2 admin admin] PATH_INFO: `/v3/projects/b333a68b13c44d15ac1b118addeb6c59/users/22394a8288db42718ddfef7c175e7a93/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:54.800042 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95c379-324d-4188-8bdd-f19f41ed62a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b333a68b13c44d15ac1b118addeb6c59, user_id=22394a8288db42718ddfef7c175e7a93, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:54.802712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95c379-324d-4188-8bdd-f19f41ed62a2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:54.813072 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1351/2688] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:30:54 2022] PUT /identity/v3/projects/b333a68b13c44d15ac1b118addeb6c59/users/22394a8288db42718ddfef7c175e7a93/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:54.825229 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c82308-371c-428a-90a2-16a33263547b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:54.825229 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c82308-371c-428a-90a2-16a33263547b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:54.825503 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c82308-371c-428a-90a2-16a33263547b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:54.854466 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-65c82308-371c-428a-90a2-16a33263547b None None] MFA Rules not processed for user `22394a8288db42718ddfef7c175e7a93`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:54.855683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-65c82308-371c-428a-90a2-16a33263547b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:54.901998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:54.927320 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1338/2689] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:54.938028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95c379-324d-4188-8bdd-f19f41ed62a2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:54.939763 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bf95c379-324d-4188-8bdd-f19f41ed62a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:54.998606 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95c379-324d-4188-8bdd-f19f41ed62a2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:55.002229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0a143-0d8d-4b6d-95fa-b70349196736 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:55.003621 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0a143-0d8d-4b6d-95fa-b70349196736 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:55.003621 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0a143-0d8d-4b6d-95fa-b70349196736 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:55.004001 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0a143-0d8d-4b6d-95fa-b70349196736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:55.013130 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0a143-0d8d-4b6d-95fa-b70349196736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:55.014641 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0a143-0d8d-4b6d-95fa-b70349196736 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:55.031464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1352/2690] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:56.437405 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c82308-371c-428a-90a2-16a33263547b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:56.508545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c82308-371c-428a-90a2-16a33263547b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:56.513025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7516e9-3983-474b-b305-7eda3ed269a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:56.513906 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7516e9-3983-474b-b305-7eda3ed269a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:56.514189 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7516e9-3983-474b-b305-7eda3ed269a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:56.514466 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7516e9-3983-474b-b305-7eda3ed269a0 admin admin] PATH_INFO: `/v3/users/d9cb7f1ba24d45b88bec5db3211d0c39` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:56.515668 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7516e9-3983-474b-b305-7eda3ed269a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9cb7f1ba24d45b88bec5db3211d0c39)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:56.517625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7516e9-3983-474b-b305-7eda3ed269a0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:56.565598 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ef7516e9-3983-474b-b305-7eda3ed269a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9cb7f1ba24d45b88bec5db3211d0c39'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:56.572904 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ef7516e9-3983-474b-b305-7eda3ed269a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9cb7f1ba24d45b88bec5db3211d0c39'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:56.573521 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ef7516e9-3983-474b-b305-7eda3ed269a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9cb7f1ba24d45b88bec5db3211d0c39'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:56.574131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ef7516e9-3983-474b-b305-7eda3ed269a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9cb7f1ba24d45b88bec5db3211d0c39'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:56.586613 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ef7516e9-3983-474b-b305-7eda3ed269a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9cb7f1ba24d45b88bec5db3211d0c39'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:56.598890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1339/2691] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:30:56 2022] DELETE /identity/v3/users/d9cb7f1ba24d45b88bec5db3211d0c39 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:56.603531 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3352c-bb6f-4882-9152-2e210a619c03 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:56.604122 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3352c-bb6f-4882-9152-2e210a619c03 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:56.604122 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3352c-bb6f-4882-9152-2e210a619c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:56.624098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-19c3352c-bb6f-4882-9152-2e210a619c03 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:56.625345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-19c3352c-bb6f-4882-9152-2e210a619c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:56.634564 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:56.688691 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1353/2692] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:30:56.699022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7516e9-3983-474b-b305-7eda3ed269a0 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:56.700474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ef7516e9-3983-474b-b305-7eda3ed269a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:56.762714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7516e9-3983-474b-b305-7eda3ed269a0 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:56.766549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337671e-77fd-49b9-9b6d-cb3bb3436851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:56.767243 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337671e-77fd-49b9-9b6d-cb3bb3436851 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:56.767575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337671e-77fd-49b9-9b6d-cb3bb3436851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:56.767823 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337671e-77fd-49b9-9b6d-cb3bb3436851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:56.777629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337671e-77fd-49b9-9b6d-cb3bb3436851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:56.779080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337671e-77fd-49b9-9b6d-cb3bb3436851 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:56.789806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1340/2693] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:30:57.090008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3352c-bb6f-4882-9152-2e210a619c03 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:57.091500 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-19c3352c-bb6f-4882-9152-2e210a619c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:57.105208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3352c-bb6f-4882-9152-2e210a619c03 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:57.110727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d979d-3eb8-4708-9c7c-e72bb8b956c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:57.111636 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d979d-3eb8-4708-9c7c-e72bb8b956c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:57.111919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d979d-3eb8-4708-9c7c-e72bb8b956c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:57.112195 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d979d-3eb8-4708-9c7c-e72bb8b956c7 admin admin] PATH_INFO: `/v3/projects/2edbedca83aa4147b72053d696eb6535` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:57.114264 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d979d-3eb8-4708-9c7c-e72bb8b956c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2edbedca83aa4147b72053d696eb6535)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:57.115938 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d979d-3eb8-4708-9c7c-e72bb8b956c7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:57.170789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-129d979d-3eb8-4708-9c7c-e72bb8b956c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2edbedca83aa4147b72053d696eb6535', 'request_id': 'req-129d979d-3eb8-4708-9c7c-e72bb8b956c7'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:57.177681 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-129d979d-3eb8-4708-9c7c-e72bb8b956c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2edbedca83aa4147b72053d696eb6535', 'request_id': 'req-129d979d-3eb8-4708-9c7c-e72bb8b956c7'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:57.185370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-129d979d-3eb8-4708-9c7c-e72bb8b956c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2edbedca83aa4147b72053d696eb6535', 'request_id': 'req-129d979d-3eb8-4708-9c7c-e72bb8b956c7'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:57.200399 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-129d979d-3eb8-4708-9c7c-e72bb8b956c7 admin admin] The token cache is being invalidate because project 2edbedca83aa4147b72053d696eb6535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:30:57.200691 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-129d979d-3eb8-4708-9c7c-e72bb8b956c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:57.201558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-129d979d-3eb8-4708-9c7c-e72bb8b956c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:57.203344 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1354/2694] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:30:57 2022] DELETE /identity/v3/projects/2edbedca83aa4147b72053d696eb6535 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:57.207805 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337671e-77fd-49b9-9b6d-cb3bb3436851 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:57.214625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:57.218848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337671e-77fd-49b9-9b6d-cb3bb3436851 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:57.283709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33ca67-5219-4fe8-b474-2fa7df962c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:57.284625 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33ca67-5219-4fe8-b474-2fa7df962c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:57.284905 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33ca67-5219-4fe8-b474-2fa7df962c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:57.285446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33ca67-5219-4fe8-b474-2fa7df962c49 admin admin] PATH_INFO: `/v3/users/22394a8288db42718ddfef7c175e7a93` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:57.286654 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33ca67-5219-4fe8-b474-2fa7df962c49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22394a8288db42718ddfef7c175e7a93)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:57.288677 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33ca67-5219-4fe8-b474-2fa7df962c49 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:57.338286 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8a33ca67-5219-4fe8-b474-2fa7df962c49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22394a8288db42718ddfef7c175e7a93'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:57.346447 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8a33ca67-5219-4fe8-b474-2fa7df962c49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22394a8288db42718ddfef7c175e7a93'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:57.347107 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8a33ca67-5219-4fe8-b474-2fa7df962c49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22394a8288db42718ddfef7c175e7a93'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:57.347758 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8a33ca67-5219-4fe8-b474-2fa7df962c49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22394a8288db42718ddfef7c175e7a93'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:57.364454 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-8a33ca67-5219-4fe8-b474-2fa7df962c49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22394a8288db42718ddfef7c175e7a93'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:57.377684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1341/2695] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:30:57 2022] DELETE /identity/v3/users/22394a8288db42718ddfef7c175e7a93 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:57.663187 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d979d-3eb8-4708-9c7c-e72bb8b956c7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:57.664679 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-129d979d-3eb8-4708-9c7c-e72bb8b956c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:57.681430 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d979d-3eb8-4708-9c7c-e72bb8b956c7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:57.742804 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe470e6-0ad2-4694-9dc0-43bb736715d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:57.743656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe470e6-0ad2-4694-9dc0-43bb736715d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:57.743933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe470e6-0ad2-4694-9dc0-43bb736715d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:57.744202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe470e6-0ad2-4694-9dc0-43bb736715d6 admin admin] PATH_INFO: `/v3/projects/b333a68b13c44d15ac1b118addeb6c59` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:57.745396 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe470e6-0ad2-4694-9dc0-43bb736715d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b333a68b13c44d15ac1b118addeb6c59)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:57.747273 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe470e6-0ad2-4694-9dc0-43bb736715d6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:57.790680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:57.797432 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0fe470e6-0ad2-4694-9dc0-43bb736715d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b333a68b13c44d15ac1b118addeb6c59', 'request_id': 'req-0fe470e6-0ad2-4694-9dc0-43bb736715d6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:57.805271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0fe470e6-0ad2-4694-9dc0-43bb736715d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b333a68b13c44d15ac1b118addeb6c59', 'request_id': 'req-0fe470e6-0ad2-4694-9dc0-43bb736715d6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:57.811087 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0fe470e6-0ad2-4694-9dc0-43bb736715d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b333a68b13c44d15ac1b118addeb6c59', 'request_id': 'req-0fe470e6-0ad2-4694-9dc0-43bb736715d6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:57.824170 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0fe470e6-0ad2-4694-9dc0-43bb736715d6 admin admin] The token cache is being invalidate because project b333a68b13c44d15ac1b118addeb6c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:30:57.824495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0fe470e6-0ad2-4694-9dc0-43bb736715d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:57.825115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0fe470e6-0ad2-4694-9dc0-43bb736715d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:30:57.826653 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1355/2696] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:30:57 2022] DELETE /identity/v3/projects/b333a68b13c44d15ac1b118addeb6c59 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:57.832262 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6396-9906-4d9a-99a3-6dfe6ee4432a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:57.832783 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6396-9906-4d9a-99a3-6dfe6ee4432a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:57.833212 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6396-9906-4d9a-99a3-6dfe6ee4432a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:57.854595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-667c6396-9906-4d9a-99a3-6dfe6ee4432a None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:57.855836 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-667c6396-9906-4d9a-99a3-6dfe6ee4432a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:57.938698 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1342/2697] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:57.948210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b0434-f4b3-4d18-8336-6c54fa182b30 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:57.948600 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b0434-f4b3-4d18-8336-6c54fa182b30 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:57.948887 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b0434-f4b3-4d18-8336-6c54fa182b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:57.978973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-897b0434-f4b3-4d18-8336-6c54fa182b30 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:57.980207 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-897b0434-f4b3-4d18-8336-6c54fa182b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:57.989008 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1356/2698] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:57.993406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c6396-9906-4d9a-99a3-6dfe6ee4432a None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:58.003752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c6396-9906-4d9a-99a3-6dfe6ee4432a None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:58.008732 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22ba54-fa88-4227-bbb4-6659777bd1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:58.009411 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22ba54-fa88-4227-bbb4-6659777bd1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:58.009708 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22ba54-fa88-4227-bbb4-6659777bd1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:58.009975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22ba54-fa88-4227-bbb4-6659777bd1b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:58.010861 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22ba54-fa88-4227-bbb4-6659777bd1b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:30:58.011010 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22ba54-fa88-4227-bbb4-6659777bd1b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:58.012694 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22ba54-fa88-4227-bbb4-6659777bd1b1 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:58.025772 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1343/2699] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:30:58.030355 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b0434-f4b3-4d18-8336-6c54fa182b30 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:58.040287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b0434-f4b3-4d18-8336-6c54fa182b30 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:58.045168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27885f8-4d96-4457-9656-832f4ca92f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:58.045767 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27885f8-4d96-4457-9656-832f4ca92f4e admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:58.046052 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27885f8-4d96-4457-9656-832f4ca92f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:58.046331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27885f8-4d96-4457-9656-832f4ca92f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:58.047031 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27885f8-4d96-4457-9656-832f4ca92f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:58.048968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27885f8-4d96-4457-9656-832f4ca92f4e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:58.079270 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1357/2700] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:30:58 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:58.083731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22ba54-fa88-4227-bbb4-6659777bd1b1 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:58.094152 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22ba54-fa88-4227-bbb4-6659777bd1b1 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:58.103259 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:58.161821 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b69fef-e396-4d2c-b907-d08557a13bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:58.162504 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b69fef-e396-4d2c-b907-d08557a13bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:58.162788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b69fef-e396-4d2c-b907-d08557a13bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:58.163072 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b69fef-e396-4d2c-b907-d08557a13bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:58.163829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b69fef-e396-4d2c-b907-d08557a13bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:58.166307 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b69fef-e396-4d2c-b907-d08557a13bb5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:58.188467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1344/2701] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:30:58 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:58.193424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27885f8-4d96-4457-9656-832f4ca92f4e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:58.203592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27885f8-4d96-4457-9656-832f4ca92f4e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:58.209204 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfc967-2132-45e5-913c-8a94b69b0805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:58.210169 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfc967-2132-45e5-913c-8a94b69b0805 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:58.210608 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfc967-2132-45e5-913c-8a94b69b0805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:58.210998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfc967-2132-45e5-913c-8a94b69b0805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:58.212117 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfc967-2132-45e5-913c-8a94b69b0805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:58.214779 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfc967-2132-45e5-913c-8a94b69b0805 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:58.230914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1358/2702] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:58.234905 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b69fef-e396-4d2c-b907-d08557a13bb5 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:58.248085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b69fef-e396-4d2c-b907-d08557a13bb5 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:58.254317 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784043bf-03cc-4906-a80d-87b5cadf6260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:58.255431 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784043bf-03cc-4906-a80d-87b5cadf6260 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:58.255937 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784043bf-03cc-4906-a80d-87b5cadf6260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:58.256507 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784043bf-03cc-4906-a80d-87b5cadf6260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:58.258067 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784043bf-03cc-4906-a80d-87b5cadf6260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:58.260411 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784043bf-03cc-4906-a80d-87b5cadf6260 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:58.273668 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1345/2703] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:30:58.277906 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfc967-2132-45e5-913c-8a94b69b0805 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:58.288522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfc967-2132-45e5-913c-8a94b69b0805 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:58.293308 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63651d99-de66-45a9-a8c3-e28b9419c2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:58.294196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63651d99-de66-45a9-a8c3-e28b9419c2f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:58.294486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63651d99-de66-45a9-a8c3-e28b9419c2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:58.294766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63651d99-de66-45a9-a8c3-e28b9419c2f3 admin admin] PATH_INFO: `/v3/projects/8778434175f7426495075063ce2ff1d5/users/eaa8b4d8179a4646b24cc3e95161a606/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:58.311648 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63651d99-de66-45a9-a8c3-e28b9419c2f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8778434175f7426495075063ce2ff1d5, user_id=eaa8b4d8179a4646b24cc3e95161a606, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:58.314403 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63651d99-de66-45a9-a8c3-e28b9419c2f3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:58.330595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1359/2704] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:30:58 2022] PUT /identity/v3/projects/8778434175f7426495075063ce2ff1d5/users/eaa8b4d8179a4646b24cc3e95161a606/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:30:58.399721 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9f862-19fa-483f-84fc-9ef98667429c None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:58.400010 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9f862-19fa-483f-84fc-9ef98667429c None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:58.400319 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9f862-19fa-483f-84fc-9ef98667429c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:58.434182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-dcc9f862-19fa-483f-84fc-9ef98667429c None None] MFA Rules not processed for user `eaa8b4d8179a4646b24cc3e95161a606`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:58.435674 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-dcc9f862-19fa-483f-84fc-9ef98667429c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:58.502327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1346/2705] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:58.507208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63651d99-de66-45a9-a8c3-e28b9419c2f3 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:58.569764 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63651d99-de66-45a9-a8c3-e28b9419c2f3 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:58.574533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28c02f-c21d-414a-b4cf-2146afbeecd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:58.575278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28c02f-c21d-414a-b4cf-2146afbeecd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:58.575514 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28c02f-c21d-414a-b4cf-2146afbeecd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:58.575766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28c02f-c21d-414a-b4cf-2146afbeecd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:58.576513 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28c02f-c21d-414a-b4cf-2146afbeecd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:58.578443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28c02f-c21d-414a-b4cf-2146afbeecd5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:58.605153 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1360/2706] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:30:58 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:30:58.609290 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9f862-19fa-483f-84fc-9ef98667429c None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:58.620424 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9f862-19fa-483f-84fc-9ef98667429c None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:58.676791 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21ecdb-b4c4-4905-943a-9185f0129728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:58.677460 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21ecdb-b4c4-4905-943a-9185f0129728 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:58.677743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21ecdb-b4c4-4905-943a-9185f0129728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:58.678133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21ecdb-b4c4-4905-943a-9185f0129728 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:58.678756 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21ecdb-b4c4-4905-943a-9185f0129728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:58.680711 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21ecdb-b4c4-4905-943a-9185f0129728 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:58.702148 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1347/2707] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:30:58 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:30:58.706285 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28c02f-c21d-414a-b4cf-2146afbeecd5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:58.717081 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28c02f-c21d-414a-b4cf-2146afbeecd5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:58.722260 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5e9e6-15bd-4534-803c-4d9caa742eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:58.722921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5e9e6-15bd-4534-803c-4d9caa742eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:58.723202 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5e9e6-15bd-4534-803c-4d9caa742eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:58.723473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5e9e6-15bd-4534-803c-4d9caa742eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:58.724185 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5e9e6-15bd-4534-803c-4d9caa742eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:58.725800 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5e9e6-15bd-4534-803c-4d9caa742eb3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:58.736429 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1361/2708] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:58.741421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21ecdb-b4c4-4905-943a-9185f0129728 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:58.751975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21ecdb-b4c4-4905-943a-9185f0129728 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:58.756925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176be0f5-a576-48c8-a899-6b0d752d94de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:58.757932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be0f5-a576-48c8-a899-6b0d752d94de admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:58.758344 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be0f5-a576-48c8-a899-6b0d752d94de admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:58.758636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be0f5-a576-48c8-a899-6b0d752d94de admin admin] PATH_INFO: `/v3/projects/feffee039ef74d969d98365ecaa3ebd0/users/c151339844cd4690a95a6b36fc416cab/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:58.762066 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:58.775892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176be0f5-a576-48c8-a899-6b0d752d94de admin admin] RBAC: Authorizing `identity:create_grant(project_id=feffee039ef74d969d98365ecaa3ebd0, user_id=c151339844cd4690a95a6b36fc416cab, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:58.778643 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176be0f5-a576-48c8-a899-6b0d752d94de admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:58.793088 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1348/2709] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:30:58 2022] PUT /identity/v3/projects/feffee039ef74d969d98365ecaa3ebd0/users/c151339844cd4690a95a6b36fc416cab/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:58.797302 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5e9e6-15bd-4534-803c-4d9caa742eb3 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:58.807849 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5e9e6-15bd-4534-803c-4d9caa742eb3 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:58.846485 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:58.867968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a62639-4ac3-441b-bb3d-f4ecc47d9d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:58.868676 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a62639-4ac3-441b-bb3d-f4ecc47d9d98 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:58.868962 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a62639-4ac3-441b-bb3d-f4ecc47d9d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:58.869240 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a62639-4ac3-441b-bb3d-f4ecc47d9d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:58.869965 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a62639-4ac3-441b-bb3d-f4ecc47d9d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:58.871580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a62639-4ac3-441b-bb3d-f4ecc47d9d98 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:58.881477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1362/2710] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:30:58.885827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176be0f5-a576-48c8-a899-6b0d752d94de admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:58.896737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176be0f5-a576-48c8-a899-6b0d752d94de admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:58.901545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd26669-cdfb-45d5-9aa7-3b2771756120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:58.902539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd26669-cdfb-45d5-9aa7-3b2771756120 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:58.902922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd26669-cdfb-45d5-9aa7-3b2771756120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:58.903172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd26669-cdfb-45d5-9aa7-3b2771756120 admin admin] PATH_INFO: `/v3/projects/feffee039ef74d969d98365ecaa3ebd0/users/c151339844cd4690a95a6b36fc416cab/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:58.905327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd26669-cdfb-45d5-9aa7-3b2771756120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feffee039ef74d969d98365ecaa3ebd0, user_id=c151339844cd4690a95a6b36fc416cab, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:58.908036 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd26669-cdfb-45d5-9aa7-3b2771756120 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:58.919933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1349/2711] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:30:58 2022] PUT /identity/v3/projects/feffee039ef74d969d98365ecaa3ebd0/users/c151339844cd4690a95a6b36fc416cab/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:30:58.930220 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d651fd-2e54-4a9e-a75c-e50b5afc444c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:58.930510 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d651fd-2e54-4a9e-a75c-e50b5afc444c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:58.930787 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d651fd-2e54-4a9e-a75c-e50b5afc444c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:58.958629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-37d651fd-2e54-4a9e-a75c-e50b5afc444c None None] MFA Rules not processed for user `c151339844cd4690a95a6b36fc416cab`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:30:58.959925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-37d651fd-2e54-4a9e-a75c-e50b5afc444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:59.027472 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1363/2712] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:30:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:30:59.040293 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd26669-cdfb-45d5-9aa7-3b2771756120 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:30:59.041981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-cdd26669-cdfb-45d5-9aa7-3b2771756120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:30:59.115998 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd26669-cdfb-45d5-9aa7-3b2771756120 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:30:59.119620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9d3e5-ff9a-40d2-b168-35fcd1606af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:30:59.120301 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9d3e5-ff9a-40d2-b168-35fcd1606af6 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:30:59.120585 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9d3e5-ff9a-40d2-b168-35fcd1606af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:30:59.120855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9d3e5-ff9a-40d2-b168-35fcd1606af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:30:59.180427 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9d3e5-ff9a-40d2-b168-35fcd1606af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:30:59.181932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9d3e5-ff9a-40d2-b168-35fcd1606af6 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:30:59.192247 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1350/2713] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:30:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:31:00.569843 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d651fd-2e54-4a9e-a75c-e50b5afc444c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:00.579793 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d651fd-2e54-4a9e-a75c-e50b5afc444c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:00.584048 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87705030-7139-4e62-bbc1-69d23ba88de2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:00.584764 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87705030-7139-4e62-bbc1-69d23ba88de2 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:00.585049 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87705030-7139-4e62-bbc1-69d23ba88de2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:00.585323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87705030-7139-4e62-bbc1-69d23ba88de2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:00.594470 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87705030-7139-4e62-bbc1-69d23ba88de2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:00.595908 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87705030-7139-4e62-bbc1-69d23ba88de2 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:00.605903 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1364/2714] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:31:05.442596 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9d3e5-ff9a-40d2-b168-35fcd1606af6 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:05.505050 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9d3e5-ff9a-40d2-b168-35fcd1606af6 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:05.510131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1bc88-e18e-4e8b-bb0e-2413b94a50f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:05.511004 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1bc88-e18e-4e8b-bb0e-2413b94a50f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:05.511289 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1bc88-e18e-4e8b-bb0e-2413b94a50f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:05.511568 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1bc88-e18e-4e8b-bb0e-2413b94a50f6 admin admin] PATH_INFO: `/v3/users/eaa8b4d8179a4646b24cc3e95161a606` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:05.512777 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1bc88-e18e-4e8b-bb0e-2413b94a50f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaa8b4d8179a4646b24cc3e95161a606)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:05.514705 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1bc88-e18e-4e8b-bb0e-2413b94a50f6 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:05.545327 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:05.563641 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2de1bc88-e18e-4e8b-bb0e-2413b94a50f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaa8b4d8179a4646b24cc3e95161a606'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:05.571011 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2de1bc88-e18e-4e8b-bb0e-2413b94a50f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaa8b4d8179a4646b24cc3e95161a606'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:05.571673 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2de1bc88-e18e-4e8b-bb0e-2413b94a50f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaa8b4d8179a4646b24cc3e95161a606'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:05.572321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2de1bc88-e18e-4e8b-bb0e-2413b94a50f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaa8b4d8179a4646b24cc3e95161a606'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:05.584495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-2de1bc88-e18e-4e8b-bb0e-2413b94a50f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaa8b4d8179a4646b24cc3e95161a606'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:05.596197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1351/2715] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:31:05 2022] DELETE /identity/v3/users/eaa8b4d8179a4646b24cc3e95161a606 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:05.601339 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd0493-5153-4c1a-b0a6-481dcd42c946 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:05.601834 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd0493-5153-4c1a-b0a6-481dcd42c946 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:05.601951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd0493-5153-4c1a-b0a6-481dcd42c946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:05.620245 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0ccd0493-5153-4c1a-b0a6-481dcd42c946 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:05.621516 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0ccd0493-5153-4c1a-b0a6-481dcd42c946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:05.681370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1365/2716] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:31:05.691632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1bc88-e18e-4e8b-bb0e-2413b94a50f6 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:05.693076 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-2de1bc88-e18e-4e8b-bb0e-2413b94a50f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:05.748918 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1bc88-e18e-4e8b-bb0e-2413b94a50f6 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:05.753450 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a4721-f143-4b6e-8348-22838661e96c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:05.754094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a4721-f143-4b6e-8348-22838661e96c service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:05.754373 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a4721-f143-4b6e-8348-22838661e96c service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:05.754646 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a4721-f143-4b6e-8348-22838661e96c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:05.763767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a4721-f143-4b6e-8348-22838661e96c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:05.765264 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a4721-f143-4b6e-8348-22838661e96c service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:05.774668 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1352/2717] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:31:06.043058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd0493-5153-4c1a-b0a6-481dcd42c946 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:06.044548 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0ccd0493-5153-4c1a-b0a6-481dcd42c946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:06.059611 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd0493-5153-4c1a-b0a6-481dcd42c946 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:06.064350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:06.065353 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:06.065629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:06.066058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b admin admin] PATH_INFO: `/v3/projects/8778434175f7426495075063ce2ff1d5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:06.067256 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8778434175f7426495075063ce2ff1d5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:06.069194 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:06.115706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:06.120591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8778434175f7426495075063ce2ff1d5', 'request_id': 'req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:06.127958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8778434175f7426495075063ce2ff1d5', 'request_id': 'req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:06.133832 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8778434175f7426495075063ce2ff1d5', 'request_id': 'req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:06.146986 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b admin admin] The token cache is being invalidate because project 8778434175f7426495075063ce2ff1d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:31:06.147278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:06.147923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:06.149486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1366/2718] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:31:06 2022] DELETE /identity/v3/projects/8778434175f7426495075063ce2ff1d5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:06.153606 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a4721-f143-4b6e-8348-22838661e96c service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:06.164089 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a4721-f143-4b6e-8348-22838661e96c service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:06.221984 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccee25-9393-48e9-95a4-e9c8b368542f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:06.222874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccee25-9393-48e9-95a4-e9c8b368542f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:06.223160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccee25-9393-48e9-95a4-e9c8b368542f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:06.223438 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccee25-9393-48e9-95a4-e9c8b368542f admin admin] PATH_INFO: `/v3/users/c151339844cd4690a95a6b36fc416cab` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:06.224658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccee25-9393-48e9-95a4-e9c8b368542f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c151339844cd4690a95a6b36fc416cab)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:06.226593 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccee25-9393-48e9-95a4-e9c8b368542f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:06.273981 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-74ccee25-9393-48e9-95a4-e9c8b368542f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c151339844cd4690a95a6b36fc416cab'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:06.276525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:06.281576 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-74ccee25-9393-48e9-95a4-e9c8b368542f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c151339844cd4690a95a6b36fc416cab'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:06.282225 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-74ccee25-9393-48e9-95a4-e9c8b368542f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c151339844cd4690a95a6b36fc416cab'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:06.282853 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-74ccee25-9393-48e9-95a4-e9c8b368542f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c151339844cd4690a95a6b36fc416cab'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:06.296100 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-74ccee25-9393-48e9-95a4-e9c8b368542f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c151339844cd4690a95a6b36fc416cab'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:06.308542 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1353/2719] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:31:06 2022] DELETE /identity/v3/users/c151339844cd4690a95a6b36fc416cab => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:06.594492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:06.595970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:06.610457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577ddec-64d4-434b-8ebf-e6e5e5713c4b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:06.671164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f4887-e1f1-46be-846f-ca1befc0b34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:06.672037 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f4887-e1f1-46be-846f-ca1befc0b34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:06.672351 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f4887-e1f1-46be-846f-ca1befc0b34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:06.672629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f4887-e1f1-46be-846f-ca1befc0b34f admin admin] PATH_INFO: `/v3/projects/feffee039ef74d969d98365ecaa3ebd0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:06.673865 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f4887-e1f1-46be-846f-ca1befc0b34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=feffee039ef74d969d98365ecaa3ebd0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:06.676394 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f4887-e1f1-46be-846f-ca1befc0b34f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:06.724053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2c6f4887-e1f1-46be-846f-ca1befc0b34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feffee039ef74d969d98365ecaa3ebd0', 'request_id': 'req-2c6f4887-e1f1-46be-846f-ca1befc0b34f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:06.730328 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2c6f4887-e1f1-46be-846f-ca1befc0b34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feffee039ef74d969d98365ecaa3ebd0', 'request_id': 'req-2c6f4887-e1f1-46be-846f-ca1befc0b34f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:06.736633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2c6f4887-e1f1-46be-846f-ca1befc0b34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feffee039ef74d969d98365ecaa3ebd0', 'request_id': 'req-2c6f4887-e1f1-46be-846f-ca1befc0b34f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:06.750154 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2c6f4887-e1f1-46be-846f-ca1befc0b34f admin admin] The token cache is being invalidate because project feffee039ef74d969d98365ecaa3ebd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:31:06.750443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2c6f4887-e1f1-46be-846f-ca1befc0b34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:06.751072 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2c6f4887-e1f1-46be-846f-ca1befc0b34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:06.752951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1367/2720] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:31:06 2022] DELETE /identity/v3/projects/feffee039ef74d969d98365ecaa3ebd0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:06.758264 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd1f23-8476-45aa-8cbe-b17a4adb8530 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:06.758820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd1f23-8476-45aa-8cbe-b17a4adb8530 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:06.758820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd1f23-8476-45aa-8cbe-b17a4adb8530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:06.780990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-6ebd1f23-8476-45aa-8cbe-b17a4adb8530 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:06.782219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-6ebd1f23-8476-45aa-8cbe-b17a4adb8530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:06.844369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1354/2721] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:31:06.854713 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773f535-da10-404c-96e2-dfd93f62f5f9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:06.854998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773f535-da10-404c-96e2-dfd93f62f5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:06.855276 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773f535-da10-404c-96e2-dfd93f62f5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:06.875801 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1773f535-da10-404c-96e2-dfd93f62f5f9 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:06.877036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1773f535-da10-404c-96e2-dfd93f62f5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:06.885297 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1368/2722] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:31:06.890280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd1f23-8476-45aa-8cbe-b17a4adb8530 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:06.901019 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd1f23-8476-45aa-8cbe-b17a4adb8530 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:06.905696 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d775c5-5da1-4ffe-9074-5681dd090e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:06.906355 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d775c5-5da1-4ffe-9074-5681dd090e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:06.906636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d775c5-5da1-4ffe-9074-5681dd090e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:06.906909 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d775c5-5da1-4ffe-9074-5681dd090e45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:06.907630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d775c5-5da1-4ffe-9074-5681dd090e45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:31:06.907933 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d775c5-5da1-4ffe-9074-5681dd090e45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:06.910076 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d775c5-5da1-4ffe-9074-5681dd090e45 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:06.922607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1355/2723] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:31:06.928203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773f535-da10-404c-96e2-dfd93f62f5f9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:06.938058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773f535-da10-404c-96e2-dfd93f62f5f9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:06.942871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b46079-b0b9-4ca3-832d-e7a4631b50e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:06.943536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b46079-b0b9-4ca3-832d-e7a4631b50e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:06.943826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b46079-b0b9-4ca3-832d-e7a4631b50e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:06.944104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b46079-b0b9-4ca3-832d-e7a4631b50e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:06.944863 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b46079-b0b9-4ca3-832d-e7a4631b50e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:06.946777 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b46079-b0b9-4ca3-832d-e7a4631b50e0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:06.979080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1369/2724] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:31:06 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:31:06.980988 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d775c5-5da1-4ffe-9074-5681dd090e45 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:06.992065 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d775c5-5da1-4ffe-9074-5681dd090e45 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:07.048040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a4dfb-81d0-4bd2-9243-d1f2419f8ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:07.048751 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a4dfb-81d0-4bd2-9243-d1f2419f8ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:07.049032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a4dfb-81d0-4bd2-9243-d1f2419f8ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:07.049311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a4dfb-81d0-4bd2-9243-d1f2419f8ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:07.050037 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a4dfb-81d0-4bd2-9243-d1f2419f8ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:07.051990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a4dfb-81d0-4bd2-9243-d1f2419f8ff0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:07.077131 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1356/2725] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:31:06 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:31:07.078280 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b46079-b0b9-4ca3-832d-e7a4631b50e0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:07.089253 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b46079-b0b9-4ca3-832d-e7a4631b50e0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:07.094047 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa61c40-5350-4384-ac4d-e544f7379472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:07.094792 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa61c40-5350-4384-ac4d-e544f7379472 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:07.095001 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa61c40-5350-4384-ac4d-e544f7379472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:07.095282 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa61c40-5350-4384-ac4d-e544f7379472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:07.096015 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa61c40-5350-4384-ac4d-e544f7379472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:07.098280 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa61c40-5350-4384-ac4d-e544f7379472 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:07.109594 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1370/2726] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:31:07.113757 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a4dfb-81d0-4bd2-9243-d1f2419f8ff0 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:07.124442 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a4dfb-81d0-4bd2-9243-d1f2419f8ff0 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:07.129311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb16d7-b66a-4934-84de-0c550994a6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:07.129987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb16d7-b66a-4934-84de-0c550994a6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:07.130275 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb16d7-b66a-4934-84de-0c550994a6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:07.130582 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb16d7-b66a-4934-84de-0c550994a6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:07.131314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb16d7-b66a-4934-84de-0c550994a6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:07.132971 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb16d7-b66a-4934-84de-0c550994a6a1 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:07.144850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1357/2727] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:31:07.149172 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa61c40-5350-4384-ac4d-e544f7379472 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:07.160818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa61c40-5350-4384-ac4d-e544f7379472 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:07.165587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe34a1-6ae1-408e-83a1-208eb77724a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:07.166483 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe34a1-6ae1-408e-83a1-208eb77724a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:07.166765 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe34a1-6ae1-408e-83a1-208eb77724a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:07.167041 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe34a1-6ae1-408e-83a1-208eb77724a2 admin admin] PATH_INFO: `/v3/projects/728d492cf0344ca7aeca3c25e4daa010/users/e2d07678300a4b3baada4c8195965759/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:07.182721 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe34a1-6ae1-408e-83a1-208eb77724a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=728d492cf0344ca7aeca3c25e4daa010, user_id=e2d07678300a4b3baada4c8195965759, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:07.185392 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe34a1-6ae1-408e-83a1-208eb77724a2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:07.193690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:07.199968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1371/2728] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:31:07 2022] PUT /identity/v3/projects/728d492cf0344ca7aeca3c25e4daa010/users/e2d07678300a4b3baada4c8195965759/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:07.210918 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea717203-0994-488e-afd6-4c47d1ddd588 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:07.211209 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea717203-0994-488e-afd6-4c47d1ddd588 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:07.211480 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea717203-0994-488e-afd6-4c47d1ddd588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:07.240996 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ea717203-0994-488e-afd6-4c47d1ddd588 None None] MFA Rules not processed for user `e2d07678300a4b3baada4c8195965759`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:07.242205 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ea717203-0994-488e-afd6-4c47d1ddd588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:07.261876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:07.312378 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1358/2729] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:31:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:31:07.324212 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe34a1-6ae1-408e-83a1-208eb77724a2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:07.326024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5cbe34a1-6ae1-408e-83a1-208eb77724a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:07.413847 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe34a1-6ae1-408e-83a1-208eb77724a2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:07.418314 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2c0a0-49fd-45ed-868e-2b604c007e9c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '623c97746d304c6ba971e79e4dbeb730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:07.419130 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2c0a0-49fd-45ed-868e-2b604c007e9c service glance] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:07.419534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2c0a0-49fd-45ed-868e-2b604c007e9c service glance] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:07.419880 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2c0a0-49fd-45ed-868e-2b604c007e9c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:07.431764 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2c0a0-49fd-45ed-868e-2b604c007e9c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:07.434108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2c0a0-49fd-45ed-868e-2b604c007e9c service glance] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:07.446890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1372/2730] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:31:12.847545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1bf84-f507-4d46-b347-ec6c7b07d41a None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:12.848187 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1bf84-f507-4d46-b347-ec6c7b07d41a None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:12.848187 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1bf84-f507-4d46-b347-ec6c7b07d41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:12.871622 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-1ba1bf84-f507-4d46-b347-ec6c7b07d41a None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:12.872955 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1ba1bf84-f507-4d46-b347-ec6c7b07d41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:12.940827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1359/2731] 10.222.0.99 () {58 vars in 1016 bytes} [Mon Jul 25 16:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:31:12.966106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2c0a0-49fd-45ed-868e-2b604c007e9c service glance] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:12.967689 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8ee2c0a0-49fd-45ed-868e-2b604c007e9c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:13.046089 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2c0a0-49fd-45ed-868e-2b604c007e9c service glance] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:13.051806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e79eed-037e-4b55-aeae-9f4da6532097 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:13.052496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e79eed-037e-4b55-aeae-9f4da6532097 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:13.052780 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e79eed-037e-4b55-aeae-9f4da6532097 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:13.053054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e79eed-037e-4b55-aeae-9f4da6532097 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:13.062552 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e79eed-037e-4b55-aeae-9f4da6532097 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:13.064284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e79eed-037e-4b55-aeae-9f4da6532097 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:13.074795 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1373/2732] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:31:16.940624 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1bcc7-7404-4c1f-bb79-1c02737ff4a6 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:16.941224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1bcc7-7404-4c1f-bb79-1c02737ff4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:16.941224 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1bcc7-7404-4c1f-bb79-1c02737ff4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:16.966332 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-30c1bcc7-7404-4c1f-bb79-1c02737ff4a6 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:16.967651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-30c1bcc7-7404-4c1f-bb79-1c02737ff4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:16.978121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1360/2733] 10.222.0.99 () {58 vars in 1016 bytes} [Mon Jul 25 16:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:31:17.002853 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e79eed-037e-4b55-aeae-9f4da6532097 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:17.004622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-65e79eed-037e-4b55-aeae-9f4da6532097 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:17.023947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e79eed-037e-4b55-aeae-9f4da6532097 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:17.029457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a165f0-3717-4e51-8fb0-06254d7241e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:17.030111 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a165f0-3717-4e51-8fb0-06254d7241e0 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:17.030399 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a165f0-3717-4e51-8fb0-06254d7241e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:17.030671 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a165f0-3717-4e51-8fb0-06254d7241e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:17.040447 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a165f0-3717-4e51-8fb0-06254d7241e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:17.042044 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a165f0-3717-4e51-8fb0-06254d7241e0 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:17.052161 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1374/2734] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:31:21.291265 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cd8df-0252-4deb-8f2a-2665f158c229 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:21.291904 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cd8df-0252-4deb-8f2a-2665f158c229 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:21.291904 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cd8df-0252-4deb-8f2a-2665f158c229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:21.313079 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3b1cd8df-0252-4deb-8f2a-2665f158c229 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:21.314363 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3b1cd8df-0252-4deb-8f2a-2665f158c229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:21.322717 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1361/2735] 10.222.0.99 () {58 vars in 1016 bytes} [Mon Jul 25 16:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:31:21.357885 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a165f0-3717-4e51-8fb0-06254d7241e0 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:21.370496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a165f0-3717-4e51-8fb0-06254d7241e0 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:21.376512 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d70675-5a86-440c-be5a-24c87af25f21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:21.377210 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d70675-5a86-440c-be5a-24c87af25f21 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:21.377496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d70675-5a86-440c-be5a-24c87af25f21 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:21.377777 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d70675-5a86-440c-be5a-24c87af25f21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:21.387174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d70675-5a86-440c-be5a-24c87af25f21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:21.388842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d70675-5a86-440c-be5a-24c87af25f21 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:21.401011 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1375/2736] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:31:25.499763 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d18db-0b87-4cd5-be92-8e0eb629edd4 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:25.500370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d18db-0b87-4cd5-be92-8e0eb629edd4 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:25.500370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d18db-0b87-4cd5-be92-8e0eb629edd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:25.520599 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-5e3d18db-0b87-4cd5-be92-8e0eb629edd4 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:25.521852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-5e3d18db-0b87-4cd5-be92-8e0eb629edd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:25.530099 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1362/2737] 10.222.0.99 () {58 vars in 1016 bytes} [Mon Jul 25 16:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:31:25.553934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d70675-5a86-440c-be5a-24c87af25f21 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:25.565496 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d70675-5a86-440c-be5a-24c87af25f21 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:25.570860 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e6984-4fd8-4baa-8ff3-cb4d17bfebf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:25.571492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6984-4fd8-4baa-8ff3-cb4d17bfebf9 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:25.571800 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6984-4fd8-4baa-8ff3-cb4d17bfebf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:25.572073 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6984-4fd8-4baa-8ff3-cb4d17bfebf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:25.580864 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e6984-4fd8-4baa-8ff3-cb4d17bfebf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:25.582428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e6984-4fd8-4baa-8ff3-cb4d17bfebf9 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:25.592383 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1376/2738] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:31:30.595163 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d26706-efc1-4ef2-987f-c9f527392391 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:30.596971 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d26706-efc1-4ef2-987f-c9f527392391 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:30.596971 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d26706-efc1-4ef2-987f-c9f527392391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:30.616322 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-f0d26706-efc1-4ef2-987f-c9f527392391 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:30.617549 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f0d26706-efc1-4ef2-987f-c9f527392391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:30.625587 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1363/2739] 10.222.0.99 () {58 vars in 1016 bytes} [Mon Jul 25 16:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:31:30.653435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e6984-4fd8-4baa-8ff3-cb4d17bfebf9 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:30.665650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e6984-4fd8-4baa-8ff3-cb4d17bfebf9 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:30.671358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0125f50-2dbe-4bd0-8559-685ace962ffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:30.672007 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0125f50-2dbe-4bd0-8559-685ace962ffb service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:30.672323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0125f50-2dbe-4bd0-8559-685ace962ffb service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:30.672605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0125f50-2dbe-4bd0-8559-685ace962ffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:30.682254 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0125f50-2dbe-4bd0-8559-685ace962ffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:30.683862 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0125f50-2dbe-4bd0-8559-685ace962ffb service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:30.696374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1377/2740] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:31:32.573633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d26706-efc1-4ef2-987f-c9f527392391 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:32.583386 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d26706-efc1-4ef2-987f-c9f527392391 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:32.587942 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e16d9-c5af-470f-a74b-4fd8540b2f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:32.588830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e16d9-c5af-470f-a74b-4fd8540b2f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:32.589113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e16d9-c5af-470f-a74b-4fd8540b2f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:32.589385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e16d9-c5af-470f-a74b-4fd8540b2f79 admin admin] PATH_INFO: `/v3/users/e2d07678300a4b3baada4c8195965759` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:32.591199 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e16d9-c5af-470f-a74b-4fd8540b2f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2d07678300a4b3baada4c8195965759)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:32.592515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e16d9-c5af-470f-a74b-4fd8540b2f79 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:32.641866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f32e16d9-c5af-470f-a74b-4fd8540b2f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2d07678300a4b3baada4c8195965759'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:32.651500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f32e16d9-c5af-470f-a74b-4fd8540b2f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2d07678300a4b3baada4c8195965759'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:32.652820 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f32e16d9-c5af-470f-a74b-4fd8540b2f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2d07678300a4b3baada4c8195965759'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:32.653504 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f32e16d9-c5af-470f-a74b-4fd8540b2f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2d07678300a4b3baada4c8195965759'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:32.667519 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-f32e16d9-c5af-470f-a74b-4fd8540b2f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2d07678300a4b3baada4c8195965759'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:32.680616 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1364/2741] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:31:32 2022] DELETE /identity/v3/users/e2d07678300a4b3baada4c8195965759 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:32.685089 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3626c-57d4-4269-a4c2-08f9dac33d00 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:32.685578 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3626c-57d4-4269-a4c2-08f9dac33d00 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:32.685686 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3626c-57d4-4269-a4c2-08f9dac33d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:32.705499 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c1d3626c-57d4-4269-a4c2-08f9dac33d00 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:32.706710 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c1d3626c-57d4-4269-a4c2-08f9dac33d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:32.715075 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:32.766072 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1378/2742] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:31:32.776242 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e16d9-c5af-470f-a74b-4fd8540b2f79 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:32.777661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f32e16d9-c5af-470f-a74b-4fd8540b2f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:32.789231 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:32.837584 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e16d9-c5af-470f-a74b-4fd8540b2f79 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:32.841204 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eff8a-1b12-42bc-8a80-f5d56494353c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:32.841847 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eff8a-1b12-42bc-8a80-f5d56494353c service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:32.842130 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eff8a-1b12-42bc-8a80-f5d56494353c service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:32.842406 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eff8a-1b12-42bc-8a80-f5d56494353c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:32.852590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32eff8a-1b12-42bc-8a80-f5d56494353c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:32.854022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32eff8a-1b12-42bc-8a80-f5d56494353c service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:32.864602 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1365/2743] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:31:33.133740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3626c-57d4-4269-a4c2-08f9dac33d00 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:33.135355 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c1d3626c-57d4-4269-a4c2-08f9dac33d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:33.148996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3626c-57d4-4269-a4c2-08f9dac33d00 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:33.153635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aeb00-c28f-4c49-8acc-af353657515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:33.154504 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aeb00-c28f-4c49-8acc-af353657515a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:33.154784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aeb00-c28f-4c49-8acc-af353657515a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:33.155056 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aeb00-c28f-4c49-8acc-af353657515a admin admin] PATH_INFO: `/v3/projects/728d492cf0344ca7aeca3c25e4daa010` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:33.156228 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aeb00-c28f-4c49-8acc-af353657515a admin admin] RBAC: Authorizing `identity:delete_project(project_id=728d492cf0344ca7aeca3c25e4daa010)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:33.159334 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aeb00-c28f-4c49-8acc-af353657515a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:33.214379 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-469aeb00-c28f-4c49-8acc-af353657515a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '728d492cf0344ca7aeca3c25e4daa010', 'request_id': 'req-469aeb00-c28f-4c49-8acc-af353657515a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:33.221010 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-469aeb00-c28f-4c49-8acc-af353657515a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '728d492cf0344ca7aeca3c25e4daa010', 'request_id': 'req-469aeb00-c28f-4c49-8acc-af353657515a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:33.226495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-469aeb00-c28f-4c49-8acc-af353657515a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '728d492cf0344ca7aeca3c25e4daa010', 'request_id': 'req-469aeb00-c28f-4c49-8acc-af353657515a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:33.239845 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-469aeb00-c28f-4c49-8acc-af353657515a admin admin] The token cache is being invalidate because project 728d492cf0344ca7aeca3c25e4daa010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:31:33.240140 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-469aeb00-c28f-4c49-8acc-af353657515a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:33.240846 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-469aeb00-c28f-4c49-8acc-af353657515a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:33.242398 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1379/2744] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:31:33 2022] DELETE /identity/v3/projects/728d492cf0344ca7aeca3c25e4daa010 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:33.247351 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e3dc9-0bff-4524-b23c-537a94a541ad None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:33.247648 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e3dc9-0bff-4524-b23c-537a94a541ad None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:33.247929 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e3dc9-0bff-4524-b23c-537a94a541ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:33.268071 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-3a7e3dc9-0bff-4524-b23c-537a94a541ad None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:33.269318 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-3a7e3dc9-0bff-4524-b23c-537a94a541ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:33.328879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1366/2745] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:31:33.337519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355f61c-f4b2-433d-be7d-d688f106116f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:33.337808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355f61c-f4b2-433d-be7d-d688f106116f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:33.338093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355f61c-f4b2-433d-be7d-d688f106116f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:33.358146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8355f61c-f4b2-433d-be7d-d688f106116f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:33.359359 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8355f61c-f4b2-433d-be7d-d688f106116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:33.367345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1380/2746] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:31:33.371559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e3dc9-0bff-4524-b23c-537a94a541ad None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:33.381278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e3dc9-0bff-4524-b23c-537a94a541ad None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:33.386107 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21509433-3f65-430e-b770-5369ad065105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:33.386767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21509433-3f65-430e-b770-5369ad065105 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:33.387047 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21509433-3f65-430e-b770-5369ad065105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:33.387319 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21509433-3f65-430e-b770-5369ad065105 admin admin] PATH_INFO: `/v3/domains` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:33.388046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21509433-3f65-430e-b770-5369ad065105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80366) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:31:33.388378 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21509433-3f65-430e-b770-5369ad065105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:33.389992 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21509433-3f65-430e-b770-5369ad065105 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:33.402770 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1367/2747] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:31:33.407242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355f61c-f4b2-433d-be7d-d688f106116f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:33.417709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355f61c-f4b2-433d-be7d-d688f106116f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:33.422684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb30734-c013-4c3e-947b-9ccbf469c94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:33.423358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb30734-c013-4c3e-947b-9ccbf469c94b admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:33.423645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb30734-c013-4c3e-947b-9ccbf469c94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:33.424467 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb30734-c013-4c3e-947b-9ccbf469c94b admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:33.425175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb30734-c013-4c3e-947b-9ccbf469c94b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:33.427142 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb30734-c013-4c3e-947b-9ccbf469c94b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:33.464077 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1381/2748] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:31:33 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:31:33.468419 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21509433-3f65-430e-b770-5369ad065105 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:33.478834 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21509433-3f65-430e-b770-5369ad065105 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:33.537938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb722fbf-7913-4e3c-bff4-93a16b23f9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:33.538627 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb722fbf-7913-4e3c-bff4-93a16b23f9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:33.538911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb722fbf-7913-4e3c-bff4-93a16b23f9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:33.539191 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb722fbf-7913-4e3c-bff4-93a16b23f9a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:33.539902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb722fbf-7913-4e3c-bff4-93a16b23f9a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:33.541892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb722fbf-7913-4e3c-bff4-93a16b23f9a1 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:33.567512 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1368/2749] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:31:33 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:31:33.571967 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb30734-c013-4c3e-947b-9ccbf469c94b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:33.583749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb30734-c013-4c3e-947b-9ccbf469c94b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:33.587909 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421573d8-9d4b-4d53-9d7e-6168642534ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:33.588662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421573d8-9d4b-4d53-9d7e-6168642534ed admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:33.588900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421573d8-9d4b-4d53-9d7e-6168642534ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:33.589172 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421573d8-9d4b-4d53-9d7e-6168642534ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:33.589897 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421573d8-9d4b-4d53-9d7e-6168642534ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:33.591487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421573d8-9d4b-4d53-9d7e-6168642534ed admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:33.601975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1382/2750] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:31:33.606369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb722fbf-7913-4e3c-bff4-93a16b23f9a1 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:33.617400 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb722fbf-7913-4e3c-bff4-93a16b23f9a1 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:33.622369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce6374-1e39-4fbe-bfed-9c5154d9866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:33.623051 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce6374-1e39-4fbe-bfed-9c5154d9866b admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:33.623336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce6374-1e39-4fbe-bfed-9c5154d9866b admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:33.623615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce6374-1e39-4fbe-bfed-9c5154d9866b admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:33.624384 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce6374-1e39-4fbe-bfed-9c5154d9866b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:33.626114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce6374-1e39-4fbe-bfed-9c5154d9866b admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:33.639116 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1369/2751] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:31:33.643725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421573d8-9d4b-4d53-9d7e-6168642534ed admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:33.653896 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421573d8-9d4b-4d53-9d7e-6168642534ed admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:33.659081 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb45551-a53c-4969-8dfb-4b6efd0dfd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:33.659977 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45551-a53c-4969-8dfb-4b6efd0dfd78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:33.660291 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45551-a53c-4969-8dfb-4b6efd0dfd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:33.660827 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45551-a53c-4969-8dfb-4b6efd0dfd78 admin admin] PATH_INFO: `/v3/projects/7d65bfa6b96845fc8ee80bdf1a0264ee/users/f6636f2379b94c5697310868e4566c13/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:33.677010 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb45551-a53c-4969-8dfb-4b6efd0dfd78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d65bfa6b96845fc8ee80bdf1a0264ee, user_id=f6636f2379b94c5697310868e4566c13, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:33.679656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb45551-a53c-4969-8dfb-4b6efd0dfd78 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:33.695149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1383/2752] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:31:33 2022] PUT /identity/v3/projects/7d65bfa6b96845fc8ee80bdf1a0264ee/users/f6636f2379b94c5697310868e4566c13/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:33.707514 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11508668-2dd9-487e-8c3b-e28df8417945 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:33.708026 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11508668-2dd9-487e-8c3b-e28df8417945 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:33.708559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11508668-2dd9-487e-8c3b-e28df8417945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:33.739498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-11508668-2dd9-487e-8c3b-e28df8417945 None None] MFA Rules not processed for user `f6636f2379b94c5697310868e4566c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:33.740787 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-11508668-2dd9-487e-8c3b-e28df8417945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:33.746001 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:33.812450 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1370/2753] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:31:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:31:33.817481 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb45551-a53c-4969-8dfb-4b6efd0dfd78 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:33.853626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:33.882662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb45551-a53c-4969-8dfb-4b6efd0dfd78 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:33.887762 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da12c3-68e1-4ccb-9788-ce843ad12772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:33.888397 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da12c3-68e1-4ccb-9788-ce843ad12772 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:33.888684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da12c3-68e1-4ccb-9788-ce843ad12772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:33.888964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da12c3-68e1-4ccb-9788-ce843ad12772 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:33.889695 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da12c3-68e1-4ccb-9788-ce843ad12772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:33.891605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da12c3-68e1-4ccb-9788-ce843ad12772 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:33.921415 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1384/2754] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:31:33 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:31:33.926222 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11508668-2dd9-487e-8c3b-e28df8417945 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:33.937514 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11508668-2dd9-487e-8c3b-e28df8417945 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:33.996217 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e26e6-6e42-4e3c-8b88-333130d7d744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:33.996922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e26e6-6e42-4e3c-8b88-333130d7d744 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:33.997209 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e26e6-6e42-4e3c-8b88-333130d7d744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:33.997488 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e26e6-6e42-4e3c-8b88-333130d7d744 admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:33.998182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e26e6-6e42-4e3c-8b88-333130d7d744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:34.000164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e26e6-6e42-4e3c-8b88-333130d7d744 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:34.025651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1371/2755] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:31:33 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:31:34.029814 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da12c3-68e1-4ccb-9788-ce843ad12772 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:34.043963 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da12c3-68e1-4ccb-9788-ce843ad12772 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:34.049484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1c10e-c18d-474a-9231-7fceba47cf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:34.050229 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1c10e-c18d-474a-9231-7fceba47cf3c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:34.050511 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1c10e-c18d-474a-9231-7fceba47cf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:34.050788 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1c10e-c18d-474a-9231-7fceba47cf3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:34.051517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1c10e-c18d-474a-9231-7fceba47cf3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:34.053157 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1c10e-c18d-474a-9231-7fceba47cf3c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:34.065805 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1385/2756] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:31:34.069925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e26e6-6e42-4e3c-8b88-333130d7d744 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:34.080793 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e26e6-6e42-4e3c-8b88-333130d7d744 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:34.085565 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524448b-2d20-4711-8989-b152e9d922b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:34.086231 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524448b-2d20-4711-8989-b152e9d922b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:34.086514 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524448b-2d20-4711-8989-b152e9d922b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:34.086788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524448b-2d20-4711-8989-b152e9d922b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:34.087513 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524448b-2d20-4711-8989-b152e9d922b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:34.089139 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524448b-2d20-4711-8989-b152e9d922b0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:34.100865 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1372/2757] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:31:34.105740 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1c10e-c18d-474a-9231-7fceba47cf3c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:34.117900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1c10e-c18d-474a-9231-7fceba47cf3c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:34.123262 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dddca4-efaf-4b76-b648-8f8f2d909067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:34.124307 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dddca4-efaf-4b76-b648-8f8f2d909067 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:34.124684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dddca4-efaf-4b76-b648-8f8f2d909067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:34.125072 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dddca4-efaf-4b76-b648-8f8f2d909067 admin admin] PATH_INFO: `/v3/projects/5d6f3a51242e42bdb0eca7641fe70be5/users/fcbe4122e28d4fa09f5fe1358ab61d05/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:34.141735 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dddca4-efaf-4b76-b648-8f8f2d909067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d6f3a51242e42bdb0eca7641fe70be5, user_id=fcbe4122e28d4fa09f5fe1358ab61d05, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:34.144868 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dddca4-efaf-4b76-b648-8f8f2d909067 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:34.159719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1386/2758] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:31:34 2022] PUT /identity/v3/projects/5d6f3a51242e42bdb0eca7641fe70be5/users/fcbe4122e28d4fa09f5fe1358ab61d05/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:34.170543 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81260478-c53e-4515-a19d-5d36f7ee7be9 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:34.171048 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81260478-c53e-4515-a19d-5d36f7ee7be9 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:34.171373 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81260478-c53e-4515-a19d-5d36f7ee7be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:34.201863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-81260478-c53e-4515-a19d-5d36f7ee7be9 None None] MFA Rules not processed for user `fcbe4122e28d4fa09f5fe1358ab61d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:34.203114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-81260478-c53e-4515-a19d-5d36f7ee7be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:34.280279 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1373/2759] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:31:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:31:34.286609 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dddca4-efaf-4b76-b648-8f8f2d909067 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:34.350739 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dddca4-efaf-4b76-b648-8f8f2d909067 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:34.355611 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed91340-22cc-4949-85eb-ab032e727e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:34.356306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed91340-22cc-4949-85eb-ab032e727e43 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:34.356597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed91340-22cc-4949-85eb-ab032e727e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:34.356876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed91340-22cc-4949-85eb-ab032e727e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:34.357628 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed91340-22cc-4949-85eb-ab032e727e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:34.359516 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed91340-22cc-4949-85eb-ab032e727e43 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:34.386714 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1387/2760] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:31:34 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:31:34.390837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81260478-c53e-4515-a19d-5d36f7ee7be9 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:34.402399 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81260478-c53e-4515-a19d-5d36f7ee7be9 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:34.414157 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:34.461156 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51dd5e-2e69-44c5-b856-d40e3f0e500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:34.461835 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51dd5e-2e69-44c5-b856-d40e3f0e500a admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:34.462117 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51dd5e-2e69-44c5-b856-d40e3f0e500a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:34.462393 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51dd5e-2e69-44c5-b856-d40e3f0e500a admin admin] PATH_INFO: `/v3/users` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:34.463075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51dd5e-2e69-44c5-b856-d40e3f0e500a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:34.465049 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51dd5e-2e69-44c5-b856-d40e3f0e500a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:34.486672 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1374/2761] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:31:34 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:31:34.490818 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed91340-22cc-4949-85eb-ab032e727e43 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:34.503250 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed91340-22cc-4949-85eb-ab032e727e43 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:34.508072 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc99af-71a5-4c2d-b583-97fccad3543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:34.508777 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc99af-71a5-4c2d-b583-97fccad3543e admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:34.509064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc99af-71a5-4c2d-b583-97fccad3543e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:34.509340 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc99af-71a5-4c2d-b583-97fccad3543e admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:34.510064 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc99af-71a5-4c2d-b583-97fccad3543e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:34.511672 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc99af-71a5-4c2d-b583-97fccad3543e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:34.523411 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1388/2762] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:31:34.527946 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51dd5e-2e69-44c5-b856-d40e3f0e500a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:34.539895 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51dd5e-2e69-44c5-b856-d40e3f0e500a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:34.544579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f076cb3-9cde-4da7-b4cd-4edc3ef98ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:34.545466 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f076cb3-9cde-4da7-b4cd-4edc3ef98ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:34.545749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f076cb3-9cde-4da7-b4cd-4edc3ef98ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:34.546025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f076cb3-9cde-4da7-b4cd-4edc3ef98ab6 admin admin] PATH_INFO: `/v3/projects/21636f6e43a5430b89f0611a5ecfc76b/users/15ac737ee34148f3817deb4d5dc176cb/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:34.562247 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f076cb3-9cde-4da7-b4cd-4edc3ef98ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21636f6e43a5430b89f0611a5ecfc76b, user_id=15ac737ee34148f3817deb4d5dc176cb, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:34.565021 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f076cb3-9cde-4da7-b4cd-4edc3ef98ab6 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:34.578570 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1375/2763] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:31:34 2022] PUT /identity/v3/projects/21636f6e43a5430b89f0611a5ecfc76b/users/15ac737ee34148f3817deb4d5dc176cb/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:34.582859 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc99af-71a5-4c2d-b583-97fccad3543e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:34.593402 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc99af-71a5-4c2d-b583-97fccad3543e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:34.651598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:34.653275 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc642e5f-2a71-4f7f-b681-fd4278a07ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:34.654007 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc642e5f-2a71-4f7f-b681-fd4278a07ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:34.654370 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc642e5f-2a71-4f7f-b681-fd4278a07ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:34.654539 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc642e5f-2a71-4f7f-b681-fd4278a07ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:34.655371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc642e5f-2a71-4f7f-b681-fd4278a07ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:34.657287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc642e5f-2a71-4f7f-b681-fd4278a07ef8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:34.675983 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1389/2764] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:31:34.677789 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f076cb3-9cde-4da7-b4cd-4edc3ef98ab6 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:34.688375 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f076cb3-9cde-4da7-b4cd-4edc3ef98ab6 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:34.697882 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae0eac-5f8b-4f33-8c9b-833cdf033bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:34.699430 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae0eac-5f8b-4f33-8c9b-833cdf033bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:34.699911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae0eac-5f8b-4f33-8c9b-833cdf033bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:34.700409 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae0eac-5f8b-4f33-8c9b-833cdf033bbe admin admin] PATH_INFO: `/v3/projects/21636f6e43a5430b89f0611a5ecfc76b/users/15ac737ee34148f3817deb4d5dc176cb/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:34.703955 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae0eac-5f8b-4f33-8c9b-833cdf033bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=21636f6e43a5430b89f0611a5ecfc76b, user_id=15ac737ee34148f3817deb4d5dc176cb, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:34.709363 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae0eac-5f8b-4f33-8c9b-833cdf033bbe admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:34.724962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1376/2765] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:31:34 2022] PUT /identity/v3/projects/21636f6e43a5430b89f0611a5ecfc76b/users/15ac737ee34148f3817deb4d5dc176cb/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:34.736821 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448bb00-b999-4df0-a2af-41eb52026db2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:34.737458 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448bb00-b999-4df0-a2af-41eb52026db2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:34.737458 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448bb00-b999-4df0-a2af-41eb52026db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:34.767826 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a448bb00-b999-4df0-a2af-41eb52026db2 None None] MFA Rules not processed for user `15ac737ee34148f3817deb4d5dc176cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:34.769102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a448bb00-b999-4df0-a2af-41eb52026db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:34.804414 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cda5ec-6b98-4aba-8bac-902c076117c5 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:34.804703 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cda5ec-6b98-4aba-8bac-902c076117c5 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:34.804985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cda5ec-6b98-4aba-8bac-902c076117c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:34.827321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-56cda5ec-6b98-4aba-8bac-902c076117c5 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:34.828854 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-56cda5ec-6b98-4aba-8bac-902c076117c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:34.847214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1390/2766] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:31:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:31:34.859711 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448bb00-b999-4df0-a2af-41eb52026db2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:34.861556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a448bb00-b999-4df0-a2af-41eb52026db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:34.902021 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1377/2767] 10.222.0.99 () {58 vars in 1016 bytes} [Mon Jul 25 16:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:31:34.927733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448bb00-b999-4df0-a2af-41eb52026db2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:34.927961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cda5ec-6b98-4aba-8bac-902c076117c5 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:34.929663 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-56cda5ec-6b98-4aba-8bac-902c076117c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:34.931944 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98031724-0b31-424a-8742-93f0f0e63ce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:34.932151 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98031724-0b31-424a-8742-93f0f0e63ce9 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:34.932464 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98031724-0b31-424a-8742-93f0f0e63ce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:34.932746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98031724-0b31-424a-8742-93f0f0e63ce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:34.995963 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98031724-0b31-424a-8742-93f0f0e63ce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:34.997446 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98031724-0b31-424a-8742-93f0f0e63ce9 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:35.006946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1391/2768] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:31:35.007747 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cda5ec-6b98-4aba-8bac-902c076117c5 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:35.013515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b4f05-b8e1-45d6-a46f-7fd15bf3e20a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:35.014202 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b4f05-b8e1-45d6-a46f-7fd15bf3e20a service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:35.014486 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b4f05-b8e1-45d6-a46f-7fd15bf3e20a service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:35.014764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b4f05-b8e1-45d6-a46f-7fd15bf3e20a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:35.021106 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:35.025316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b4f05-b8e1-45d6-a46f-7fd15bf3e20a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:35.027594 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b4f05-b8e1-45d6-a46f-7fd15bf3e20a service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:35.041303 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1378/2769] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:31:36.560671 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98031724-0b31-424a-8742-93f0f0e63ce9 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:36.569859 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98031724-0b31-424a-8742-93f0f0e63ce9 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:36.573492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5059e-272f-41df-9021-37cb8bdd6b15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:36.574138 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5059e-272f-41df-9021-37cb8bdd6b15 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:36.574424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5059e-272f-41df-9021-37cb8bdd6b15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:36.574727 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5059e-272f-41df-9021-37cb8bdd6b15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:36.605027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:36.633486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5059e-272f-41df-9021-37cb8bdd6b15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:36.634910 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5059e-272f-41df-9021-37cb8bdd6b15 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:36.643688 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1392/2770] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:31:37.209441 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b4f05-b8e1-45d6-a46f-7fd15bf3e20a service nova] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:37.219061 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b4f05-b8e1-45d6-a46f-7fd15bf3e20a service nova] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:37.222832 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374a391-9759-4b4e-873c-aa0002a058ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:37.223476 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a391-9759-4b4e-873c-aa0002a058ba service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:37.223786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a391-9759-4b4e-873c-aa0002a058ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:37.224062 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a391-9759-4b4e-873c-aa0002a058ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:37.233564 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374a391-9759-4b4e-873c-aa0002a058ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:37.234877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374a391-9759-4b4e-873c-aa0002a058ba service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:37.245370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1379/2771] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:31:41.115321 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5059e-272f-41df-9021-37cb8bdd6b15 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:41.128109 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5059e-272f-41df-9021-37cb8bdd6b15 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:41.132680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717f0cf-e282-4f4d-a3b2-bf388f9bc488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:41.133585 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717f0cf-e282-4f4d-a3b2-bf388f9bc488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:41.133870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717f0cf-e282-4f4d-a3b2-bf388f9bc488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:41.134147 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717f0cf-e282-4f4d-a3b2-bf388f9bc488 admin admin] PATH_INFO: `/v3/users/f6636f2379b94c5697310868e4566c13` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:41.135331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717f0cf-e282-4f4d-a3b2-bf388f9bc488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6636f2379b94c5697310868e4566c13)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:41.137295 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717f0cf-e282-4f4d-a3b2-bf388f9bc488 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:41.185864 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1717f0cf-e282-4f4d-a3b2-bf388f9bc488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6636f2379b94c5697310868e4566c13'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:41.186939 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1717f0cf-e282-4f4d-a3b2-bf388f9bc488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6636f2379b94c5697310868e4566c13'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:41.189893 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1717f0cf-e282-4f4d-a3b2-bf388f9bc488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6636f2379b94c5697310868e4566c13'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:41.197773 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1717f0cf-e282-4f4d-a3b2-bf388f9bc488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6636f2379b94c5697310868e4566c13'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:41.206867 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1717f0cf-e282-4f4d-a3b2-bf388f9bc488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6636f2379b94c5697310868e4566c13'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:41.227478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1393/2772] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:31:41 2022] DELETE /identity/v3/users/f6636f2379b94c5697310868e4566c13 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:41.232791 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972443d6-a327-4e83-a236-e5ec19a3a2ce None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:41.232791 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972443d6-a327-4e83-a236-e5ec19a3a2ce None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:41.233319 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972443d6-a327-4e83-a236-e5ec19a3a2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:41.252339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-972443d6-a327-4e83-a236-e5ec19a3a2ce None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:41.253559 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-972443d6-a327-4e83-a236-e5ec19a3a2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:41.312449 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1380/2773] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:31:41.322743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717f0cf-e282-4f4d-a3b2-bf388f9bc488 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:41.324219 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1717f0cf-e282-4f4d-a3b2-bf388f9bc488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:41.382006 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717f0cf-e282-4f4d-a3b2-bf388f9bc488 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:41.385651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d295e5d-cbcb-43fc-bbc8-8f27d4393523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:41.386276 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d295e5d-cbcb-43fc-bbc8-8f27d4393523 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:41.386561 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d295e5d-cbcb-43fc-bbc8-8f27d4393523 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:41.386836 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d295e5d-cbcb-43fc-bbc8-8f27d4393523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:41.396035 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d295e5d-cbcb-43fc-bbc8-8f27d4393523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:41.397493 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d295e5d-cbcb-43fc-bbc8-8f27d4393523 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:41.407004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1394/2774] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:31:41.696780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972443d6-a327-4e83-a236-e5ec19a3a2ce None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:41.698240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-972443d6-a327-4e83-a236-e5ec19a3a2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:41.714533 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972443d6-a327-4e83-a236-e5ec19a3a2ce None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:41.721218 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:41.722688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:41.723241 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:41.723686 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80 admin admin] PATH_INFO: `/v3/projects/7d65bfa6b96845fc8ee80bdf1a0264ee` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:41.725830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d65bfa6b96845fc8ee80bdf1a0264ee)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:41.729634 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:41.780545 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d65bfa6b96845fc8ee80bdf1a0264ee', 'request_id': 'req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:41.787923 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d65bfa6b96845fc8ee80bdf1a0264ee', 'request_id': 'req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:41.794115 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d65bfa6b96845fc8ee80bdf1a0264ee', 'request_id': 'req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:41.804921 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80 admin admin] The token cache is being invalidate because project 7d65bfa6b96845fc8ee80bdf1a0264ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:31:41.805210 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:41.805855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:41.807415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1381/2775] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:31:41 2022] DELETE /identity/v3/projects/7d65bfa6b96845fc8ee80bdf1a0264ee => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:41.811345 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d295e5d-cbcb-43fc-bbc8-8f27d4393523 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:41.821661 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d295e5d-cbcb-43fc-bbc8-8f27d4393523 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:41.865416 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:41.881613 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773cb87-ab83-40f1-83c2-00e691fbe721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:41.882515 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773cb87-ab83-40f1-83c2-00e691fbe721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:41.882806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773cb87-ab83-40f1-83c2-00e691fbe721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:41.883076 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773cb87-ab83-40f1-83c2-00e691fbe721 admin admin] PATH_INFO: `/v3/users/fcbe4122e28d4fa09f5fe1358ab61d05` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:41.884279 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773cb87-ab83-40f1-83c2-00e691fbe721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcbe4122e28d4fa09f5fe1358ab61d05)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:41.886208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773cb87-ab83-40f1-83c2-00e691fbe721 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:41.938289 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f773cb87-ab83-40f1-83c2-00e691fbe721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcbe4122e28d4fa09f5fe1358ab61d05'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:41.938961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f773cb87-ab83-40f1-83c2-00e691fbe721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcbe4122e28d4fa09f5fe1358ab61d05'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:41.939556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f773cb87-ab83-40f1-83c2-00e691fbe721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcbe4122e28d4fa09f5fe1358ab61d05'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:41.946369 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f773cb87-ab83-40f1-83c2-00e691fbe721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcbe4122e28d4fa09f5fe1358ab61d05'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:41.954025 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f773cb87-ab83-40f1-83c2-00e691fbe721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcbe4122e28d4fa09f5fe1358ab61d05'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:41.971808 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1395/2776] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:31:41 2022] DELETE /identity/v3/users/fcbe4122e28d4fa09f5fe1358ab61d05 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:42.262709 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:42.264166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:42.279294 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3bd14-ce31-47f2-9db8-f8195cc2cc80 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:42.337076 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:42.337943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:42.338228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:42.338504 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697 admin admin] PATH_INFO: `/v3/projects/5d6f3a51242e42bdb0eca7641fe70be5` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:42.339697 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d6f3a51242e42bdb0eca7641fe70be5)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:42.341646 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:42.347890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:42.390885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d6f3a51242e42bdb0eca7641fe70be5', 'request_id': 'req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:42.398139 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d6f3a51242e42bdb0eca7641fe70be5', 'request_id': 'req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:42.404712 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d6f3a51242e42bdb0eca7641fe70be5', 'request_id': 'req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:42.415676 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697 admin admin] The token cache is being invalidate because project 5d6f3a51242e42bdb0eca7641fe70be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:31:42.415967 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:42.416629 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:42.418181 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1382/2777] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:31:42 2022] DELETE /identity/v3/projects/5d6f3a51242e42bdb0eca7641fe70be5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:42.422357 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773cb87-ab83-40f1-83c2-00e691fbe721 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:42.424356 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f773cb87-ab83-40f1-83c2-00e691fbe721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:42.437094 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773cb87-ab83-40f1-83c2-00e691fbe721 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:42.493589 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff7359-7af5-4d82-b132-0769c5621688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:42.494473 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff7359-7af5-4d82-b132-0769c5621688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:42.494755 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff7359-7af5-4d82-b132-0769c5621688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:42.495028 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff7359-7af5-4d82-b132-0769c5621688 admin admin] PATH_INFO: `/v3/users/15ac737ee34148f3817deb4d5dc176cb` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:42.496207 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff7359-7af5-4d82-b132-0769c5621688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ac737ee34148f3817deb4d5dc176cb)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:42.498146 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff7359-7af5-4d82-b132-0769c5621688 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:42.542854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-94ff7359-7af5-4d82-b132-0769c5621688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ac737ee34148f3817deb4d5dc176cb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:42.543505 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-94ff7359-7af5-4d82-b132-0769c5621688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ac737ee34148f3817deb4d5dc176cb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:42.544106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-94ff7359-7af5-4d82-b132-0769c5621688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ac737ee34148f3817deb4d5dc176cb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:42.551408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-94ff7359-7af5-4d82-b132-0769c5621688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ac737ee34148f3817deb4d5dc176cb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:42.558543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-94ff7359-7af5-4d82-b132-0769c5621688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ac737ee34148f3817deb4d5dc176cb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:42.562885 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:42.579160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1396/2778] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:31:42 2022] DELETE /identity/v3/users/15ac737ee34148f3817deb4d5dc176cb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:42.865482 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:42.866923 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:42.881354 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccc3e2-3561-4d8d-ae6a-bb1101970697 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:42.938421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcefe15-6ea8-40c5-961e-53821e37e344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:42.939321 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcefe15-6ea8-40c5-961e-53821e37e344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:42.939601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcefe15-6ea8-40c5-961e-53821e37e344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:42.939876 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcefe15-6ea8-40c5-961e-53821e37e344 admin admin] PATH_INFO: `/v3/projects/21636f6e43a5430b89f0611a5ecfc76b` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:42.941070 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcefe15-6ea8-40c5-961e-53821e37e344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21636f6e43a5430b89f0611a5ecfc76b)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:42.942973 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcefe15-6ea8-40c5-961e-53821e37e344 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:42.989627 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3bcefe15-6ea8-40c5-961e-53821e37e344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21636f6e43a5430b89f0611a5ecfc76b', 'request_id': 'req-3bcefe15-6ea8-40c5-961e-53821e37e344'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:42.997007 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3bcefe15-6ea8-40c5-961e-53821e37e344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21636f6e43a5430b89f0611a5ecfc76b', 'request_id': 'req-3bcefe15-6ea8-40c5-961e-53821e37e344'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:43.003240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3bcefe15-6ea8-40c5-961e-53821e37e344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21636f6e43a5430b89f0611a5ecfc76b', 'request_id': 'req-3bcefe15-6ea8-40c5-961e-53821e37e344'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:43.013694 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3bcefe15-6ea8-40c5-961e-53821e37e344 admin admin] The token cache is being invalidate because project 21636f6e43a5430b89f0611a5ecfc76b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:31:43.013972 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3bcefe15-6ea8-40c5-961e-53821e37e344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:43.014609 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-3bcefe15-6ea8-40c5-961e-53821e37e344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:31:43.016150 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1383/2779] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:31:42 2022] DELETE /identity/v3/projects/21636f6e43a5430b89f0611a5ecfc76b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:31:50.919750 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff7359-7af5-4d82-b132-0769c5621688 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:50.921279 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-94ff7359-7af5-4d82-b132-0769c5621688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:50.993625 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff7359-7af5-4d82-b132-0769c5621688 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:51.057026 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d827d4-9990-4be7-8155-c1b24aafab31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:51.057700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d827d4-9990-4be7-8155-c1b24aafab31 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:51.057981 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d827d4-9990-4be7-8155-c1b24aafab31 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:51.058255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d827d4-9990-4be7-8155-c1b24aafab31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:51.060080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f3d827d4-9990-4be7-8155-c1b24aafab31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:51.144944 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d827d4-9990-4be7-8155-c1b24aafab31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:51.146536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d827d4-9990-4be7-8155-c1b24aafab31 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:51.151034 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:51.168719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1397/2780] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:31:52.308564 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2c0f4-8864-4693-a014-2ca1ec58c101 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:52.309049 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2c0f4-8864-4693-a014-2ca1ec58c101 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:52.309145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2c0f4-8864-4693-a014-2ca1ec58c101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:52.327806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-4fa2c0f4-8864-4693-a014-2ca1ec58c101 None None] MFA Rules not processed for user `71ba8cc4f00946feb7457eac3c61e044`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:31:52.329043 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4fa2c0f4-8864-4693-a014-2ca1ec58c101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:52.348732 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:52.387536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1384/2781] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:31:52.635584 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d827d4-9990-4be7-8155-c1b24aafab31 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:52.637856 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f3d827d4-9990-4be7-8155-c1b24aafab31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:52.697331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d827d4-9990-4be7-8155-c1b24aafab31 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:52.704141 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004eed24-6012-440c-a6c4-0f9012e93a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:52.706261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004eed24-6012-440c-a6c4-0f9012e93a94 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:52.707192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004eed24-6012-440c-a6c4-0f9012e93a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:52.707698 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004eed24-6012-440c-a6c4-0f9012e93a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:52.711051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-004eed24-6012-440c-a6c4-0f9012e93a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:52.730674 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004eed24-6012-440c-a6c4-0f9012e93a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:52.734108 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004eed24-6012-440c-a6c4-0f9012e93a94 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:52.750306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1398/2782] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:31:54.079146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2c0f4-8864-4693-a014-2ca1ec58c101 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:31:54.080669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4fa2c0f4-8864-4693-a014-2ca1ec58c101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:54.151043 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2c0f4-8864-4693-a014-2ca1ec58c101 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:31:54.156007 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f9888-12f1-4a19-b71a-100b67806bed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3474e40117440498f0fe99f743df50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:31:54.156689 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f9888-12f1-4a19-b71a-100b67806bed service placement] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:31:54.156974 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f9888-12f1-4a19-b71a-100b67806bed service placement] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:31:54.157274 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f9888-12f1-4a19-b71a-100b67806bed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:31:54.159546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ad7f9888-12f1-4a19-b71a-100b67806bed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:31:54.171604 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f9888-12f1-4a19-b71a-100b67806bed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:31:54.173794 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f9888-12f1-4a19-b71a-100b67806bed service placement] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:31:54.185213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1385/2783] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:31:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:00.933605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004eed24-6012-440c-a6c4-0f9012e93a94 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:00.946524 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004eed24-6012-440c-a6c4-0f9012e93a94 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:00.952003 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d26418-3c80-46bf-958c-73567b3305a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3474e40117440498f0fe99f743df50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:00.952953 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d26418-3c80-46bf-958c-73567b3305a4 service placement] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:00.953483 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d26418-3c80-46bf-958c-73567b3305a4 service placement] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:00.953998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d26418-3c80-46bf-958c-73567b3305a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:00.956101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-01d26418-3c80-46bf-958c-73567b3305a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:00.969420 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d26418-3c80-46bf-958c-73567b3305a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:00.971963 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d26418-3c80-46bf-958c-73567b3305a4 service placement] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:00.984416 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1399/2784] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:04.180421 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=46 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:08.220607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f9888-12f1-4a19-b71a-100b67806bed service placement] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:08.222049 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ad7f9888-12f1-4a19-b71a-100b67806bed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:08.234128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f9888-12f1-4a19-b71a-100b67806bed service placement] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:08.238195 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dacdc-3403-44f8-9a07-84f4e9379969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:08.238929 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dacdc-3403-44f8-9a07-84f4e9379969 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:08.239583 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dacdc-3403-44f8-9a07-84f4e9379969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:08.240128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dacdc-3403-44f8-9a07-84f4e9379969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:08.242315 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-8d9dacdc-3403-44f8-9a07-84f4e9379969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:08.309472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9dacdc-3403-44f8-9a07-84f4e9379969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:08.310922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9dacdc-3403-44f8-9a07-84f4e9379969 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:08.321223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1386/2785] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:32:09.526580 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d26418-3c80-46bf-958c-73567b3305a4 service placement] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:09.528083 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-01d26418-3c80-46bf-958c-73567b3305a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:09.552594 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d26418-3c80-46bf-958c-73567b3305a4 service placement] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:09.559745 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8aec2-c07c-4322-b6d3-1944d27c515a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:09.560544 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8aec2-c07c-4322-b6d3-1944d27c515a service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:09.561058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8aec2-c07c-4322-b6d3-1944d27c515a service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:09.561498 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8aec2-c07c-4322-b6d3-1944d27c515a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:09.564544 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c4b8aec2-c07c-4322-b6d3-1944d27c515a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:09.578346 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8aec2-c07c-4322-b6d3-1944d27c515a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:09.580759 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8aec2-c07c-4322-b6d3-1944d27c515a service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:09.593126 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1400/2786] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:11.690060 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dacdc-3403-44f8-9a07-84f4e9379969 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:11.701869 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dacdc-3403-44f8-9a07-84f4e9379969 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:11.707367 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5fa97-4498-4819-9efa-94c854853d88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3474e40117440498f0fe99f743df50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:11.708043 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5fa97-4498-4819-9efa-94c854853d88 service placement] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:11.708785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5fa97-4498-4819-9efa-94c854853d88 service placement] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:11.708785 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5fa97-4498-4819-9efa-94c854853d88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:11.710467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-0be5fa97-4498-4819-9efa-94c854853d88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:11.723607 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5fa97-4498-4819-9efa-94c854853d88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:11.725235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5fa97-4498-4819-9efa-94c854853d88 service placement] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:11.739334 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1387/2787] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:11.760825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8aec2-c07c-4322-b6d3-1944d27c515a service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:11.762312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c4b8aec2-c07c-4322-b6d3-1944d27c515a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:11.781316 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8aec2-c07c-4322-b6d3-1944d27c515a service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:11.789404 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e6ba8-d616-40ad-bf82-823095a09d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:11.790316 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e6ba8-d616-40ad-bf82-823095a09d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:11.790595 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e6ba8-d616-40ad-bf82-823095a09d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:11.790947 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e6ba8-d616-40ad-bf82-823095a09d5a admin admin] PATH_INFO: `/v3/users/10c3b4f5766449c19198efc35dc80429` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:11.792374 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e6ba8-d616-40ad-bf82-823095a09d5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c3b4f5766449c19198efc35dc80429)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:11.794456 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e6ba8-d616-40ad-bf82-823095a09d5a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:11.850487 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-469e6ba8-d616-40ad-bf82-823095a09d5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c3b4f5766449c19198efc35dc80429'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:11.851794 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-469e6ba8-d616-40ad-bf82-823095a09d5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c3b4f5766449c19198efc35dc80429'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:11.852522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-469e6ba8-d616-40ad-bf82-823095a09d5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c3b4f5766449c19198efc35dc80429'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:11.859594 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-469e6ba8-d616-40ad-bf82-823095a09d5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c3b4f5766449c19198efc35dc80429'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:11.868130 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-469e6ba8-d616-40ad-bf82-823095a09d5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c3b4f5766449c19198efc35dc80429'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:11.885764 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1401/2788] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:32:11 2022] DELETE /identity/v3/users/10c3b4f5766449c19198efc35dc80429 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:12.068899 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5fa97-4498-4819-9efa-94c854853d88 service placement] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:12.081575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5fa97-4498-4819-9efa-94c854853d88 service placement] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:12.142963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8303c36-82f0-48fc-8b7a-550dbe0373ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:12.143943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8303c36-82f0-48fc-8b7a-550dbe0373ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:12.144139 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8303c36-82f0-48fc-8b7a-550dbe0373ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:12.144450 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8303c36-82f0-48fc-8b7a-550dbe0373ed admin admin] PATH_INFO: `/v3/projects/7246e06afcd841b9a0805cf0d61e2f39` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:12.145653 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8303c36-82f0-48fc-8b7a-550dbe0373ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=7246e06afcd841b9a0805cf0d61e2f39)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:12.147571 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8303c36-82f0-48fc-8b7a-550dbe0373ed admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:12.213086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d8303c36-82f0-48fc-8b7a-550dbe0373ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7246e06afcd841b9a0805cf0d61e2f39', 'request_id': 'req-d8303c36-82f0-48fc-8b7a-550dbe0373ed'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:12.225624 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d8303c36-82f0-48fc-8b7a-550dbe0373ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7246e06afcd841b9a0805cf0d61e2f39', 'request_id': 'req-d8303c36-82f0-48fc-8b7a-550dbe0373ed'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:12.235931 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d8303c36-82f0-48fc-8b7a-550dbe0373ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7246e06afcd841b9a0805cf0d61e2f39', 'request_id': 'req-d8303c36-82f0-48fc-8b7a-550dbe0373ed'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:12.247311 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d8303c36-82f0-48fc-8b7a-550dbe0373ed admin admin] The token cache is being invalidate because project 7246e06afcd841b9a0805cf0d61e2f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:32:12.247601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d8303c36-82f0-48fc-8b7a-550dbe0373ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:12.248304 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-d8303c36-82f0-48fc-8b7a-550dbe0373ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:12.249877 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1388/2789] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:32:12 2022] DELETE /identity/v3/projects/7246e06afcd841b9a0805cf0d61e2f39 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:12.255870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d7807-2312-407d-ba09-c752d3e6a1f3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:12.256321 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d7807-2312-407d-ba09-c752d3e6a1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:12.256825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d7807-2312-407d-ba09-c752d3e6a1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:12.286410 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8b6d7807-2312-407d-ba09-c752d3e6a1f3 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:12.287651 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8b6d7807-2312-407d-ba09-c752d3e6a1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:12.323192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:12.362913 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1402/2790] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:12.371453 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5952603-2598-4a89-b05e-3c1f35e851cf None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:12.371734 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5952603-2598-4a89-b05e-3c1f35e851cf None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:12.372005 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5952603-2598-4a89-b05e-3c1f35e851cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:12.393821 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-a5952603-2598-4a89-b05e-3c1f35e851cf None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:12.395040 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-a5952603-2598-4a89-b05e-3c1f35e851cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:12.403128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1389/2791] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:12.407499 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d7807-2312-407d-ba09-c752d3e6a1f3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:12.417549 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d7807-2312-407d-ba09-c752d3e6a1f3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:12.422196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be78f5-2beb-4c4a-8d8c-b5fb173ef460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:12.423363 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be78f5-2beb-4c4a-8d8c-b5fb173ef460 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:12.423646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be78f5-2beb-4c4a-8d8c-b5fb173ef460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:12.423926 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be78f5-2beb-4c4a-8d8c-b5fb173ef460 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:12.424690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be78f5-2beb-4c4a-8d8c-b5fb173ef460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:32:12.425001 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be78f5-2beb-4c4a-8d8c-b5fb173ef460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:12.426606 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be78f5-2beb-4c4a-8d8c-b5fb173ef460 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:12.438914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1403/2792] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:32:12.443289 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5952603-2598-4a89-b05e-3c1f35e851cf None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:12.449006 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:12.452839 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5952603-2598-4a89-b05e-3c1f35e851cf None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:12.458688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b3e3c-87dc-48fa-920c-382830a8c95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:12.459385 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b3e3c-87dc-48fa-920c-382830a8c95c admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:12.460003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b3e3c-87dc-48fa-920c-382830a8c95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:12.460815 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b3e3c-87dc-48fa-920c-382830a8c95c admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:12.461003 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b3e3c-87dc-48fa-920c-382830a8c95c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:12.462916 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b3e3c-87dc-48fa-920c-382830a8c95c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:12.490667 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1390/2793] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:32:12 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:32:12.494749 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be78f5-2beb-4c4a-8d8c-b5fb173ef460 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:12.505729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be78f5-2beb-4c4a-8d8c-b5fb173ef460 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:12.561201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85df51-78f0-4188-9d03-e21814cf229a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:12.561875 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85df51-78f0-4188-9d03-e21814cf229a admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:12.562160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85df51-78f0-4188-9d03-e21814cf229a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:12.562438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85df51-78f0-4188-9d03-e21814cf229a admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:12.563718 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85df51-78f0-4188-9d03-e21814cf229a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:12.565681 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85df51-78f0-4188-9d03-e21814cf229a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:12.587521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1404/2794] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:32:12 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:32:12.591572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b3e3c-87dc-48fa-920c-382830a8c95c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:12.616737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b3e3c-87dc-48fa-920c-382830a8c95c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:12.627822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd859114-ad02-4a6c-a532-33c6febd9e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:12.628561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd859114-ad02-4a6c-a532-33c6febd9e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:12.628855 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd859114-ad02-4a6c-a532-33c6febd9e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:12.629123 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd859114-ad02-4a6c-a532-33c6febd9e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:12.629862 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd859114-ad02-4a6c-a532-33c6febd9e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:12.631497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd859114-ad02-4a6c-a532-33c6febd9e8c admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:12.646138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1391/2795] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:32:12.652927 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85df51-78f0-4188-9d03-e21814cf229a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:12.668819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85df51-78f0-4188-9d03-e21814cf229a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:12.675869 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d4dc1-d132-4d8d-8b1c-79619b9c470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:12.677024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d4dc1-d132-4d8d-8b1c-79619b9c470f admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:12.677024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d4dc1-d132-4d8d-8b1c-79619b9c470f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:12.677217 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d4dc1-d132-4d8d-8b1c-79619b9c470f admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:12.678019 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d4dc1-d132-4d8d-8b1c-79619b9c470f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:12.679626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d4dc1-d132-4d8d-8b1c-79619b9c470f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:12.691301 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1405/2796] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:32:12.695797 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd859114-ad02-4a6c-a532-33c6febd9e8c admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:12.707514 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd859114-ad02-4a6c-a532-33c6febd9e8c admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:12.712626 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913b115-1861-4709-843d-b50acf68911f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:12.713665 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b115-1861-4709-843d-b50acf68911f admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:12.713957 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b115-1861-4709-843d-b50acf68911f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:12.714216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b115-1861-4709-843d-b50acf68911f admin admin] PATH_INFO: `/v3/projects/ea513afa87a1479aa36d60050877251f/users/c60fa3c0e29f47e080cf98ce5296c0d4/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:12.732718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913b115-1861-4709-843d-b50acf68911f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea513afa87a1479aa36d60050877251f, user_id=c60fa3c0e29f47e080cf98ce5296c0d4, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:12.736219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913b115-1861-4709-843d-b50acf68911f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:12.751019 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1392/2797] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:32:12 2022] PUT /identity/v3/projects/ea513afa87a1479aa36d60050877251f/users/c60fa3c0e29f47e080cf98ce5296c0d4/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:12.756444 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885380c-63a2-4a97-a523-fecf10e0be4c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:12.756735 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885380c-63a2-4a97-a523-fecf10e0be4c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:12.757026 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885380c-63a2-4a97-a523-fecf10e0be4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:12.776047 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8885380c-63a2-4a97-a523-fecf10e0be4c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:12.777299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8885380c-63a2-4a97-a523-fecf10e0be4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:12.839380 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1406/2798] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:12.849852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913b115-1861-4709-843d-b50acf68911f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:12.851688 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-7913b115-1861-4709-843d-b50acf68911f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:12.916403 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913b115-1861-4709-843d-b50acf68911f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:12.921177 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3996ea-8b96-413a-a9d2-5ca3d7e2d615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:12.921912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3996ea-8b96-413a-a9d2-5ca3d7e2d615 service neutron] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:12.922257 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3996ea-8b96-413a-a9d2-5ca3d7e2d615 service neutron] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:12.923255 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3996ea-8b96-413a-a9d2-5ca3d7e2d615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:12.935750 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3996ea-8b96-413a-a9d2-5ca3d7e2d615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:12.937492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3996ea-8b96-413a-a9d2-5ca3d7e2d615 service neutron] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:12.963056 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1393/2799] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:13.700009 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f451aa-cc43-41b2-b4ef-6fa1ebd1d03d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:13.700576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f451aa-cc43-41b2-b4ef-6fa1ebd1d03d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:13.700854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f451aa-cc43-41b2-b4ef-6fa1ebd1d03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:13.728991 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-68f451aa-cc43-41b2-b4ef-6fa1ebd1d03d None None] MFA Rules not processed for user `c60fa3c0e29f47e080cf98ce5296c0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:13.730280 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-68f451aa-cc43-41b2-b4ef-6fa1ebd1d03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:13.771760 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:13.810006 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1407/2800] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:13.814636 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3996ea-8b96-413a-a9d2-5ca3d7e2d615 service neutron] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:13.824760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3996ea-8b96-413a-a9d2-5ca3d7e2d615 service neutron] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:13.829939 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589b955-8d00-4448-843e-a7fa04efcea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:13.830617 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589b955-8d00-4448-843e-a7fa04efcea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:13.830901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589b955-8d00-4448-843e-a7fa04efcea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:13.831172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589b955-8d00-4448-843e-a7fa04efcea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:13.831856 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589b955-8d00-4448-843e-a7fa04efcea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:13.833804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589b955-8d00-4448-843e-a7fa04efcea3 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:13.862983 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1394/2801] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:32:13 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:32:13.866725 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f451aa-cc43-41b2-b4ef-6fa1ebd1d03d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:13.878309 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f451aa-cc43-41b2-b4ef-6fa1ebd1d03d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:13.941160 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd024f44-00b9-4600-8d39-98173a862b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:13.941753 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024f44-00b9-4600-8d39-98173a862b05 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:13.942032 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024f44-00b9-4600-8d39-98173a862b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:13.942309 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024f44-00b9-4600-8d39-98173a862b05 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:13.943007 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd024f44-00b9-4600-8d39-98173a862b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:13.944958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd024f44-00b9-4600-8d39-98173a862b05 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:13.966211 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1408/2802] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:32:13 2022] POST /identity/v3/users => generated 308 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:32:13.970440 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589b955-8d00-4448-843e-a7fa04efcea3 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:13.980780 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589b955-8d00-4448-843e-a7fa04efcea3 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:13.986031 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc72f5-9bfb-4935-a81f-03e663887e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:13.986714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc72f5-9bfb-4935-a81f-03e663887e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:13.987025 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc72f5-9bfb-4935-a81f-03e663887e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:13.987332 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc72f5-9bfb-4935-a81f-03e663887e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:13.988056 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc72f5-9bfb-4935-a81f-03e663887e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:13.989754 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc72f5-9bfb-4935-a81f-03e663887e07 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:14.001160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1395/2803] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:32:14.005250 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd024f44-00b9-4600-8d39-98173a862b05 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:14.015278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd024f44-00b9-4600-8d39-98173a862b05 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:14.020660 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c2d0d-1de8-4272-89f7-fb0f2b203a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:14.021551 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c2d0d-1de8-4272-89f7-fb0f2b203a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:14.021835 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c2d0d-1de8-4272-89f7-fb0f2b203a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:14.022199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c2d0d-1de8-4272-89f7-fb0f2b203a38 admin admin] PATH_INFO: `/v3/projects/c6b11769cc9a491d975843bb8cf0c5d2/users/e976c2cb9474476399b87d4e8868140d/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:14.038824 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c2d0d-1de8-4272-89f7-fb0f2b203a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b11769cc9a491d975843bb8cf0c5d2, user_id=e976c2cb9474476399b87d4e8868140d, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:14.041528 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c2d0d-1de8-4272-89f7-fb0f2b203a38 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:14.054680 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1409/2804] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:32:14 2022] PUT /identity/v3/projects/c6b11769cc9a491d975843bb8cf0c5d2/users/e976c2cb9474476399b87d4e8868140d/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:14.058914 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc72f5-9bfb-4935-a81f-03e663887e07 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:14.069132 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc72f5-9bfb-4935-a81f-03e663887e07 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:14.129677 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd57db0-6cdf-4678-8d02-60ef3ba3e912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:14.130352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd57db0-6cdf-4678-8d02-60ef3ba3e912 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:14.130631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd57db0-6cdf-4678-8d02-60ef3ba3e912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:14.130930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd57db0-6cdf-4678-8d02-60ef3ba3e912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:14.131655 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd57db0-6cdf-4678-8d02-60ef3ba3e912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:14.133317 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd57db0-6cdf-4678-8d02-60ef3ba3e912 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:14.143743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1396/2805] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:32:14.148065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c2d0d-1de8-4272-89f7-fb0f2b203a38 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:14.158589 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c2d0d-1de8-4272-89f7-fb0f2b203a38 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:14.163842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef822573-e818-4792-84e3-32e62ebefbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:14.164750 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef822573-e818-4792-84e3-32e62ebefbd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:14.165027 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef822573-e818-4792-84e3-32e62ebefbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:14.165300 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef822573-e818-4792-84e3-32e62ebefbd0 admin admin] PATH_INFO: `/v3/projects/c6b11769cc9a491d975843bb8cf0c5d2/users/e976c2cb9474476399b87d4e8868140d/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:14.167262 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef822573-e818-4792-84e3-32e62ebefbd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b11769cc9a491d975843bb8cf0c5d2, user_id=e976c2cb9474476399b87d4e8868140d, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:14.169912 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef822573-e818-4792-84e3-32e62ebefbd0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:14.181736 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1410/2806] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:32:14 2022] PUT /identity/v3/projects/c6b11769cc9a491d975843bb8cf0c5d2/users/e976c2cb9474476399b87d4e8868140d/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:14.855152 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67759a1b-8958-45a4-b723-cf0d90aad4f7 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:14.855694 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67759a1b-8958-45a4-b723-cf0d90aad4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:14.855871 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67759a1b-8958-45a4-b723-cf0d90aad4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:14.885569 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:14.890447 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-67759a1b-8958-45a4-b723-cf0d90aad4f7 None None] MFA Rules not processed for user `e976c2cb9474476399b87d4e8868140d`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:14.900617 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-67759a1b-8958-45a4-b723-cf0d90aad4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:14.988336 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1397/2807] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:14 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:15.574140 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adf491-6388-429d-a1b4-158cb0282044 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:15.574988 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adf491-6388-429d-a1b4-158cb0282044 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:15.575269 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adf491-6388-429d-a1b4-158cb0282044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:15.600825 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b3adf491-6388-429d-a1b4-158cb0282044 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:15.602166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b3adf491-6388-429d-a1b4-158cb0282044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:15.667984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1411/2808] 10.222.0.99 () {58 vars in 1016 bytes} [Mon Jul 25 16:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:15.690784 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67759a1b-8958-45a4-b723-cf0d90aad4f7 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:15.692193 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-67759a1b-8958-45a4-b723-cf0d90aad4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:15.773055 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67759a1b-8958-45a4-b723-cf0d90aad4f7 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:15.778799 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53a605-3d01-412e-a276-56ba725c59a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:15.779544 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53a605-3d01-412e-a276-56ba725c59a9 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:15.779825 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53a605-3d01-412e-a276-56ba725c59a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:15.780098 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53a605-3d01-412e-a276-56ba725c59a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:15.789484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53a605-3d01-412e-a276-56ba725c59a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:15.791156 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53a605-3d01-412e-a276-56ba725c59a9 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:15.802083 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1398/2809] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:32:16.159384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adf491-6388-429d-a1b4-158cb0282044 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:16.170782 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adf491-6388-429d-a1b4-158cb0282044 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:16.176151 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1e960-316e-4018-b441-c91522bf03fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:16.177089 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1e960-316e-4018-b441-c91522bf03fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:16.177376 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1e960-316e-4018-b441-c91522bf03fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:16.177656 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1e960-316e-4018-b441-c91522bf03fd admin admin] PATH_INFO: `/v3/users/c60fa3c0e29f47e080cf98ce5296c0d4` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:16.178998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1e960-316e-4018-b441-c91522bf03fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60fa3c0e29f47e080cf98ce5296c0d4)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:16.181176 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1e960-316e-4018-b441-c91522bf03fd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:16.206121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:16.238948 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82e1e960-316e-4018-b441-c91522bf03fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60fa3c0e29f47e080cf98ce5296c0d4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:16.239831 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82e1e960-316e-4018-b441-c91522bf03fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60fa3c0e29f47e080cf98ce5296c0d4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:16.240492 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82e1e960-316e-4018-b441-c91522bf03fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60fa3c0e29f47e080cf98ce5296c0d4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:16.247669 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82e1e960-316e-4018-b441-c91522bf03fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60fa3c0e29f47e080cf98ce5296c0d4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:16.258306 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82e1e960-316e-4018-b441-c91522bf03fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60fa3c0e29f47e080cf98ce5296c0d4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:16.275914 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1412/2810] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:32:16 2022] DELETE /identity/v3/users/c60fa3c0e29f47e080cf98ce5296c0d4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:32:16.479426 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53a605-3d01-412e-a276-56ba725c59a9 service nova] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:16.496267 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53a605-3d01-412e-a276-56ba725c59a9 service nova] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:16.562280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d6d13-5b66-41cd-9da2-e6f838241315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:16.563253 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d6d13-5b66-41cd-9da2-e6f838241315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:16.563536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d6d13-5b66-41cd-9da2-e6f838241315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:16.563813 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d6d13-5b66-41cd-9da2-e6f838241315 admin admin] PATH_INFO: `/v3/projects/ea513afa87a1479aa36d60050877251f` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:16.565075 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d6d13-5b66-41cd-9da2-e6f838241315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea513afa87a1479aa36d60050877251f)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:16.566988 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d6d13-5b66-41cd-9da2-e6f838241315 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:16.600472 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:16.617944 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bf4d6d13-5b66-41cd-9da2-e6f838241315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea513afa87a1479aa36d60050877251f', 'request_id': 'req-bf4d6d13-5b66-41cd-9da2-e6f838241315'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:16.626149 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bf4d6d13-5b66-41cd-9da2-e6f838241315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea513afa87a1479aa36d60050877251f', 'request_id': 'req-bf4d6d13-5b66-41cd-9da2-e6f838241315'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:16.632650 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bf4d6d13-5b66-41cd-9da2-e6f838241315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea513afa87a1479aa36d60050877251f', 'request_id': 'req-bf4d6d13-5b66-41cd-9da2-e6f838241315'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:16.643635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bf4d6d13-5b66-41cd-9da2-e6f838241315 admin admin] The token cache is being invalidate because project ea513afa87a1479aa36d60050877251f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:32:16.643926 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bf4d6d13-5b66-41cd-9da2-e6f838241315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:16.644592 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-bf4d6d13-5b66-41cd-9da2-e6f838241315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:16.646192 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1399/2811] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:32:16 2022] DELETE /identity/v3/projects/ea513afa87a1479aa36d60050877251f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:16.650857 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1e960-316e-4018-b441-c91522bf03fd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:16.652704 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-82e1e960-316e-4018-b441-c91522bf03fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:16.667014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1e960-316e-4018-b441-c91522bf03fd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:16.726771 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893a86f-b9ba-4eca-8877-472249a6db7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:16.727647 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893a86f-b9ba-4eca-8877-472249a6db7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:16.727926 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893a86f-b9ba-4eca-8877-472249a6db7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:16.728223 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893a86f-b9ba-4eca-8877-472249a6db7e admin admin] PATH_INFO: `/v3/users/e976c2cb9474476399b87d4e8868140d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:16.729443 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893a86f-b9ba-4eca-8877-472249a6db7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e976c2cb9474476399b87d4e8868140d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:16.731477 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893a86f-b9ba-4eca-8877-472249a6db7e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:16.785058 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4893a86f-b9ba-4eca-8877-472249a6db7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e976c2cb9474476399b87d4e8868140d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:16.786349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4893a86f-b9ba-4eca-8877-472249a6db7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e976c2cb9474476399b87d4e8868140d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:16.787048 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4893a86f-b9ba-4eca-8877-472249a6db7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e976c2cb9474476399b87d4e8868140d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:16.794112 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4893a86f-b9ba-4eca-8877-472249a6db7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e976c2cb9474476399b87d4e8868140d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:16.802322 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4893a86f-b9ba-4eca-8877-472249a6db7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e976c2cb9474476399b87d4e8868140d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:16.820842 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1413/2812] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:32:16 2022] DELETE /identity/v3/users/e976c2cb9474476399b87d4e8868140d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:17.006799 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d6d13-5b66-41cd-9da2-e6f838241315 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:17.008240 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-bf4d6d13-5b66-41cd-9da2-e6f838241315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:17.021848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d6d13-5b66-41cd-9da2-e6f838241315 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:17.078290 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3351602-2884-43e6-aee8-b0b3232b9b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:17.079187 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3351602-2884-43e6-aee8-b0b3232b9b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:17.079474 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3351602-2884-43e6-aee8-b0b3232b9b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:17.079751 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3351602-2884-43e6-aee8-b0b3232b9b96 admin admin] PATH_INFO: `/v3/projects/c6b11769cc9a491d975843bb8cf0c5d2` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:17.081084 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3351602-2884-43e6-aee8-b0b3232b9b96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b11769cc9a491d975843bb8cf0c5d2)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:17.082995 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3351602-2884-43e6-aee8-b0b3232b9b96 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:17.131110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e3351602-2884-43e6-aee8-b0b3232b9b96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b11769cc9a491d975843bb8cf0c5d2', 'request_id': 'req-e3351602-2884-43e6-aee8-b0b3232b9b96'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:17.139016 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e3351602-2884-43e6-aee8-b0b3232b9b96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b11769cc9a491d975843bb8cf0c5d2', 'request_id': 'req-e3351602-2884-43e6-aee8-b0b3232b9b96'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:17.145374 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e3351602-2884-43e6-aee8-b0b3232b9b96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b11769cc9a491d975843bb8cf0c5d2', 'request_id': 'req-e3351602-2884-43e6-aee8-b0b3232b9b96'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:17.156085 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e3351602-2884-43e6-aee8-b0b3232b9b96 admin admin] The token cache is being invalidate because project c6b11769cc9a491d975843bb8cf0c5d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:32:17.156465 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e3351602-2884-43e6-aee8-b0b3232b9b96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:17.157651 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-e3351602-2884-43e6-aee8-b0b3232b9b96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:17.159680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1400/2813] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:32:17 2022] DELETE /identity/v3/projects/c6b11769cc9a491d975843bb8cf0c5d2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:17.165025 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da395471-e2fd-4597-8fd2-1a290ceec4fb None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:17.165318 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da395471-e2fd-4597-8fd2-1a290ceec4fb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:17.165592 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da395471-e2fd-4597-8fd2-1a290ceec4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:17.186053 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-da395471-e2fd-4597-8fd2-1a290ceec4fb None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:17.187271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-da395471-e2fd-4597-8fd2-1a290ceec4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:17.199970 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:17.249256 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1414/2814] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:17.257700 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b30ed-5952-4b70-a115-e2bad24e28fd None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:17.257991 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b30ed-5952-4b70-a115-e2bad24e28fd None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:17.258266 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b30ed-5952-4b70-a115-e2bad24e28fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:17.278484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-b79b30ed-5952-4b70-a115-e2bad24e28fd None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:17.279694 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-b79b30ed-5952-4b70-a115-e2bad24e28fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:17.287975 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1401/2815] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:17.292424 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da395471-e2fd-4597-8fd2-1a290ceec4fb None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:17.302078 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da395471-e2fd-4597-8fd2-1a290ceec4fb None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:17.306654 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58a198-beb5-402d-b227-ff0333f26041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:17.307338 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58a198-beb5-402d-b227-ff0333f26041 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:17.307626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58a198-beb5-402d-b227-ff0333f26041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:17.307905 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58a198-beb5-402d-b227-ff0333f26041 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:17.308655 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58a198-beb5-402d-b227-ff0333f26041 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:32:17.308964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58a198-beb5-402d-b227-ff0333f26041 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:17.310548 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58a198-beb5-402d-b227-ff0333f26041 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:17.322919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1415/2816] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 16:32:17.327680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b30ed-5952-4b70-a115-e2bad24e28fd None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:17.337803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b30ed-5952-4b70-a115-e2bad24e28fd None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:17.342807 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea164ad1-ea6f-4afe-bac3-f340423f2d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:17.343167 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea164ad1-ea6f-4afe-bac3-f340423f2d21 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:17.343451 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea164ad1-ea6f-4afe-bac3-f340423f2d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:17.343724 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea164ad1-ea6f-4afe-bac3-f340423f2d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:17.344477 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea164ad1-ea6f-4afe-bac3-f340423f2d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:17.346402 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea164ad1-ea6f-4afe-bac3-f340423f2d21 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:17.374572 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1402/2817] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:32:17 2022] POST /identity/v3/projects => generated 357 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:32:17.379281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58a198-beb5-402d-b227-ff0333f26041 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:17.389513 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58a198-beb5-402d-b227-ff0333f26041 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:17.447890 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12960278-82ff-4467-aae1-7c7288bae5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:17.448634 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12960278-82ff-4467-aae1-7c7288bae5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:17.448933 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12960278-82ff-4467-aae1-7c7288bae5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:17.449239 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12960278-82ff-4467-aae1-7c7288bae5e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:17.449969 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12960278-82ff-4467-aae1-7c7288bae5e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:17.451958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12960278-82ff-4467-aae1-7c7288bae5e3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:17.476080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1416/2818] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:32:17 2022] POST /identity/v3/users => generated 279 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:32:17.480686 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea164ad1-ea6f-4afe-bac3-f340423f2d21 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:17.491786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea164ad1-ea6f-4afe-bac3-f340423f2d21 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:17.496648 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16de481-6828-4125-bac2-5f5a3d2addee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:17.497334 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de481-6828-4125-bac2-5f5a3d2addee admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:17.497618 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de481-6828-4125-bac2-5f5a3d2addee admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:17.497893 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de481-6828-4125-bac2-5f5a3d2addee admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:17.498628 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16de481-6828-4125-bac2-5f5a3d2addee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:17.500281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16de481-6828-4125-bac2-5f5a3d2addee admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:17.512456 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1403/2819] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:32:17.516915 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12960278-82ff-4467-aae1-7c7288bae5e3 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:17.527323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12960278-82ff-4467-aae1-7c7288bae5e3 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:17.532102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4af14-b057-4757-9627-fad4c3e0c9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:17.532815 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4af14-b057-4757-9627-fad4c3e0c9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:17.533096 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4af14-b057-4757-9627-fad4c3e0c9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:17.533384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4af14-b057-4757-9627-fad4c3e0c9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:17.534112 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4af14-b057-4757-9627-fad4c3e0c9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:17.535980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4af14-b057-4757-9627-fad4c3e0c9f4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:17.549267 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1417/2820] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:32:17.553479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16de481-6828-4125-bac2-5f5a3d2addee admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:17.561197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:17.567228 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16de481-6828-4125-bac2-5f5a3d2addee admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:17.574498 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaea3b-710d-4d68-b389-a8b540d5084d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:17.575483 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaea3b-710d-4d68-b389-a8b540d5084d admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:17.575830 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaea3b-710d-4d68-b389-a8b540d5084d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:17.576178 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaea3b-710d-4d68-b389-a8b540d5084d admin admin] PATH_INFO: `/v3/projects/88a04141456845d592325faffd0cbbe3/users/fb5e8fb416ea4194962a090b4132a935/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:17.597364 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfaea3b-710d-4d68-b389-a8b540d5084d admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a04141456845d592325faffd0cbbe3, user_id=fb5e8fb416ea4194962a090b4132a935, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:17.600021 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfaea3b-710d-4d68-b389-a8b540d5084d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:17.614016 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1404/2821] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:32:17 2022] PUT /identity/v3/projects/88a04141456845d592325faffd0cbbe3/users/fb5e8fb416ea4194962a090b4132a935/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:17.626457 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cb421-3188-4bb1-9447-82e790f08a75 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:17.626750 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cb421-3188-4bb1-9447-82e790f08a75 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:17.627024 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cb421-3188-4bb1-9447-82e790f08a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:17.656358 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c78cb421-3188-4bb1-9447-82e790f08a75 None None] MFA Rules not processed for user `fb5e8fb416ea4194962a090b4132a935`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:17.657548 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c78cb421-3188-4bb1-9447-82e790f08a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:17.724435 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1418/2822] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:17 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:17.728875 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaea3b-710d-4d68-b389-a8b540d5084d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:17.789959 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaea3b-710d-4d68-b389-a8b540d5084d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:17.794547 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f0636-23f0-44a4-86ef-58bd6154b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:17.795200 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f0636-23f0-44a4-86ef-58bd6154b4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:17.795482 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f0636-23f0-44a4-86ef-58bd6154b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:17.795756 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f0636-23f0-44a4-86ef-58bd6154b4a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:17.796482 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f0636-23f0-44a4-86ef-58bd6154b4a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:17.798912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f0636-23f0-44a4-86ef-58bd6154b4a4 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:17.825484 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1405/2823] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:32:17 2022] POST /identity/v3/projects => generated 357 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:32:17.829705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cb421-3188-4bb1-9447-82e790f08a75 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:17.840701 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cb421-3188-4bb1-9447-82e790f08a75 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:17.852121 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:17.901634 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d72f0e-3133-4594-931e-4da088433f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:17.902305 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d72f0e-3133-4594-931e-4da088433f12 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:17.902583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d72f0e-3133-4594-931e-4da088433f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:17.902854 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d72f0e-3133-4594-931e-4da088433f12 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:17.903534 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d72f0e-3133-4594-931e-4da088433f12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:17.905456 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d72f0e-3133-4594-931e-4da088433f12 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:17.934284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1419/2824] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:32:17 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:32:17.938470 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f0636-23f0-44a4-86ef-58bd6154b4a4 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:17.949370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f0636-23f0-44a4-86ef-58bd6154b4a4 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:17.954133 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340af78-2fa5-4924-a0f7-87f797750a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:17.954806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340af78-2fa5-4924-a0f7-87f797750a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:17.955086 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340af78-2fa5-4924-a0f7-87f797750a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:17.955362 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340af78-2fa5-4924-a0f7-87f797750a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:17.956087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340af78-2fa5-4924-a0f7-87f797750a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:17.957731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340af78-2fa5-4924-a0f7-87f797750a6f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:17.972885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1406/2825] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:32:17.977568 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d72f0e-3133-4594-931e-4da088433f12 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:17.990572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d72f0e-3133-4594-931e-4da088433f12 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:17.995660 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dedf9-8fb7-459e-aff0-319b664e2009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:17.996806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dedf9-8fb7-459e-aff0-319b664e2009 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:17.996952 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dedf9-8fb7-459e-aff0-319b664e2009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:17.997104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dedf9-8fb7-459e-aff0-319b664e2009 admin admin] PATH_INFO: `/v3/projects/3afa64b90bb14650b1b273f0bbc699d7/users/45efbdf7641f475da4a3da05fe8d57b7/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:18.013034 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dedf9-8fb7-459e-aff0-319b664e2009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3afa64b90bb14650b1b273f0bbc699d7, user_id=45efbdf7641f475da4a3da05fe8d57b7, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:18.015817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dedf9-8fb7-459e-aff0-319b664e2009 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:18.029637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1420/2826] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:32:17 2022] PUT /identity/v3/projects/3afa64b90bb14650b1b273f0bbc699d7/users/45efbdf7641f475da4a3da05fe8d57b7/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:18.034426 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340af78-2fa5-4924-a0f7-87f797750a6f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:18.045097 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340af78-2fa5-4924-a0f7-87f797750a6f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:18.103160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bf716-a84b-4927-8c98-63a0e21835bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:18.103848 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bf716-a84b-4927-8c98-63a0e21835bb admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:18.104135 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bf716-a84b-4927-8c98-63a0e21835bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:18.104444 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bf716-a84b-4927-8c98-63a0e21835bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:18.105188 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bf716-a84b-4927-8c98-63a0e21835bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:18.106844 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bf716-a84b-4927-8c98-63a0e21835bb admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:18.119452 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1407/2827] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:32:18.123750 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dedf9-8fb7-459e-aff0-319b664e2009 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:18.134766 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dedf9-8fb7-459e-aff0-319b664e2009 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:18.140025 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14133b-8aa9-4a8b-a5cd-a7d1510939ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:18.141456 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14133b-8aa9-4a8b-a5cd-a7d1510939ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:18.141456 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14133b-8aa9-4a8b-a5cd-a7d1510939ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:18.141668 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14133b-8aa9-4a8b-a5cd-a7d1510939ae admin admin] PATH_INFO: `/v3/projects/3afa64b90bb14650b1b273f0bbc699d7/users/45efbdf7641f475da4a3da05fe8d57b7/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:18.143556 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14133b-8aa9-4a8b-a5cd-a7d1510939ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3afa64b90bb14650b1b273f0bbc699d7, user_id=45efbdf7641f475da4a3da05fe8d57b7, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:18.146242 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14133b-8aa9-4a8b-a5cd-a7d1510939ae admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:18.158120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1421/2828] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:32:18 2022] PUT /identity/v3/projects/3afa64b90bb14650b1b273f0bbc699d7/users/45efbdf7641f475da4a3da05fe8d57b7/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:18.169558 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd4740-639f-483f-b87f-b5540dc6ae2e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:18.169850 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd4740-639f-483f-b87f-b5540dc6ae2e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:18.170129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd4740-639f-483f-b87f-b5540dc6ae2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:18.202032 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-f3cd4740-639f-483f-b87f-b5540dc6ae2e None None] MFA Rules not processed for user `45efbdf7641f475da4a3da05fe8d57b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:18.203186 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-f3cd4740-639f-483f-b87f-b5540dc6ae2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:18.247018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:18.277684 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1408/2829] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:18 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:18.289930 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14133b-8aa9-4a8b-a5cd-a7d1510939ae admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:18.291657 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bf14133b-8aa9-4a8b-a5cd-a7d1510939ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:18.350192 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14133b-8aa9-4a8b-a5cd-a7d1510939ae admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:18.353911 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83f072-d12d-424e-86fd-dc62843044b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:18.354558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83f072-d12d-424e-86fd-dc62843044b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:18.354838 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83f072-d12d-424e-86fd-dc62843044b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:18.355107 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83f072-d12d-424e-86fd-dc62843044b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:18.364541 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83f072-d12d-424e-86fd-dc62843044b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:18.365973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83f072-d12d-424e-86fd-dc62843044b8 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:18.375518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1422/2830] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:18 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:18.452983 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd4740-639f-483f-b87f-b5540dc6ae2e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:18.464017 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd4740-639f-483f-b87f-b5540dc6ae2e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:18.467752 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50c068-603e-4a2f-9eb0-5de752c9a5d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:18.468436 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50c068-603e-4a2f-9eb0-5de752c9a5d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:18.468722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50c068-603e-4a2f-9eb0-5de752c9a5d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:18.469002 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50c068-603e-4a2f-9eb0-5de752c9a5d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:18.528630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50c068-603e-4a2f-9eb0-5de752c9a5d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:18.530397 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50c068-603e-4a2f-9eb0-5de752c9a5d6 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:18.544829 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1409/2831] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:18 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:19.929612 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fc310-bcae-45df-bb2b-8c2e0aeb0d7c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:19.930223 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fc310-bcae-45df-bb2b-8c2e0aeb0d7c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:19.930223 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fc310-bcae-45df-bb2b-8c2e0aeb0d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:19.949975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0e8fc310-bcae-45df-bb2b-8c2e0aeb0d7c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:19.951199 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0e8fc310-bcae-45df-bb2b-8c2e0aeb0d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:20.012769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1423/2832] 10.222.0.99 () {58 vars in 1016 bytes} [Mon Jul 25 16:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:20.035619 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50c068-603e-4a2f-9eb0-5de752c9a5d6 service cinder] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:20.037300 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1b50c068-603e-4a2f-9eb0-5de752c9a5d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:20.111211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50c068-603e-4a2f-9eb0-5de752c9a5d6 service cinder] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:20.117747 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5db5a9-aa4d-4daf-81da-6f1efcc5c1ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:20.118410 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5db5a9-aa4d-4daf-81da-6f1efcc5c1ed service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:20.118704 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5db5a9-aa4d-4daf-81da-6f1efcc5c1ed service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:20.118979 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5db5a9-aa4d-4daf-81da-6f1efcc5c1ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:20.129271 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5db5a9-aa4d-4daf-81da-6f1efcc5c1ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:20.130902 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5db5a9-aa4d-4daf-81da-6f1efcc5c1ed service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:20.142828 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1410/2833] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:24.069784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e9791-0567-49a6-b98d-b2e3141bb166 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:24.070583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e9791-0567-49a6-b98d-b2e3141bb166 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:24.070583 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e9791-0567-49a6-b98d-b2e3141bb166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:24.092764 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-800e9791-0567-49a6-b98d-b2e3141bb166 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:24.093998 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-800e9791-0567-49a6-b98d-b2e3141bb166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:24.102553 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1424/2834] 10.222.0.99 () {58 vars in 1016 bytes} [Mon Jul 25 16:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:32:24.130387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5db5a9-aa4d-4daf-81da-6f1efcc5c1ed service nova] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:24.132631 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9a5db5a9-aa4d-4daf-81da-6f1efcc5c1ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:24.157977 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5db5a9-aa4d-4daf-81da-6f1efcc5c1ed service nova] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:24.166316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562de8e-9c73-4ff2-90e9-59ba1f83103e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:24.167248 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562de8e-9c73-4ff2-90e9-59ba1f83103e service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:24.167608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562de8e-9c73-4ff2-90e9-59ba1f83103e service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:24.168083 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562de8e-9c73-4ff2-90e9-59ba1f83103e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:24.178585 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562de8e-9c73-4ff2-90e9-59ba1f83103e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:24.180236 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562de8e-9c73-4ff2-90e9-59ba1f83103e service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:24.192067 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1411/2835] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:28.244117 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd52e24-7724-4fa3-88c0-5a7f897e64c2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:28.244817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd52e24-7724-4fa3-88c0-5a7f897e64c2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:28.244817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd52e24-7724-4fa3-88c0-5a7f897e64c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:28.253629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:28.267284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5dd52e24-7724-4fa3-88c0-5a7f897e64c2 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:28.268979 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5dd52e24-7724-4fa3-88c0-5a7f897e64c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:28.279196 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1425/2836] 10.222.0.99 () {58 vars in 1016 bytes} [Mon Jul 25 16:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:32:28.305462 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562de8e-9c73-4ff2-90e9-59ba1f83103e service nova] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:28.317525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562de8e-9c73-4ff2-90e9-59ba1f83103e service nova] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:28.323400 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949379f5-c39c-4dff-8607-85907365feca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:28.324197 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949379f5-c39c-4dff-8607-85907365feca service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:28.324645 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949379f5-c39c-4dff-8607-85907365feca service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:28.324990 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949379f5-c39c-4dff-8607-85907365feca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:28.346984 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949379f5-c39c-4dff-8607-85907365feca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:28.349046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949379f5-c39c-4dff-8607-85907365feca service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:28.372140 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1412/2837] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:32.487923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237fd5c-1728-4163-9543-f29f8e655b10 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:32.488461 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237fd5c-1728-4163-9543-f29f8e655b10 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:32.488652 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237fd5c-1728-4163-9543-f29f8e655b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:32.511522 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0237fd5c-1728-4163-9543-f29f8e655b10 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:32.512812 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0237fd5c-1728-4163-9543-f29f8e655b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:32.522034 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1426/2838] 10.222.0.99 () {58 vars in 1016 bytes} [Mon Jul 25 16:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:32.550485 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949379f5-c39c-4dff-8607-85907365feca service nova] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:32.563734 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949379f5-c39c-4dff-8607-85907365feca service nova] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:32.570080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03283bb8-c1dc-455c-bb6b-e6c2c0671791 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c455f8d340444b068249213ff504895e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:32.570862 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03283bb8-c1dc-455c-bb6b-e6c2c0671791 service nova] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:32.571214 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03283bb8-c1dc-455c-bb6b-e6c2c0671791 service nova] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:32.571560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03283bb8-c1dc-455c-bb6b-e6c2c0671791 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:32.582203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03283bb8-c1dc-455c-bb6b-e6c2c0671791 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:32.583858 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03283bb8-c1dc-455c-bb6b-e6c2c0671791 service nova] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:32.596508 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1413/2839] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:32:33.888603 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237fd5c-1728-4163-9543-f29f8e655b10 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:33.899694 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237fd5c-1728-4163-9543-f29f8e655b10 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:33.904483 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb85f2-c3f5-4921-9c5d-3033962d4b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:33.905382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb85f2-c3f5-4921-9c5d-3033962d4b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:33.905664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb85f2-c3f5-4921-9c5d-3033962d4b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:33.905941 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb85f2-c3f5-4921-9c5d-3033962d4b95 admin admin] PATH_INFO: `/v3/users/fb5e8fb416ea4194962a090b4132a935` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:33.907949 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb85f2-c3f5-4921-9c5d-3033962d4b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5e8fb416ea4194962a090b4132a935)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:33.909954 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb85f2-c3f5-4921-9c5d-3033962d4b95 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:33.962931 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1dfb85f2-c3f5-4921-9c5d-3033962d4b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5e8fb416ea4194962a090b4132a935'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:33.963642 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1dfb85f2-c3f5-4921-9c5d-3033962d4b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5e8fb416ea4194962a090b4132a935'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:33.964336 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1dfb85f2-c3f5-4921-9c5d-3033962d4b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5e8fb416ea4194962a090b4132a935'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:33.977974 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1dfb85f2-c3f5-4921-9c5d-3033962d4b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5e8fb416ea4194962a090b4132a935'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:33.989789 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1dfb85f2-c3f5-4921-9c5d-3033962d4b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5e8fb416ea4194962a090b4132a935'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:34.009901 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1427/2840] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:32:33 2022] DELETE /identity/v3/users/fb5e8fb416ea4194962a090b4132a935 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:34.014658 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bd4e9-30ac-4777-a553-256cec8a2d48 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:34.015245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bd4e9-30ac-4777-a553-256cec8a2d48 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:34.015245 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bd4e9-30ac-4777-a553-256cec8a2d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:34.037497 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-079bd4e9-30ac-4777-a553-256cec8a2d48 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:34.038762 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-079bd4e9-30ac-4777-a553-256cec8a2d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:34.052473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:34.103760 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1414/2841] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:34.115543 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb85f2-c3f5-4921-9c5d-3033962d4b95 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:34.117505 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1dfb85f2-c3f5-4921-9c5d-3033962d4b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:34.188626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb85f2-c3f5-4921-9c5d-3033962d4b95 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:34.192510 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c76a4e-75cd-4820-acb2-249505e682eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:34.193177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c76a4e-75cd-4820-acb2-249505e682eb service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:34.193465 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c76a4e-75cd-4820-acb2-249505e682eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:34.193746 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c76a4e-75cd-4820-acb2-249505e682eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:34.203412 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c76a4e-75cd-4820-acb2-249505e682eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:34.204907 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c76a4e-75cd-4820-acb2-249505e682eb service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:34.215383 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1428/2842] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:34.531594 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bd4e9-30ac-4777-a553-256cec8a2d48 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:34.533554 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-079bd4e9-30ac-4777-a553-256cec8a2d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:34.546524 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bd4e9-30ac-4777-a553-256cec8a2d48 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:34.552731 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8e77b-115c-4127-b10c-b7b82c67ee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:34.554110 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8e77b-115c-4127-b10c-b7b82c67ee24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:34.554653 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8e77b-115c-4127-b10c-b7b82c67ee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:34.554932 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8e77b-115c-4127-b10c-b7b82c67ee24 admin admin] PATH_INFO: `/v3/projects/88a04141456845d592325faffd0cbbe3` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:34.557536 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8e77b-115c-4127-b10c-b7b82c67ee24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a04141456845d592325faffd0cbbe3)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:34.559799 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8e77b-115c-4127-b10c-b7b82c67ee24 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:34.611341 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-29b8e77b-115c-4127-b10c-b7b82c67ee24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a04141456845d592325faffd0cbbe3', 'request_id': 'req-29b8e77b-115c-4127-b10c-b7b82c67ee24'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:34.619778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-29b8e77b-115c-4127-b10c-b7b82c67ee24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a04141456845d592325faffd0cbbe3', 'request_id': 'req-29b8e77b-115c-4127-b10c-b7b82c67ee24'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:34.627714 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-29b8e77b-115c-4127-b10c-b7b82c67ee24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a04141456845d592325faffd0cbbe3', 'request_id': 'req-29b8e77b-115c-4127-b10c-b7b82c67ee24'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:34.645182 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-29b8e77b-115c-4127-b10c-b7b82c67ee24 admin admin] The token cache is being invalidate because project 88a04141456845d592325faffd0cbbe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:32:34.645479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-29b8e77b-115c-4127-b10c-b7b82c67ee24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:34.646139 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-29b8e77b-115c-4127-b10c-b7b82c67ee24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:34.647712 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1415/2843] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:32:34 2022] DELETE /identity/v3/projects/88a04141456845d592325faffd0cbbe3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:34.651888 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c76a4e-75cd-4820-acb2-249505e682eb service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:34.662788 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c76a4e-75cd-4820-acb2-249505e682eb service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:34.733913 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b55d77-666b-4787-a2f6-ca1c18cbbca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:34.736235 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b55d77-666b-4787-a2f6-ca1c18cbbca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:34.736760 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b55d77-666b-4787-a2f6-ca1c18cbbca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:34.743486 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b55d77-666b-4787-a2f6-ca1c18cbbca5 admin admin] PATH_INFO: `/v3/users/45efbdf7641f475da4a3da05fe8d57b7` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:34.746478 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b55d77-666b-4787-a2f6-ca1c18cbbca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45efbdf7641f475da4a3da05fe8d57b7)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:34.748532 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b55d77-666b-4787-a2f6-ca1c18cbbca5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:34.755013 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:34.816587 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c5b55d77-666b-4787-a2f6-ca1c18cbbca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45efbdf7641f475da4a3da05fe8d57b7'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:34.817331 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c5b55d77-666b-4787-a2f6-ca1c18cbbca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45efbdf7641f475da4a3da05fe8d57b7'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:34.818519 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c5b55d77-666b-4787-a2f6-ca1c18cbbca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45efbdf7641f475da4a3da05fe8d57b7'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:34.826143 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c5b55d77-666b-4787-a2f6-ca1c18cbbca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45efbdf7641f475da4a3da05fe8d57b7'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:34.835423 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c5b55d77-666b-4787-a2f6-ca1c18cbbca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45efbdf7641f475da4a3da05fe8d57b7'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:34.854739 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1429/2844] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:32:34 2022] DELETE /identity/v3/users/45efbdf7641f475da4a3da05fe8d57b7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:35.172553 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8e77b-115c-4127-b10c-b7b82c67ee24 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:35.174094 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-29b8e77b-115c-4127-b10c-b7b82c67ee24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:35.191303 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8e77b-115c-4127-b10c-b7b82c67ee24 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:35.269112 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b383387-a249-4098-b4ec-47f5ea83ab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:35.270087 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b383387-a249-4098-b4ec-47f5ea83ab1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:35.270372 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b383387-a249-4098-b4ec-47f5ea83ab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:35.270655 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b383387-a249-4098-b4ec-47f5ea83ab1d admin admin] PATH_INFO: `/v3/projects/3afa64b90bb14650b1b273f0bbc699d7` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:35.272022 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b383387-a249-4098-b4ec-47f5ea83ab1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3afa64b90bb14650b1b273f0bbc699d7)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:35.274166 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b383387-a249-4098-b4ec-47f5ea83ab1d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:35.326404 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:35.330641 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-4b383387-a249-4098-b4ec-47f5ea83ab1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3afa64b90bb14650b1b273f0bbc699d7', 'request_id': 'req-4b383387-a249-4098-b4ec-47f5ea83ab1d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:35.342585 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-4b383387-a249-4098-b4ec-47f5ea83ab1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3afa64b90bb14650b1b273f0bbc699d7', 'request_id': 'req-4b383387-a249-4098-b4ec-47f5ea83ab1d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:35.351415 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-4b383387-a249-4098-b4ec-47f5ea83ab1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3afa64b90bb14650b1b273f0bbc699d7', 'request_id': 'req-4b383387-a249-4098-b4ec-47f5ea83ab1d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:35.368339 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-4b383387-a249-4098-b4ec-47f5ea83ab1d admin admin] The token cache is being invalidate because project 3afa64b90bb14650b1b273f0bbc699d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:32:35.368809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-4b383387-a249-4098-b4ec-47f5ea83ab1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:35.369835 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-4b383387-a249-4098-b4ec-47f5ea83ab1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:35.372043 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1416/2845] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:32:35 2022] DELETE /identity/v3/projects/3afa64b90bb14650b1b273f0bbc699d7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:32:35.377958 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae501b-43e7-4e75-9443-581b5abac618 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:35.378510 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae501b-43e7-4e75-9443-581b5abac618 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:35.378607 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae501b-43e7-4e75-9443-581b5abac618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:35.408153 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bbae501b-43e7-4e75-9443-581b5abac618 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:35.410343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bbae501b-43e7-4e75-9443-581b5abac618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:35.496236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1430/2846] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:35.507500 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45f98-d871-4ebd-a534-14cfc1e4975e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:35.508001 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45f98-d871-4ebd-a534-14cfc1e4975e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:35.508565 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e45f98-d871-4ebd-a534-14cfc1e4975e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:35.532642 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-93e45f98-d871-4ebd-a534-14cfc1e4975e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:35.533929 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-93e45f98-d871-4ebd-a534-14cfc1e4975e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:35.543945 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1417/2847] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:35.549238 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae501b-43e7-4e75-9443-581b5abac618 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:35.559309 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae501b-43e7-4e75-9443-581b5abac618 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:35.564693 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ce102-2b28-412b-bfaf-ffa3e987b45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:35.565377 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ce102-2b28-412b-bfaf-ffa3e987b45a admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:35.565665 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ce102-2b28-412b-bfaf-ffa3e987b45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:35.565946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ce102-2b28-412b-bfaf-ffa3e987b45a admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:35.566683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ce102-2b28-412b-bfaf-ffa3e987b45a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:32:35.566996 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ce102-2b28-412b-bfaf-ffa3e987b45a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:35.568673 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ce102-2b28-412b-bfaf-ffa3e987b45a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:35.583120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1431/2848] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:32:35.587595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e45f98-d871-4ebd-a534-14cfc1e4975e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:35.598130 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e45f98-d871-4ebd-a534-14cfc1e4975e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:35.602851 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e04ef1-fb5f-4565-ab89-d88dd9ce4e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:35.603555 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e04ef1-fb5f-4565-ab89-d88dd9ce4e15 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:35.603806 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e04ef1-fb5f-4565-ab89-d88dd9ce4e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:35.604081 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e04ef1-fb5f-4565-ab89-d88dd9ce4e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:35.604874 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e04ef1-fb5f-4565-ab89-d88dd9ce4e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:35.606814 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e04ef1-fb5f-4565-ab89-d88dd9ce4e15 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:35.637988 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1418/2849] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:32:35 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:32:35.642694 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ce102-2b28-412b-bfaf-ffa3e987b45a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:35.653913 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ce102-2b28-412b-bfaf-ffa3e987b45a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:35.721662 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ac671-4e6e-461c-8d30-5ac5ac437a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:35.722380 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ac671-4e6e-461c-8d30-5ac5ac437a09 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:35.722665 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ac671-4e6e-461c-8d30-5ac5ac437a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:35.722946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ac671-4e6e-461c-8d30-5ac5ac437a09 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:35.723683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ac671-4e6e-461c-8d30-5ac5ac437a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:35.725739 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ac671-4e6e-461c-8d30-5ac5ac437a09 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:35.754924 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1432/2850] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:32:35 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:32:35.759256 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e04ef1-fb5f-4565-ab89-d88dd9ce4e15 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:35.771121 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e04ef1-fb5f-4565-ab89-d88dd9ce4e15 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:35.776141 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550b481-0127-46f4-88fb-f7677b446e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:35.776862 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550b481-0127-46f4-88fb-f7677b446e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:35.777148 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550b481-0127-46f4-88fb-f7677b446e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:35.777429 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550b481-0127-46f4-88fb-f7677b446e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:35.778185 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550b481-0127-46f4-88fb-f7677b446e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:35.779892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550b481-0127-46f4-88fb-f7677b446e6a admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:35.792992 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1419/2851] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:32:35.797537 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ac671-4e6e-461c-8d30-5ac5ac437a09 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:35.803104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:35.809063 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ac671-4e6e-461c-8d30-5ac5ac437a09 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:35.818732 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c63e33-9614-4d0e-b2ae-e045dc32a71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:35.820102 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c63e33-9614-4d0e-b2ae-e045dc32a71a admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:35.821051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c63e33-9614-4d0e-b2ae-e045dc32a71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:35.821706 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c63e33-9614-4d0e-b2ae-e045dc32a71a admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:35.822885 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c63e33-9614-4d0e-b2ae-e045dc32a71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:35.824863 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c63e33-9614-4d0e-b2ae-e045dc32a71a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:35.838729 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1433/2852] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:32:35.843885 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550b481-0127-46f4-88fb-f7677b446e6a admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:35.857009 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550b481-0127-46f4-88fb-f7677b446e6a admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:35.863160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409a66f-ab3d-45d5-950d-ed237493f855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:35.864198 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409a66f-ab3d-45d5-950d-ed237493f855 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:35.864581 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409a66f-ab3d-45d5-950d-ed237493f855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:35.864938 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409a66f-ab3d-45d5-950d-ed237493f855 admin admin] PATH_INFO: `/v3/projects/c67c1c160ac14bfcb3a8f0f70af7d886/users/130bde0b8a1f4d579defe647feee14c2/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:35.885756 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409a66f-ab3d-45d5-950d-ed237493f855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67c1c160ac14bfcb3a8f0f70af7d886, user_id=130bde0b8a1f4d579defe647feee14c2, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:35.889630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409a66f-ab3d-45d5-950d-ed237493f855 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:35.909546 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1420/2853] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:32:35 2022] PUT /identity/v3/projects/c67c1c160ac14bfcb3a8f0f70af7d886/users/130bde0b8a1f4d579defe647feee14c2/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:32:35.921054 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946646e6-bbb0-4d20-9b31-5da368841fe4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:35.921371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946646e6-bbb0-4d20-9b31-5da368841fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:35.921785 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946646e6-bbb0-4d20-9b31-5da368841fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:35.956904 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-946646e6-bbb0-4d20-9b31-5da368841fe4 None None] MFA Rules not processed for user `130bde0b8a1f4d579defe647feee14c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:35.958169 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-946646e6-bbb0-4d20-9b31-5da368841fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:36.033928 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1434/2854] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:36.038846 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409a66f-ab3d-45d5-950d-ed237493f855 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:36.112842 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409a66f-ab3d-45d5-950d-ed237493f855 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:36.118594 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac7e0c-06bc-4086-8e96-ca9f838d53af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:36.119309 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac7e0c-06bc-4086-8e96-ca9f838d53af admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:36.119589 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac7e0c-06bc-4086-8e96-ca9f838d53af admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:36.119863 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac7e0c-06bc-4086-8e96-ca9f838d53af admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:36.120608 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac7e0c-06bc-4086-8e96-ca9f838d53af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:36.122579 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac7e0c-06bc-4086-8e96-ca9f838d53af admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:36.160369 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1421/2855] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:32:36 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:32:36.165437 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946646e6-bbb0-4d20-9b31-5da368841fe4 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:36.177695 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946646e6-bbb0-4d20-9b31-5da368841fe4 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:36.256287 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a786d80-99d1-4db0-970e-24bfb7ef11ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:36.257503 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a786d80-99d1-4db0-970e-24bfb7ef11ef admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:36.257922 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a786d80-99d1-4db0-970e-24bfb7ef11ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:36.258323 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a786d80-99d1-4db0-970e-24bfb7ef11ef admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:36.259425 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a786d80-99d1-4db0-970e-24bfb7ef11ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:36.262870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a786d80-99d1-4db0-970e-24bfb7ef11ef admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:36.293150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1435/2856] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:32:36 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:32:36.297879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac7e0c-06bc-4086-8e96-ca9f838d53af admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:36.309222 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac7e0c-06bc-4086-8e96-ca9f838d53af admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:36.314475 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee673ef-d92b-4093-a0ff-98c29d4e06b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:36.315172 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee673ef-d92b-4093-a0ff-98c29d4e06b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:36.315461 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee673ef-d92b-4093-a0ff-98c29d4e06b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:36.315749 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee673ef-d92b-4093-a0ff-98c29d4e06b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:36.316525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee673ef-d92b-4093-a0ff-98c29d4e06b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:36.318193 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee673ef-d92b-4093-a0ff-98c29d4e06b3 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:36.331049 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1422/2857] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:32:36.337125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a786d80-99d1-4db0-970e-24bfb7ef11ef admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:36.348552 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a786d80-99d1-4db0-970e-24bfb7ef11ef admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:36.354174 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90309076-b9bd-499d-b06c-ab28778dfc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:36.355271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90309076-b9bd-499d-b06c-ab28778dfc42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:36.355593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90309076-b9bd-499d-b06c-ab28778dfc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:36.355902 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90309076-b9bd-499d-b06c-ab28778dfc42 admin admin] PATH_INFO: `/v3/projects/5af6c2ae76184a03866daff34e05bc08/users/3a032406e1b748b2afcbc4675fdbf47a/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:36.373751 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90309076-b9bd-499d-b06c-ab28778dfc42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af6c2ae76184a03866daff34e05bc08, user_id=3a032406e1b748b2afcbc4675fdbf47a, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:36.376549 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90309076-b9bd-499d-b06c-ab28778dfc42 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:36.392149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1436/2858] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:32:36 2022] PUT /identity/v3/projects/5af6c2ae76184a03866daff34e05bc08/users/3a032406e1b748b2afcbc4675fdbf47a/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:36.396854 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee673ef-d92b-4093-a0ff-98c29d4e06b3 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:36.410537 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee673ef-d92b-4093-a0ff-98c29d4e06b3 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:36.486743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:36.509041 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f89702-c067-418a-aef9-ad94cdce7140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:36.509763 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f89702-c067-418a-aef9-ad94cdce7140 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:36.510048 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f89702-c067-418a-aef9-ad94cdce7140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:36.510326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f89702-c067-418a-aef9-ad94cdce7140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:36.511064 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f89702-c067-418a-aef9-ad94cdce7140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:36.512744 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f89702-c067-418a-aef9-ad94cdce7140 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:36.524852 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1423/2859] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:32:36.529598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90309076-b9bd-499d-b06c-ab28778dfc42 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:36.541201 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90309076-b9bd-499d-b06c-ab28778dfc42 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:36.546422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecec914-7d42-44a2-b334-f13446d85fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:36.548005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecec914-7d42-44a2-b334-f13446d85fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:36.548392 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecec914-7d42-44a2-b334-f13446d85fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:36.548673 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecec914-7d42-44a2-b334-f13446d85fe5 admin admin] PATH_INFO: `/v3/projects/5af6c2ae76184a03866daff34e05bc08/users/3a032406e1b748b2afcbc4675fdbf47a/roles/35424ae154084f97aaf54f3fa3c37725` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:36.551005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecec914-7d42-44a2-b334-f13446d85fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af6c2ae76184a03866daff34e05bc08, user_id=3a032406e1b748b2afcbc4675fdbf47a, role_id=35424ae154084f97aaf54f3fa3c37725)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:36.553751 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecec914-7d42-44a2-b334-f13446d85fe5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:36.566547 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1437/2860] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:32:36 2022] PUT /identity/v3/projects/5af6c2ae76184a03866daff34e05bc08/users/3a032406e1b748b2afcbc4675fdbf47a/roles/35424ae154084f97aaf54f3fa3c37725 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:32:36.578515 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a9dce-f7ac-434c-b2ca-65f527fed436 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:36.578985 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a9dce-f7ac-434c-b2ca-65f527fed436 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:36.579412 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a9dce-f7ac-434c-b2ca-65f527fed436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:36.613778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ad9a9dce-f7ac-434c-b2ca-65f527fed436 None None] MFA Rules not processed for user `3a032406e1b748b2afcbc4675fdbf47a`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:36.615035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ad9a9dce-f7ac-434c-b2ca-65f527fed436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:36.741053 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1424/2861] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:32:36.755428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecec914-7d42-44a2-b334-f13446d85fe5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:36.757484 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2ecec914-7d42-44a2-b334-f13446d85fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:36.819479 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:36.866337 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecec914-7d42-44a2-b334-f13446d85fe5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:36.871226 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa5431-8062-4d5e-be5d-c601cc285682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:36.871945 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa5431-8062-4d5e-be5d-c601cc285682 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:36.872372 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa5431-8062-4d5e-be5d-c601cc285682 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:36.872588 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa5431-8062-4d5e-be5d-c601cc285682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:36.891274 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa5431-8062-4d5e-be5d-c601cc285682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:36.906517 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa5431-8062-4d5e-be5d-c601cc285682 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:36.915014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1438/2862] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:32:37.074978 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a9dce-f7ac-434c-b2ca-65f527fed436 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:37.076797 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ad9a9dce-f7ac-434c-b2ca-65f527fed436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:37.090604 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a9dce-f7ac-434c-b2ca-65f527fed436 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:37.094444 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb447b-ebbd-4cab-9446-de314bab67ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:37.095129 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb447b-ebbd-4cab-9446-de314bab67ee service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:37.095437 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb447b-ebbd-4cab-9446-de314bab67ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:37.095713 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb447b-ebbd-4cab-9446-de314bab67ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:37.184827 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb447b-ebbd-4cab-9446-de314bab67ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:37.186310 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb447b-ebbd-4cab-9446-de314bab67ee service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:37.197114 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1425/2863] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 16:32:39.889675 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa5431-8062-4d5e-be5d-c601cc285682 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:39.956386 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa5431-8062-4d5e-be5d-c601cc285682 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:39.961165 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8880a-a6cd-4e63-866d-555ccdf8c994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:39.962065 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8880a-a6cd-4e63-866d-555ccdf8c994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:39.962349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8880a-a6cd-4e63-866d-555ccdf8c994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:39.962629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8880a-a6cd-4e63-866d-555ccdf8c994 admin admin] PATH_INFO: `/v3/users/130bde0b8a1f4d579defe647feee14c2` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:39.963878 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8880a-a6cd-4e63-866d-555ccdf8c994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=130bde0b8a1f4d579defe647feee14c2)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:39.965984 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8880a-a6cd-4e63-866d-555ccdf8c994 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:40.021307 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-71f8880a-a6cd-4e63-866d-555ccdf8c994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '130bde0b8a1f4d579defe647feee14c2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:40.021961 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-71f8880a-a6cd-4e63-866d-555ccdf8c994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '130bde0b8a1f4d579defe647feee14c2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:40.022784 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-71f8880a-a6cd-4e63-866d-555ccdf8c994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '130bde0b8a1f4d579defe647feee14c2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:40.030293 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-71f8880a-a6cd-4e63-866d-555ccdf8c994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '130bde0b8a1f4d579defe647feee14c2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:40.039533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-71f8880a-a6cd-4e63-866d-555ccdf8c994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '130bde0b8a1f4d579defe647feee14c2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:40.057876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1439/2864] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:32:39 2022] DELETE /identity/v3/users/130bde0b8a1f4d579defe647feee14c2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:32:40.062640 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b24934-95d4-4a31-b182-e79d3f6bed9b None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:40.063201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b24934-95d4-4a31-b182-e79d3f6bed9b None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:40.063201 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b24934-95d4-4a31-b182-e79d3f6bed9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:40.083303 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-31b24934-95d4-4a31-b182-e79d3f6bed9b None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:40.084574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-31b24934-95d4-4a31-b182-e79d3f6bed9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:40.157055 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1426/2865] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:40.167281 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8880a-a6cd-4e63-866d-555ccdf8c994 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:40.168951 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-71f8880a-a6cd-4e63-866d-555ccdf8c994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:40.232993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8880a-a6cd-4e63-866d-555ccdf8c994 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:40.236932 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8bf5f-af8a-475b-a20f-6f22252e0647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:40.237601 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8bf5f-af8a-475b-a20f-6f22252e0647 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:40.237889 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8bf5f-af8a-475b-a20f-6f22252e0647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:40.238170 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8bf5f-af8a-475b-a20f-6f22252e0647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:40.249050 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8bf5f-af8a-475b-a20f-6f22252e0647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:40.250529 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8bf5f-af8a-475b-a20f-6f22252e0647 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:40.254930 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:40.263236 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1440/2866] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:40.577704 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b24934-95d4-4a31-b182-e79d3f6bed9b None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:40.579775 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-31b24934-95d4-4a31-b182-e79d3f6bed9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:40.602890 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=100 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:40.607146 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b24934-95d4-4a31-b182-e79d3f6bed9b None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:40.613374 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee760025-3cee-44d0-8605-b097830485f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:40.614362 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee760025-3cee-44d0-8605-b097830485f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:40.614680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee760025-3cee-44d0-8605-b097830485f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:40.615067 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee760025-3cee-44d0-8605-b097830485f8 admin admin] PATH_INFO: `/v3/projects/c67c1c160ac14bfcb3a8f0f70af7d886` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:40.616429 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee760025-3cee-44d0-8605-b097830485f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67c1c160ac14bfcb3a8f0f70af7d886)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:40.619026 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee760025-3cee-44d0-8605-b097830485f8 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:40.690637 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ee760025-3cee-44d0-8605-b097830485f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67c1c160ac14bfcb3a8f0f70af7d886', 'request_id': 'req-ee760025-3cee-44d0-8605-b097830485f8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:40.702289 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ee760025-3cee-44d0-8605-b097830485f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67c1c160ac14bfcb3a8f0f70af7d886', 'request_id': 'req-ee760025-3cee-44d0-8605-b097830485f8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:40.710566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ee760025-3cee-44d0-8605-b097830485f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67c1c160ac14bfcb3a8f0f70af7d886', 'request_id': 'req-ee760025-3cee-44d0-8605-b097830485f8'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:40.723434 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ee760025-3cee-44d0-8605-b097830485f8 admin admin] The token cache is being invalidate because project c67c1c160ac14bfcb3a8f0f70af7d886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:32:40.723958 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ee760025-3cee-44d0-8605-b097830485f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:40.724679 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-ee760025-3cee-44d0-8605-b097830485f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:40.726560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1427/2867] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:32:40 2022] DELETE /identity/v3/projects/c67c1c160ac14bfcb3a8f0f70af7d886 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:40.730722 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8bf5f-af8a-475b-a20f-6f22252e0647 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:40.741542 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8bf5f-af8a-475b-a20f-6f22252e0647 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:40.802626 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08296f-1978-45ba-981e-d0a2c3929a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:40.803533 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08296f-1978-45ba-981e-d0a2c3929a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:40.803817 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08296f-1978-45ba-981e-d0a2c3929a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:40.804098 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08296f-1978-45ba-981e-d0a2c3929a2a admin admin] PATH_INFO: `/v3/users/3a032406e1b748b2afcbc4675fdbf47a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:40.805545 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08296f-1978-45ba-981e-d0a2c3929a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a032406e1b748b2afcbc4675fdbf47a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:40.807526 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08296f-1978-45ba-981e-d0a2c3929a2a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:40.861862 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-da08296f-1978-45ba-981e-d0a2c3929a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a032406e1b748b2afcbc4675fdbf47a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:40.862502 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-da08296f-1978-45ba-981e-d0a2c3929a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a032406e1b748b2afcbc4675fdbf47a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:40.863125 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-da08296f-1978-45ba-981e-d0a2c3929a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a032406e1b748b2afcbc4675fdbf47a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:40.870828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-da08296f-1978-45ba-981e-d0a2c3929a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a032406e1b748b2afcbc4675fdbf47a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:40.882093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-da08296f-1978-45ba-981e-d0a2c3929a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a032406e1b748b2afcbc4675fdbf47a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:40.903684 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1441/2868] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:32:40 2022] DELETE /identity/v3/users/3a032406e1b748b2afcbc4675fdbf47a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:32:41.236323 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee760025-3cee-44d0-8605-b097830485f8 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:41.236809 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ee760025-3cee-44d0-8605-b097830485f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:41.254943 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee760025-3cee-44d0-8605-b097830485f8 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:41.319707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd0ff6-992d-47aa-b00c-261d739baa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:41.320647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd0ff6-992d-47aa-b00c-261d739baa82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:41.320930 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd0ff6-992d-47aa-b00c-261d739baa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:41.321207 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd0ff6-992d-47aa-b00c-261d739baa82 admin admin] PATH_INFO: `/v3/projects/5af6c2ae76184a03866daff34e05bc08` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:41.322477 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd0ff6-992d-47aa-b00c-261d739baa82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af6c2ae76184a03866daff34e05bc08)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:41.324501 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd0ff6-992d-47aa-b00c-261d739baa82 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:41.379502 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-85dd0ff6-992d-47aa-b00c-261d739baa82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af6c2ae76184a03866daff34e05bc08', 'request_id': 'req-85dd0ff6-992d-47aa-b00c-261d739baa82'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:41.388847 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-85dd0ff6-992d-47aa-b00c-261d739baa82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af6c2ae76184a03866daff34e05bc08', 'request_id': 'req-85dd0ff6-992d-47aa-b00c-261d739baa82'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:41.398989 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-85dd0ff6-992d-47aa-b00c-261d739baa82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af6c2ae76184a03866daff34e05bc08', 'request_id': 'req-85dd0ff6-992d-47aa-b00c-261d739baa82'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:41.411043 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-85dd0ff6-992d-47aa-b00c-261d739baa82 admin admin] The token cache is being invalidate because project 5af6c2ae76184a03866daff34e05bc08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:32:41.411392 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-85dd0ff6-992d-47aa-b00c-261d739baa82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:41.412028 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-85dd0ff6-992d-47aa-b00c-261d739baa82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:41.413645 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1428/2869] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:32:41 2022] DELETE /identity/v3/projects/5af6c2ae76184a03866daff34e05bc08 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:41.418792 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1e346-d24e-44d3-8b93-dd48799924c4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:41.419084 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1e346-d24e-44d3-8b93-dd48799924c4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:41.419366 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1e346-d24e-44d3-8b93-dd48799924c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:41.439828 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1ab1e346-d24e-44d3-8b93-dd48799924c4 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:41.441081 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1ab1e346-d24e-44d3-8b93-dd48799924c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:41.507973 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1442/2870] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:32:41.574743 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1351a-772c-459a-94dc-0a4f450c7c25 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:41.575062 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1351a-772c-459a-94dc-0a4f450c7c25 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:41.575345 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1351a-772c-459a-94dc-0a4f450c7c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:41.597952 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-9fb1351a-772c-459a-94dc-0a4f450c7c25 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:41.599203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-9fb1351a-772c-459a-94dc-0a4f450c7c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:41.607700 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1429/2871] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:41.612350 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1e346-d24e-44d3-8b93-dd48799924c4 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:41.622090 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1e346-d24e-44d3-8b93-dd48799924c4 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:41.627645 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a098cf-ccae-4481-9cd5-2402608fd031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:41.628343 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a098cf-ccae-4481-9cd5-2402608fd031 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:41.628646 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a098cf-ccae-4481-9cd5-2402608fd031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:41.628900 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a098cf-ccae-4481-9cd5-2402608fd031 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:41.629635 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a098cf-ccae-4481-9cd5-2402608fd031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:32:41.629942 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a098cf-ccae-4481-9cd5-2402608fd031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:41.631629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a098cf-ccae-4481-9cd5-2402608fd031 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:41.648677 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1443/2872] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:32:41.650601 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1351a-772c-459a-94dc-0a4f450c7c25 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:41.660582 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1351a-772c-459a-94dc-0a4f450c7c25 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:41.665707 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2703e4b-ae8f-4b2b-adc3-c06bf32bf3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:41.666383 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2703e4b-ae8f-4b2b-adc3-c06bf32bf3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:41.666669 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2703e4b-ae8f-4b2b-adc3-c06bf32bf3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:41.666941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2703e4b-ae8f-4b2b-adc3-c06bf32bf3f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:41.667652 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2703e4b-ae8f-4b2b-adc3-c06bf32bf3f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:41.669664 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2703e4b-ae8f-4b2b-adc3-c06bf32bf3f5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:41.681128 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:41.706704 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1430/2873] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:32:41 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:32:41.712312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a098cf-ccae-4481-9cd5-2402608fd031 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:41.724222 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:41.730813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a098cf-ccae-4481-9cd5-2402608fd031 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:41.831591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51114aa-1e26-4abf-9828-072c78634d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:41.832429 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51114aa-1e26-4abf-9828-072c78634d62 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:41.832762 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51114aa-1e26-4abf-9828-072c78634d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:41.833136 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51114aa-1e26-4abf-9828-072c78634d62 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:41.833893 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51114aa-1e26-4abf-9828-072c78634d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:41.835919 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51114aa-1e26-4abf-9828-072c78634d62 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:41.861314 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1444/2874] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:32:41 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:32:41.865896 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2703e4b-ae8f-4b2b-adc3-c06bf32bf3f5 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:41.877222 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2703e4b-ae8f-4b2b-adc3-c06bf32bf3f5 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:41.882768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db13094-616e-41a3-af2f-4fdc96039917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:41.883473 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db13094-616e-41a3-af2f-4fdc96039917 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:41.883754 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db13094-616e-41a3-af2f-4fdc96039917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:41.884030 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db13094-616e-41a3-af2f-4fdc96039917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:41.884815 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db13094-616e-41a3-af2f-4fdc96039917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:41.886479 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db13094-616e-41a3-af2f-4fdc96039917 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:41.902603 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1431/2875] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:32:41.907442 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51114aa-1e26-4abf-9828-072c78634d62 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:41.919921 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51114aa-1e26-4abf-9828-072c78634d62 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:41.925166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fc448-a1f1-4368-927c-ee078e27e1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:41.925908 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fc448-a1f1-4368-927c-ee078e27e1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:41.926198 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fc448-a1f1-4368-927c-ee078e27e1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:41.926476 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fc448-a1f1-4368-927c-ee078e27e1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:41.927313 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fc448-a1f1-4368-927c-ee078e27e1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:41.929080 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fc448-a1f1-4368-927c-ee078e27e1f0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:41.943273 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1445/2876] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 16:32:41.947920 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db13094-616e-41a3-af2f-4fdc96039917 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:41.958951 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db13094-616e-41a3-af2f-4fdc96039917 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:41.964804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb32c4f-5271-43ce-95f0-4dbee4d260e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:41.965821 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb32c4f-5271-43ce-95f0-4dbee4d260e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:41.966138 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb32c4f-5271-43ce-95f0-4dbee4d260e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:41.966450 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb32c4f-5271-43ce-95f0-4dbee4d260e5 admin admin] PATH_INFO: `/v3/projects/d0316ca2ae764ec5acf818f00e2fe685/users/4a5f532e3fd046e49e819d135710aaf2/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:41.985044 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb32c4f-5271-43ce-95f0-4dbee4d260e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0316ca2ae764ec5acf818f00e2fe685, user_id=4a5f532e3fd046e49e819d135710aaf2, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:41.987987 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb32c4f-5271-43ce-95f0-4dbee4d260e5 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:42.004235 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1432/2877] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:32:41 2022] PUT /identity/v3/projects/d0316ca2ae764ec5acf818f00e2fe685/users/4a5f532e3fd046e49e819d135710aaf2/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:42.015576 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98845e-7853-4d94-a8a5-7ecb2abf7fa8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:42.016093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98845e-7853-4d94-a8a5-7ecb2abf7fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:42.016664 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98845e-7853-4d94-a8a5-7ecb2abf7fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:42.061622 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bb98845e-7853-4d94-a8a5-7ecb2abf7fa8 None None] MFA Rules not processed for user `4a5f532e3fd046e49e819d135710aaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:42.063769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bb98845e-7853-4d94-a8a5-7ecb2abf7fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:42.154819 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1446/2878] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:32:42.167420 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb32c4f-5271-43ce-95f0-4dbee4d260e5 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:42.169329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-dcb32c4f-5271-43ce-95f0-4dbee4d260e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:42.250767 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb32c4f-5271-43ce-95f0-4dbee4d260e5 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:42.254689 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d911a87-7003-4ba8-a15c-61231b752614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:42.255356 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d911a87-7003-4ba8-a15c-61231b752614 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:42.255635 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d911a87-7003-4ba8-a15c-61231b752614 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:42.255911 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d911a87-7003-4ba8-a15c-61231b752614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:42.265542 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d911a87-7003-4ba8-a15c-61231b752614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:42.267035 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d911a87-7003-4ba8-a15c-61231b752614 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:42.277646 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1433/2879] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:42.318093 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98845e-7853-4d94-a8a5-7ecb2abf7fa8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:42.414743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98845e-7853-4d94-a8a5-7ecb2abf7fa8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:42.419333 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d9a75-bba4-409a-82d6-afd30e22d893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:42.420208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d9a75-bba4-409a-82d6-afd30e22d893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:42.420521 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d9a75-bba4-409a-82d6-afd30e22d893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:42.420798 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d9a75-bba4-409a-82d6-afd30e22d893 admin admin] PATH_INFO: `/v3/users/4a5f532e3fd046e49e819d135710aaf2` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:42.422769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d9a75-bba4-409a-82d6-afd30e22d893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a5f532e3fd046e49e819d135710aaf2)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:42.424734 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d9a75-bba4-409a-82d6-afd30e22d893 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:42.439312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:42.472748 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-553d9a75-bba4-409a-82d6-afd30e22d893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a5f532e3fd046e49e819d135710aaf2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:42.473398 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-553d9a75-bba4-409a-82d6-afd30e22d893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a5f532e3fd046e49e819d135710aaf2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:42.474002 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-553d9a75-bba4-409a-82d6-afd30e22d893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a5f532e3fd046e49e819d135710aaf2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:42.482615 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-553d9a75-bba4-409a-82d6-afd30e22d893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a5f532e3fd046e49e819d135710aaf2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:42.500495 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-553d9a75-bba4-409a-82d6-afd30e22d893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a5f532e3fd046e49e819d135710aaf2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:42.518872 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1447/2880] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:32:42 2022] DELETE /identity/v3/users/4a5f532e3fd046e49e819d135710aaf2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:42.524664 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913285c6-1e2a-4253-ba47-853eac51a26f None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:42.525071 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913285c6-1e2a-4253-ba47-853eac51a26f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:42.525565 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913285c6-1e2a-4253-ba47-853eac51a26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:42.545281 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-913285c6-1e2a-4253-ba47-853eac51a26f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:42.547046 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-913285c6-1e2a-4253-ba47-853eac51a26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:42.608283 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1434/2881] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:32:42.618605 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d9a75-bba4-409a-82d6-afd30e22d893 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:42.620195 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-553d9a75-bba4-409a-82d6-afd30e22d893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:42.681555 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d9a75-bba4-409a-82d6-afd30e22d893 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:42.685411 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1677254-b7fe-4814-8a6c-887775b8e320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:42.686057 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1677254-b7fe-4814-8a6c-887775b8e320 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:42.686342 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1677254-b7fe-4814-8a6c-887775b8e320 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:42.686618 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1677254-b7fe-4814-8a6c-887775b8e320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:42.698597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1677254-b7fe-4814-8a6c-887775b8e320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:42.700048 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1677254-b7fe-4814-8a6c-887775b8e320 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:42.710255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1448/2882] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:43.083153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913285c6-1e2a-4253-ba47-853eac51a26f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:43.084892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-913285c6-1e2a-4253-ba47-853eac51a26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:43.099589 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913285c6-1e2a-4253-ba47-853eac51a26f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:43.104435 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74c39b-8776-4ebc-a3cf-ae7c67533e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:43.105314 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74c39b-8776-4ebc-a3cf-ae7c67533e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:43.105595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74c39b-8776-4ebc-a3cf-ae7c67533e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:43.105867 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74c39b-8776-4ebc-a3cf-ae7c67533e6b admin admin] PATH_INFO: `/v3/projects/d0316ca2ae764ec5acf818f00e2fe685` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:43.107837 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74c39b-8776-4ebc-a3cf-ae7c67533e6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0316ca2ae764ec5acf818f00e2fe685)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:43.110420 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74c39b-8776-4ebc-a3cf-ae7c67533e6b admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:43.161901 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1f74c39b-8776-4ebc-a3cf-ae7c67533e6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0316ca2ae764ec5acf818f00e2fe685', 'request_id': 'req-1f74c39b-8776-4ebc-a3cf-ae7c67533e6b'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:43.164521 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:43.170718 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1f74c39b-8776-4ebc-a3cf-ae7c67533e6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0316ca2ae764ec5acf818f00e2fe685', 'request_id': 'req-1f74c39b-8776-4ebc-a3cf-ae7c67533e6b'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:43.178959 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1f74c39b-8776-4ebc-a3cf-ae7c67533e6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0316ca2ae764ec5acf818f00e2fe685', 'request_id': 'req-1f74c39b-8776-4ebc-a3cf-ae7c67533e6b'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:43.192664 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1f74c39b-8776-4ebc-a3cf-ae7c67533e6b admin admin] The token cache is being invalidate because project d0316ca2ae764ec5acf818f00e2fe685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:32:43.192878 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1f74c39b-8776-4ebc-a3cf-ae7c67533e6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:43.193528 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-1f74c39b-8776-4ebc-a3cf-ae7c67533e6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:43.195624 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1435/2883] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:32:43 2022] DELETE /identity/v3/projects/d0316ca2ae764ec5acf818f00e2fe685 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:43.200783 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dce2e-98cf-41c4-85f6-066d5b63cb1c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:43.201315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dce2e-98cf-41c4-85f6-066d5b63cb1c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:43.201315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dce2e-98cf-41c4-85f6-066d5b63cb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:43.221388 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a59dce2e-98cf-41c4-85f6-066d5b63cb1c None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:43.222591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a59dce2e-98cf-41c4-85f6-066d5b63cb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:43.293278 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1449/2884] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:43.302216 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7242b-fbd1-417d-aca6-1cd3857abbc6 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:43.303104 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7242b-fbd1-417d-aca6-1cd3857abbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:43.303104 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7242b-fbd1-417d-aca6-1cd3857abbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:43.324685 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-10f7242b-fbd1-417d-aca6-1cd3857abbc6 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:43.325941 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-10f7242b-fbd1-417d-aca6-1cd3857abbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:43.334362 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1436/2885] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:32:43.338876 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59dce2e-98cf-41c4-85f6-066d5b63cb1c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:43.352597 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59dce2e-98cf-41c4-85f6-066d5b63cb1c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:43.361284 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df27ecd-7c4f-4f57-baba-0add9c741cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:43.362439 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df27ecd-7c4f-4f57-baba-0add9c741cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:43.362934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df27ecd-7c4f-4f57-baba-0add9c741cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:43.363432 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df27ecd-7c4f-4f57-baba-0add9c741cc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:43.364866 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df27ecd-7c4f-4f57-baba-0add9c741cc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:32:43.365449 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df27ecd-7c4f-4f57-baba-0add9c741cc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:43.368659 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df27ecd-7c4f-4f57-baba-0add9c741cc0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:43.391722 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1450/2886] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:32:43.396739 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7242b-fbd1-417d-aca6-1cd3857abbc6 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:43.407194 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7242b-fbd1-417d-aca6-1cd3857abbc6 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:43.412231 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92690de2-45d2-4010-a6f7-cfec4825ac55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:43.412961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92690de2-45d2-4010-a6f7-cfec4825ac55 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:43.413241 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92690de2-45d2-4010-a6f7-cfec4825ac55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:43.413511 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92690de2-45d2-4010-a6f7-cfec4825ac55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:43.414219 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92690de2-45d2-4010-a6f7-cfec4825ac55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:43.416159 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92690de2-45d2-4010-a6f7-cfec4825ac55 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:43.452822 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1437/2887] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:32:43 2022] POST /identity/v3/projects => generated 361 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:32:43.459162 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df27ecd-7c4f-4f57-baba-0add9c741cc0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:43.470574 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df27ecd-7c4f-4f57-baba-0add9c741cc0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:43.495106 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:43.542660 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5101b-e94c-4c9a-abdd-59858521f59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:43.543355 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5101b-e94c-4c9a-abdd-59858521f59b admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:43.543644 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5101b-e94c-4c9a-abdd-59858521f59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:43.543925 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5101b-e94c-4c9a-abdd-59858521f59b admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:43.544683 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5101b-e94c-4c9a-abdd-59858521f59b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:43.547225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5101b-e94c-4c9a-abdd-59858521f59b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:43.580432 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1451/2888] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:32:43 2022] POST /identity/v3/users => generated 281 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:32:43.584719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92690de2-45d2-4010-a6f7-cfec4825ac55 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:43.596910 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92690de2-45d2-4010-a6f7-cfec4825ac55 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:43.602313 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa00ad-0923-47b8-9123-523d361eef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:43.603005 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa00ad-0923-47b8-9123-523d361eef88 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:43.603288 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa00ad-0923-47b8-9123-523d361eef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:43.603560 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa00ad-0923-47b8-9123-523d361eef88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:43.604326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa00ad-0923-47b8-9123-523d361eef88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:43.605960 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa00ad-0923-47b8-9123-523d361eef88 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:43.626471 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1438/2889] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:32:43.630774 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5101b-e94c-4c9a-abdd-59858521f59b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:43.647551 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5101b-e94c-4c9a-abdd-59858521f59b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:43.652562 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7453c69-061f-44ea-ac21-293721812401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:43.653250 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7453c69-061f-44ea-ac21-293721812401 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:43.653536 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7453c69-061f-44ea-ac21-293721812401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:43.653813 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7453c69-061f-44ea-ac21-293721812401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:43.654549 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7453c69-061f-44ea-ac21-293721812401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:43.656293 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7453c69-061f-44ea-ac21-293721812401 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:43.667705 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1452/2890] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:32:43.672223 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa00ad-0923-47b8-9123-523d361eef88 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:43.683262 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa00ad-0923-47b8-9123-523d361eef88 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:43.688804 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c88c5-b504-4398-9cab-f0db5dcd85d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:43.689706 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c88c5-b504-4398-9cab-f0db5dcd85d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:43.689988 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c88c5-b504-4398-9cab-f0db5dcd85d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:43.690313 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c88c5-b504-4398-9cab-f0db5dcd85d2 admin admin] PATH_INFO: `/v3/projects/4f411dd4553242029f2ba8b4f450bb84/users/9d6a1347649c4f81805791a0d92ea53a/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:43.706541 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c88c5-b504-4398-9cab-f0db5dcd85d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f411dd4553242029f2ba8b4f450bb84, user_id=9d6a1347649c4f81805791a0d92ea53a, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:43.709164 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c88c5-b504-4398-9cab-f0db5dcd85d2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:43.723596 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1439/2891] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:32:43 2022] PUT /identity/v3/projects/4f411dd4553242029f2ba8b4f450bb84/users/9d6a1347649c4f81805791a0d92ea53a/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:32:43.738166 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cbe4d-5181-41a7-afd9-c1daad2d3cdc None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:43.738637 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cbe4d-5181-41a7-afd9-c1daad2d3cdc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:43.739051 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cbe4d-5181-41a7-afd9-c1daad2d3cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:43.774751 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-773cbe4d-5181-41a7-afd9-c1daad2d3cdc None None] MFA Rules not processed for user `9d6a1347649c4f81805791a0d92ea53a`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:43.775993 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-773cbe4d-5181-41a7-afd9-c1daad2d3cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:43.852299 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1453/2892] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:43.896912 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c88c5-b504-4398-9cab-f0db5dcd85d2 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:43.898779 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-083c88c5-b504-4398-9cab-f0db5dcd85d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:43.967925 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c88c5-b504-4398-9cab-f0db5dcd85d2 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:43.971623 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2720c5-16bf-4905-9c8f-5db9c147a788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:43.972316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2720c5-16bf-4905-9c8f-5db9c147a788 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:43.972604 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2720c5-16bf-4905-9c8f-5db9c147a788 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:43.972882 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2720c5-16bf-4905-9c8f-5db9c147a788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:43.984868 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2720c5-16bf-4905-9c8f-5db9c147a788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:43.987778 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2720c5-16bf-4905-9c8f-5db9c147a788 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:44.004951 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1440/2893] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:44.020524 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cbe4d-5181-41a7-afd9-c1daad2d3cdc None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:44.090715 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cbe4d-5181-41a7-afd9-c1daad2d3cdc None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:44.095438 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3e25a-6a9a-4847-9eac-3be71eba6dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:44.096403 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3e25a-6a9a-4847-9eac-3be71eba6dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:44.096690 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3e25a-6a9a-4847-9eac-3be71eba6dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:44.096966 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3e25a-6a9a-4847-9eac-3be71eba6dbd admin admin] PATH_INFO: `/v3/users/9d6a1347649c4f81805791a0d92ea53a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:44.098255 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3e25a-6a9a-4847-9eac-3be71eba6dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6a1347649c4f81805791a0d92ea53a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:44.100362 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3e25a-6a9a-4847-9eac-3be71eba6dbd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:44.144987 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:44.161829 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7fe3e25a-6a9a-4847-9eac-3be71eba6dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6a1347649c4f81805791a0d92ea53a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:44.162899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7fe3e25a-6a9a-4847-9eac-3be71eba6dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6a1347649c4f81805791a0d92ea53a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:44.163579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7fe3e25a-6a9a-4847-9eac-3be71eba6dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6a1347649c4f81805791a0d92ea53a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:44.171303 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7fe3e25a-6a9a-4847-9eac-3be71eba6dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6a1347649c4f81805791a0d92ea53a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:44.181493 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7fe3e25a-6a9a-4847-9eac-3be71eba6dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6a1347649c4f81805791a0d92ea53a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:44.210453 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1454/2894] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:32:44 2022] DELETE /identity/v3/users/9d6a1347649c4f81805791a0d92ea53a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:44.216203 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373352-dc08-4fc7-8762-c0a70bd4ccac None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:44.216843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373352-dc08-4fc7-8762-c0a70bd4ccac None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:44.217378 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4373352-dc08-4fc7-8762-c0a70bd4ccac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:44.241338 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-c4373352-dc08-4fc7-8762-c0a70bd4ccac None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:44.242599 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c4373352-dc08-4fc7-8762-c0a70bd4ccac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:44.307467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1441/2895] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:44.317975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3e25a-6a9a-4847-9eac-3be71eba6dbd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:44.319454 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7fe3e25a-6a9a-4847-9eac-3be71eba6dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:44.380237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3e25a-6a9a-4847-9eac-3be71eba6dbd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:44.384523 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a6edd-1c04-4210-a6e9-fb9462ccb1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:44.385224 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a6edd-1c04-4210-a6e9-fb9462ccb1ef service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:44.385538 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a6edd-1c04-4210-a6e9-fb9462ccb1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:44.385851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a6edd-1c04-4210-a6e9-fb9462ccb1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:44.396004 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a6edd-1c04-4210-a6e9-fb9462ccb1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:44.397491 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a6edd-1c04-4210-a6e9-fb9462ccb1ef service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:44.408101 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1455/2896] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:44.686446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4373352-dc08-4fc7-8762-c0a70bd4ccac None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:44.687914 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-c4373352-dc08-4fc7-8762-c0a70bd4ccac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:44.701614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4373352-dc08-4fc7-8762-c0a70bd4ccac None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:44.706854 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c972b80-6d69-4be5-86ce-d9ead0a03743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:44.707734 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c972b80-6d69-4be5-86ce-d9ead0a03743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:44.708018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c972b80-6d69-4be5-86ce-d9ead0a03743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:44.708332 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c972b80-6d69-4be5-86ce-d9ead0a03743 admin admin] PATH_INFO: `/v3/projects/4f411dd4553242029f2ba8b4f450bb84` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:44.709555 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c972b80-6d69-4be5-86ce-d9ead0a03743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f411dd4553242029f2ba8b4f450bb84)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:44.712160 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c972b80-6d69-4be5-86ce-d9ead0a03743 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:44.735318 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:44.771092 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7c972b80-6d69-4be5-86ce-d9ead0a03743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f411dd4553242029f2ba8b4f450bb84', 'request_id': 'req-7c972b80-6d69-4be5-86ce-d9ead0a03743'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:44.778722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7c972b80-6d69-4be5-86ce-d9ead0a03743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f411dd4553242029f2ba8b4f450bb84', 'request_id': 'req-7c972b80-6d69-4be5-86ce-d9ead0a03743'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:44.786181 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7c972b80-6d69-4be5-86ce-d9ead0a03743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f411dd4553242029f2ba8b4f450bb84', 'request_id': 'req-7c972b80-6d69-4be5-86ce-d9ead0a03743'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:44.796680 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7c972b80-6d69-4be5-86ce-d9ead0a03743 admin admin] The token cache is being invalidate because project 4f411dd4553242029f2ba8b4f450bb84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:32:44.796977 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7c972b80-6d69-4be5-86ce-d9ead0a03743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:44.797633 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-7c972b80-6d69-4be5-86ce-d9ead0a03743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:44.799187 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1442/2897] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:32:44 2022] DELETE /identity/v3/projects/4f411dd4553242029f2ba8b4f450bb84 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:44.804189 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7ab16-cb7e-4bd9-8382-cc631c5dc010 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:44.804632 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7ab16-cb7e-4bd9-8382-cc631c5dc010 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:44.804975 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7ab16-cb7e-4bd9-8382-cc631c5dc010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:44.824613 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9ea7ab16-cb7e-4bd9-8382-cc631c5dc010 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:44.825871 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9ea7ab16-cb7e-4bd9-8382-cc631c5dc010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:44.890972 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1456/2898] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:44.899124 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed328c98-2160-4424-a5f7-ddd6de4940b2 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:44.899446 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed328c98-2160-4424-a5f7-ddd6de4940b2 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:44.899761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed328c98-2160-4424-a5f7-ddd6de4940b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:44.920196 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-ed328c98-2160-4424-a5f7-ddd6de4940b2 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:44.921482 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-ed328c98-2160-4424-a5f7-ddd6de4940b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:44.931033 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1443/2899] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:44.940593 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7ab16-cb7e-4bd9-8382-cc631c5dc010 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:44.955271 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7ab16-cb7e-4bd9-8382-cc631c5dc010 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:44.960169 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdf415-47ae-43de-8c1e-24bc95c2290d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:44.960903 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdf415-47ae-43de-8c1e-24bc95c2290d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:44.961241 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdf415-47ae-43de-8c1e-24bc95c2290d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:44.961524 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdf415-47ae-43de-8c1e-24bc95c2290d admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:44.962326 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdf415-47ae-43de-8c1e-24bc95c2290d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:32:44.962733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdf415-47ae-43de-8c1e-24bc95c2290d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:44.964422 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdf415-47ae-43de-8c1e-24bc95c2290d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:44.977913 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1457/2900] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:32:44.982615 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed328c98-2160-4424-a5f7-ddd6de4940b2 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:44.992379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed328c98-2160-4424-a5f7-ddd6de4940b2 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:44.996884 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484cfb8-20bb-4c89-8ec9-cd1cc8f88d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:44.997574 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484cfb8-20bb-4c89-8ec9-cd1cc8f88d93 admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:44.997854 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484cfb8-20bb-4c89-8ec9-cd1cc8f88d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:44.998125 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484cfb8-20bb-4c89-8ec9-cd1cc8f88d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:44.998812 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484cfb8-20bb-4c89-8ec9-cd1cc8f88d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:45.001258 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484cfb8-20bb-4c89-8ec9-cd1cc8f88d93 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:45.029764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1444/2901] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:32:44 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:32:45.033873 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdf415-47ae-43de-8c1e-24bc95c2290d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:45.044489 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdf415-47ae-43de-8c1e-24bc95c2290d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:45.085709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:45.111829 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d484b-d05e-453d-a79a-20807c78e4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:45.112617 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d484b-d05e-453d-a79a-20807c78e4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:45.112955 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d484b-d05e-453d-a79a-20807c78e4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:45.113261 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d484b-d05e-453d-a79a-20807c78e4a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:45.114197 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d484b-d05e-453d-a79a-20807c78e4a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:45.116480 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d484b-d05e-453d-a79a-20807c78e4a3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:45.144633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1458/2902] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:32:45 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:32:45.146270 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484cfb8-20bb-4c89-8ec9-cd1cc8f88d93 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:45.159352 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484cfb8-20bb-4c89-8ec9-cd1cc8f88d93 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:45.165467 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089af01-9a0c-4dc8-a73d-dd4d16924b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:45.166246 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089af01-9a0c-4dc8-a73d-dd4d16924b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:45.167183 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089af01-9a0c-4dc8-a73d-dd4d16924b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:45.167183 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089af01-9a0c-4dc8-a73d-dd4d16924b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:45.167737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089af01-9a0c-4dc8-a73d-dd4d16924b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:45.169525 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089af01-9a0c-4dc8-a73d-dd4d16924b23 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:45.187037 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1445/2903] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:32:45.188923 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d484b-d05e-453d-a79a-20807c78e4a3 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:45.206733 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d484b-d05e-453d-a79a-20807c78e4a3 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:45.216168 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617c793-0e6d-4f53-b309-8ff6a25903dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:45.217225 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617c793-0e6d-4f53-b309-8ff6a25903dc admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:45.217382 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617c793-0e6d-4f53-b309-8ff6a25903dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:45.217650 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617c793-0e6d-4f53-b309-8ff6a25903dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:45.219079 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617c793-0e6d-4f53-b309-8ff6a25903dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:45.220963 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617c793-0e6d-4f53-b309-8ff6a25903dc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:45.244879 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089af01-9a0c-4dc8-a73d-dd4d16924b23 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:45.251074 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1459/2904] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:32:45.256746 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089af01-9a0c-4dc8-a73d-dd4d16924b23 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:45.262481 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f676983-3396-4a76-a0d4-1d31a9fa2af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:45.264561 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f676983-3396-4a76-a0d4-1d31a9fa2af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:45.264953 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f676983-3396-4a76-a0d4-1d31a9fa2af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:45.265966 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f676983-3396-4a76-a0d4-1d31a9fa2af2 admin admin] PATH_INFO: `/v3/projects/a689e128bbd446ac98a956a13b456ef1/users/7df16ebe1c4740a4a88f032455e4622c/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:45.287387 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f676983-3396-4a76-a0d4-1d31a9fa2af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a689e128bbd446ac98a956a13b456ef1, user_id=7df16ebe1c4740a4a88f032455e4622c, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:45.290648 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f676983-3396-4a76-a0d4-1d31a9fa2af2 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:45.313165 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1446/2905] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:32:45 2022] PUT /identity/v3/projects/a689e128bbd446ac98a956a13b456ef1/users/7df16ebe1c4740a4a88f032455e4622c/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:45.325317 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ccd57-4b47-4a31-afee-cf93e8538149 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:45.325712 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ccd57-4b47-4a31-afee-cf93e8538149 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:45.326149 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ccd57-4b47-4a31-afee-cf93e8538149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:45.363359 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f00ccd57-4b47-4a31-afee-cf93e8538149 None None] MFA Rules not processed for user `7df16ebe1c4740a4a88f032455e4622c`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:45.364127 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f00ccd57-4b47-4a31-afee-cf93e8538149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:45.443886 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1460/2906] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:32:45.455211 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f676983-3396-4a76-a0d4-1d31a9fa2af2 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:45.456988 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-4f676983-3396-4a76-a0d4-1d31a9fa2af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:45.525207 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f676983-3396-4a76-a0d4-1d31a9fa2af2 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:45.532113 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ef64b-1f2d-49d0-89a9-0b60d6c0349c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:45.532803 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ef64b-1f2d-49d0-89a9-0b60d6c0349c service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:45.533084 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ef64b-1f2d-49d0-89a9-0b60d6c0349c service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:45.533355 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ef64b-1f2d-49d0-89a9-0b60d6c0349c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:45.542977 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ef64b-1f2d-49d0-89a9-0b60d6c0349c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:45.544594 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ef64b-1f2d-49d0-89a9-0b60d6c0349c service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:45.554537 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1447/2907] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:48.615237 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ccd57-4b47-4a31-afee-cf93e8538149 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:48.678043 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ccd57-4b47-4a31-afee-cf93e8538149 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:48.682558 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb580e7-772a-4e47-973a-08d7582dad60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:48.683426 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb580e7-772a-4e47-973a-08d7582dad60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:48.683711 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb580e7-772a-4e47-973a-08d7582dad60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:48.683990 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb580e7-772a-4e47-973a-08d7582dad60 admin admin] PATH_INFO: `/v3/users/7df16ebe1c4740a4a88f032455e4622c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:48.685208 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb580e7-772a-4e47-973a-08d7582dad60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7df16ebe1c4740a4a88f032455e4622c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:48.687105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb580e7-772a-4e47-973a-08d7582dad60 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:48.732769 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-deb580e7-772a-4e47-973a-08d7582dad60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7df16ebe1c4740a4a88f032455e4622c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:48.733700 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-deb580e7-772a-4e47-973a-08d7582dad60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7df16ebe1c4740a4a88f032455e4622c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:48.735177 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-deb580e7-772a-4e47-973a-08d7582dad60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7df16ebe1c4740a4a88f032455e4622c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:48.738368 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:48.746184 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-deb580e7-772a-4e47-973a-08d7582dad60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7df16ebe1c4740a4a88f032455e4622c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:48.754934 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-deb580e7-772a-4e47-973a-08d7582dad60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7df16ebe1c4740a4a88f032455e4622c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:48.772693 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1461/2908] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:32:48 2022] DELETE /identity/v3/users/7df16ebe1c4740a4a88f032455e4622c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:32:48.777377 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49780a38-6723-4a6b-ba86-e48fe6605803 None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:48.777843 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49780a38-6723-4a6b-ba86-e48fe6605803 None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:48.777963 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49780a38-6723-4a6b-ba86-e48fe6605803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:48.799922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-49780a38-6723-4a6b-ba86-e48fe6605803 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:32:48.801288 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-49780a38-6723-4a6b-ba86-e48fe6605803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:48.838173 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:48.861676 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1448/2909] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 16:32:48.871579 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb580e7-772a-4e47-973a-08d7582dad60 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:48.873000 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-deb580e7-772a-4e47-973a-08d7582dad60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:48.930059 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb580e7-772a-4e47-973a-08d7582dad60 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:48.933708 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b5acd-56cf-4f3f-92b2-f61f82b095ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:48.934347 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b5acd-56cf-4f3f-92b2-f61f82b095ec service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:48.934629 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b5acd-56cf-4f3f-92b2-f61f82b095ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:48.934905 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b5acd-56cf-4f3f-92b2-f61f82b095ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:48.943743 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b5acd-56cf-4f3f-92b2-f61f82b095ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:48.945182 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b5acd-56cf-4f3f-92b2-f61f82b095ec service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:48.954918 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1462/2910] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:32:49.271866 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49780a38-6723-4a6b-ba86-e48fe6605803 None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:32:49.274278 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-49780a38-6723-4a6b-ba86-e48fe6605803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:32:49.298080 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49780a38-6723-4a6b-ba86-e48fe6605803 None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:32:49.305947 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:32:49.307280 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:32:49.307737 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:32:49.308177 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d admin admin] PATH_INFO: `/v3/projects/a689e128bbd446ac98a956a13b456ef1` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:32:49.309871 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a689e128bbd446ac98a956a13b456ef1)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:32:49.313493 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:32:49.404722 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a689e128bbd446ac98a956a13b456ef1', 'request_id': 'req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:49.414630 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a689e128bbd446ac98a956a13b456ef1', 'request_id': 'req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:49.423961 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a689e128bbd446ac98a956a13b456ef1', 'request_id': 'req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:49.436962 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d admin admin] The token cache is being invalidate because project a689e128bbd446ac98a956a13b456ef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:32:49.437261 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:49.438148 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:32:49.440370 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1449/2911] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:32:49 2022] DELETE /identity/v3/projects/a689e128bbd446ac98a956a13b456ef1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:32:58.951085 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=37,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:59.433277 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=35,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:06.462018 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b5acd-56cf-4f3f-92b2-f61f82b095ec service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:33:06.463557 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-615b5acd-56cf-4f3f-92b2-f61f82b095ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:33:06.478272 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b5acd-56cf-4f3f-92b2-f61f82b095ec service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:33:06.535371 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d9b6a-f3d9-43e1-991f-7375e2101a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:33:06.536566 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d9b6a-f3d9-43e1-991f-7375e2101a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:33:06.536851 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d9b6a-f3d9-43e1-991f-7375e2101a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:33:06.537126 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d9b6a-f3d9-43e1-991f-7375e2101a4e admin admin] PATH_INFO: `/v3/users/71ba8cc4f00946feb7457eac3c61e044` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:33:06.538321 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d9b6a-f3d9-43e1-991f-7375e2101a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ba8cc4f00946feb7457eac3c61e044)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:33:06.540238 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d9b6a-f3d9-43e1-991f-7375e2101a4e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:33:06.586126 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-235d9b6a-f3d9-43e1-991f-7375e2101a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ba8cc4f00946feb7457eac3c61e044'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:06.586765 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-235d9b6a-f3d9-43e1-991f-7375e2101a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ba8cc4f00946feb7457eac3c61e044'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:06.587428 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-235d9b6a-f3d9-43e1-991f-7375e2101a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ba8cc4f00946feb7457eac3c61e044'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:06.594968 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-235d9b6a-f3d9-43e1-991f-7375e2101a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ba8cc4f00946feb7457eac3c61e044'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:06.602349 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-235d9b6a-f3d9-43e1-991f-7375e2101a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ba8cc4f00946feb7457eac3c61e044'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:06.618974 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1463/2912] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:33:06 2022] DELETE /identity/v3/users/71ba8cc4f00946feb7457eac3c61e044 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:33:06.797647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:33:06.799120 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:33:06.812084 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39683f75-53d2-4a46-a87f-7cc0af3e2c6d admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:33:06.869248 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace87ef-e92e-430e-ae6c-55ef9dcedb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:33:06.870033 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace87ef-e92e-430e-ae6c-55ef9dcedb17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:33:06.870316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace87ef-e92e-430e-ae6c-55ef9dcedb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:33:06.870590 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace87ef-e92e-430e-ae6c-55ef9dcedb17 admin admin] PATH_INFO: `/v3/projects/ff63dce8c9324a68ad9b8b46523b7b82` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:33:06.871761 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace87ef-e92e-430e-ae6c-55ef9dcedb17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff63dce8c9324a68ad9b8b46523b7b82)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:33:06.873704 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace87ef-e92e-430e-ae6c-55ef9dcedb17 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:33:06.922788 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0ace87ef-e92e-430e-ae6c-55ef9dcedb17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff63dce8c9324a68ad9b8b46523b7b82', 'request_id': 'req-0ace87ef-e92e-430e-ae6c-55ef9dcedb17'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:06.929842 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0ace87ef-e92e-430e-ae6c-55ef9dcedb17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff63dce8c9324a68ad9b8b46523b7b82', 'request_id': 'req-0ace87ef-e92e-430e-ae6c-55ef9dcedb17'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:06.935996 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0ace87ef-e92e-430e-ae6c-55ef9dcedb17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff63dce8c9324a68ad9b8b46523b7b82', 'request_id': 'req-0ace87ef-e92e-430e-ae6c-55ef9dcedb17'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:06.947256 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0ace87ef-e92e-430e-ae6c-55ef9dcedb17 admin admin] The token cache is being invalidate because project ff63dce8c9324a68ad9b8b46523b7b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:33:06.947539 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0ace87ef-e92e-430e-ae6c-55ef9dcedb17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:06.948288 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-0ace87ef-e92e-430e-ae6c-55ef9dcedb17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:06.949888 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1450/2913] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:33:06 2022] DELETE /identity/v3/projects/ff63dce8c9324a68ad9b8b46523b7b82 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:33:06.955429 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77a049-6592-408f-abee-0ae48c0bd467 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:33:06.955724 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77a049-6592-408f-abee-0ae48c0bd467 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:33:06.956005 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77a049-6592-408f-abee-0ae48c0bd467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:33:06.975150 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ac77a049-6592-408f-abee-0ae48c0bd467 None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:33:06.976384 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ac77a049-6592-408f-abee-0ae48c0bd467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:33:07.035155 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1464/2914] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:33:07.044316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84773916-33ba-4d72-8880-1749eb18845e None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:33:07.044661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84773916-33ba-4d72-8880-1749eb18845e None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:33:07.044880 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84773916-33ba-4d72-8880-1749eb18845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:33:07.065506 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-84773916-33ba-4d72-8880-1749eb18845e None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:33:07.066719 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-84773916-33ba-4d72-8880-1749eb18845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:33:07.074595 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1451/2915] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:33:07.078899 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77a049-6592-408f-abee-0ae48c0bd467 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:33:07.088719 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77a049-6592-408f-abee-0ae48c0bd467 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:33:07.093175 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84e076-e7b4-4dc7-aec5-b4f69265a3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:33:07.093822 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84e076-e7b4-4dc7-aec5-b4f69265a3ab admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:33:07.094104 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84e076-e7b4-4dc7-aec5-b4f69265a3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:33:07.094380 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84e076-e7b4-4dc7-aec5-b4f69265a3ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:33:07.095096 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84e076-e7b4-4dc7-aec5-b4f69265a3ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 16:33:07.095406 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84e076-e7b4-4dc7-aec5-b4f69265a3ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:33:07.097036 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84e076-e7b4-4dc7-aec5-b4f69265a3ab admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:33:07.109336 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1465/2916] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Jul 25 16:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 16:33:07.114005 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84773916-33ba-4d72-8880-1749eb18845e None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:33:07.123690 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84773916-33ba-4d72-8880-1749eb18845e None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:33:07.128363 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad965f-203b-4a43-b3f8-d9d51969a18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:33:07.129018 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad965f-203b-4a43-b3f8-d9d51969a18f admin admin] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:33:07.129300 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad965f-203b-4a43-b3f8-d9d51969a18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:33:07.129575 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad965f-203b-4a43-b3f8-d9d51969a18f admin admin] PATH_INFO: `/v3/projects` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:33:07.130251 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad965f-203b-4a43-b3f8-d9d51969a18f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:33:07.132153 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad965f-203b-4a43-b3f8-d9d51969a18f admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:33:07.159373 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1452/2917] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Jul 25 16:33:07 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 16:33:07.163870 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84e076-e7b4-4dc7-aec5-b4f69265a3ab admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:33:07.173803 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84e076-e7b4-4dc7-aec5-b4f69265a3ab admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:33:07.177311 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:07.232247 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818eb61-83f8-418e-bbab-4545a5760c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:33:07.232963 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818eb61-83f8-418e-bbab-4545a5760c10 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:33:07.233253 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818eb61-83f8-418e-bbab-4545a5760c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:33:07.233527 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818eb61-83f8-418e-bbab-4545a5760c10 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:33:07.234232 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818eb61-83f8-418e-bbab-4545a5760c10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:33:07.236164 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818eb61-83f8-418e-bbab-4545a5760c10 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:33:07.258066 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1466/2918] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Jul 25 16:33:07 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 16:33:07.262176 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad965f-203b-4a43-b3f8-d9d51969a18f admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:33:07.272956 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad965f-203b-4a43-b3f8-d9d51969a18f admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:33:07.277552 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233117f-3d28-42f2-a69e-89c058b4c195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:33:07.278208 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233117f-3d28-42f2-a69e-89c058b4c195 admin admin] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:33:07.278492 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233117f-3d28-42f2-a69e-89c058b4c195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:33:07.278768 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233117f-3d28-42f2-a69e-89c058b4c195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:33:07.279485 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233117f-3d28-42f2-a69e-89c058b4c195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:33:07.281175 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233117f-3d28-42f2-a69e-89c058b4c195 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:33:07.291316 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1453/2919] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:33:07.295124 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818eb61-83f8-418e-bbab-4545a5760c10 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:33:07.305659 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818eb61-83f8-418e-bbab-4545a5760c10 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:33:07.310263 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e63d4-6228-497b-b84f-bf62b1404049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:33:07.310926 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e63d4-6228-497b-b84f-bf62b1404049 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:33:07.311214 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e63d4-6228-497b-b84f-bf62b1404049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:33:07.311540 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e63d4-6228-497b-b84f-bf62b1404049 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:33:07.312315 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e63d4-6228-497b-b84f-bf62b1404049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:33:07.313916 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e63d4-6228-497b-b84f-bf62b1404049 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:33:07.324450 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1467/2920] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Jul 25 16:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 16:33:07.329326 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233117f-3d28-42f2-a69e-89c058b4c195 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:33:07.339362 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233117f-3d28-42f2-a69e-89c058b4c195 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:33:07.344641 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b72f2-f344-4a23-b23d-1ee246dbd0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:33:07.345519 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b72f2-f344-4a23-b23d-1ee246dbd0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:33:07.345799 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b72f2-f344-4a23-b23d-1ee246dbd0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:33:07.346074 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b72f2-f344-4a23-b23d-1ee246dbd0b0 admin admin] PATH_INFO: `/v3/projects/d2bb6e44b0664a7791de6e4b3dbf5b36/users/ec63c69e6ff340818a6d045a178011d0/roles/6a0b49157bc649ef99e870c62ee6f4fe` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:33:07.360450 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b72f2-f344-4a23-b23d-1ee246dbd0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2bb6e44b0664a7791de6e4b3dbf5b36, user_id=ec63c69e6ff340818a6d045a178011d0, role_id=6a0b49157bc649ef99e870c62ee6f4fe)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:33:07.363091 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b72f2-f344-4a23-b23d-1ee246dbd0b0 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:33:07.376286 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1454/2921] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Jul 25 16:33:07 2022] PUT /identity/v3/projects/d2bb6e44b0664a7791de6e4b3dbf5b36/users/ec63c69e6ff340818a6d045a178011d0/roles/6a0b49157bc649ef99e870c62ee6f4fe => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 16:33:07.386009 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afd488-dd88-4a99-a8cf-f8012d61ac73 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:33:07.386312 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afd488-dd88-4a99-a8cf-f8012d61ac73 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:33:07.386591 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afd488-dd88-4a99-a8cf-f8012d61ac73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:33:07.418124 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-41afd488-dd88-4a99-a8cf-f8012d61ac73 None None] MFA Rules not processed for user `ec63c69e6ff340818a6d045a178011d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:33:07.419361 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-41afd488-dd88-4a99-a8cf-f8012d61ac73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:33:07.483073 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1468/2922] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:33:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:33:07.494045 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b72f2-f344-4a23-b23d-1ee246dbd0b0 admin admin] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:33:07.495777 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-1b3b72f2-f344-4a23-b23d-1ee246dbd0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:33:07.526786 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:07.555712 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b72f2-f344-4a23-b23d-1ee246dbd0b0 admin admin] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:33:07.559374 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4289c-73c7-4695-8a97-78666acb6a61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b419d3dba854407f97f16fac79910d25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:33:07.560017 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4289c-73c7-4695-8a97-78666acb6a61 service cinder] REQUEST_METHOD: `GET` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:33:07.560329 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4289c-73c7-4695-8a97-78666acb6a61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:33:07.560610 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4289c-73c7-4695-8a97-78666acb6a61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:33:07.569526 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4289c-73c7-4695-8a97-78666acb6a61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:33:07.570909 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4289c-73c7-4695-8a97-78666acb6a61 service cinder] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:33:07.580647 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1455/2923] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:33:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:33:17.480091 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:17.575764 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=14 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:17.639115 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afd488-dd88-4a99-a8cf-f8012d61ac73 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:33:17.702317 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afd488-dd88-4a99-a8cf-f8012d61ac73 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:33:17.706806 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544dc23-89b4-45ef-85b9-b2a698e41bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:33:17.707674 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544dc23-89b4-45ef-85b9-b2a698e41bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:33:17.707946 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544dc23-89b4-45ef-85b9-b2a698e41bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:33:17.708220 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544dc23-89b4-45ef-85b9-b2a698e41bee admin admin] PATH_INFO: `/v3/users/ec63c69e6ff340818a6d045a178011d0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:33:17.709408 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544dc23-89b4-45ef-85b9-b2a698e41bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec63c69e6ff340818a6d045a178011d0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:33:17.711310 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544dc23-89b4-45ef-85b9-b2a698e41bee admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:33:17.765296 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d544dc23-89b4-45ef-85b9-b2a698e41bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec63c69e6ff340818a6d045a178011d0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:17.765964 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d544dc23-89b4-45ef-85b9-b2a698e41bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec63c69e6ff340818a6d045a178011d0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:17.766572 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d544dc23-89b4-45ef-85b9-b2a698e41bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec63c69e6ff340818a6d045a178011d0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:17.776286 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d544dc23-89b4-45ef-85b9-b2a698e41bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec63c69e6ff340818a6d045a178011d0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:17.785136 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d544dc23-89b4-45ef-85b9-b2a698e41bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec63c69e6ff340818a6d045a178011d0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:17.804014 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1469/2924] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Jul 25 16:33:17 2022] DELETE /identity/v3/users/ec63c69e6ff340818a6d045a178011d0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:33:17.808620 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d12235-a3c2-421a-83f0-bf773cf0f88f None None] REQUEST_METHOD: `POST` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:33:17.808892 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d12235-a3c2-421a-83f0-bf773cf0f88f None None] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:33:17.809174 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d12235-a3c2-421a-83f0-bf773cf0f88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:33:17.828683 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.auth.core [None req-08d12235-a3c2-421a-83f0-bf773cf0f88f None None] MFA Rules not processed for user `39c896452be844fc919b8104a7db12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80366) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 16:33:17.830027 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-08d12235-a3c2-421a-83f0-bf773cf0f88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:33:17.889213 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1456/2925] 10.222.0.70 () {58 vars in 958 bytes} [Mon Jul 25 16:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 16:33:17.899608 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544dc23-89b4-45ef-85b9-b2a698e41bee admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:33:17.901030 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d544dc23-89b4-45ef-85b9-b2a698e41bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:33:17.959105 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544dc23-89b4-45ef-85b9-b2a698e41bee admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:33:17.962775 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1d74c-52c0-4b8c-a88e-8f6b1b220492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad22a7d1e01c4c40b7cbefe971755148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:33:17.963415 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1d74c-52c0-4b8c-a88e-8f6b1b220492 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:33:17.963703 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1d74c-52c0-4b8c-a88e-8f6b1b220492 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:33:17.963980 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1d74c-52c0-4b8c-a88e-8f6b1b220492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:33:17.973830 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1d74c-52c0-4b8c-a88e-8f6b1b220492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:33:17.975277 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1d74c-52c0-4b8c-a88e-8f6b1b220492 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:33:17.985395 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1470/2926] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:33:18.275053 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d12235-a3c2-421a-83f0-bf773cf0f88f None None] Authenticating user token {{(pid=80366) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:33:18.276566 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.fernet_utils [None req-08d12235-a3c2-421a-83f0-bf773cf0f88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80366) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:33:18.290872 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d12235-a3c2-421a-83f0-bf773cf0f88f None None] Validating token access rules against request {{(pid=80366) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:33:18.296502 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e8cb9-be96-4da2-8b62-0a0694f8be03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c896452be844fc919b8104a7db12a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b95a5c35a0f44e44aca71af300d042a5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80366) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:33:18.297379 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e8cb9-be96-4da2-8b62-0a0694f8be03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:33:18.297661 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e8cb9-be96-4da2-8b62-0a0694f8be03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:33:18.297935 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e8cb9-be96-4da2-8b62-0a0694f8be03 admin admin] PATH_INFO: `/v3/projects/d2bb6e44b0664a7791de6e4b3dbf5b36` {{(pid=80366) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:33:18.299209 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e8cb9-be96-4da2-8b62-0a0694f8be03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2bb6e44b0664a7791de6e4b3dbf5b36)` {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:33:18.301148 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e8cb9-be96-4da2-8b62-0a0694f8be03 admin admin] RBAC: Authorization granted {{(pid=80366) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:33:18.349747 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-617e8cb9-be96-4da2-8b62-0a0694f8be03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2bb6e44b0664a7791de6e4b3dbf5b36', 'request_id': 'req-617e8cb9-be96-4da2-8b62-0a0694f8be03'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:18.357614 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-617e8cb9-be96-4da2-8b62-0a0694f8be03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2bb6e44b0664a7791de6e4b3dbf5b36', 'request_id': 'req-617e8cb9-be96-4da2-8b62-0a0694f8be03'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:18.364495 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-617e8cb9-be96-4da2-8b62-0a0694f8be03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2bb6e44b0664a7791de6e4b3dbf5b36', 'request_id': 'req-617e8cb9-be96-4da2-8b62-0a0694f8be03'} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:18.375632 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-617e8cb9-be96-4da2-8b62-0a0694f8be03 admin admin] The token cache is being invalidate because project d2bb6e44b0664a7791de6e4b3dbf5b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80366) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 16:33:18.375922 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-617e8cb9-be96-4da2-8b62-0a0694f8be03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:18.376594 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG keystone.notifications [None req-617e8cb9-be96-4da2-8b62-0a0694f8be03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80366) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 16:33:18.378145 dv-cinder-836973-15-smb devstack@keystone.service[80366]: [pid: 80366|app: 0|req: 1457/2927] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Jul 25 16:33:18 2022] DELETE /identity/v3/projects/d2bb6e44b0664a7791de6e4b3dbf5b36 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 16:33:27.980814 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:28.371753 dv-cinder-836973-15-smb devstack@keystone.service[80366]: DEBUG dbcounter [-] [80366] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:03.173013 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1d74c-52c0-4b8c-a88e-8f6b1b220492 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 16:37:03.174518 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fea1d74c-52c0-4b8c-a88e-8f6b1b220492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:37:03.331633 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1d74c-52c0-4b8c-a88e-8f6b1b220492 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 16:37:03.395904 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7caac-3f50-42d2-8c9d-954cad972c49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3474e40117440498f0fe99f743df50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c9d252e2e0347029d58192fab233f09', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 16:37:03.396598 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7caac-3f50-42d2-8c9d-954cad972c49 service placement] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 16:37:03.396887 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7caac-3f50-42d2-8c9d-954cad972c49 service placement] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 16:37:03.397165 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7caac-3f50-42d2-8c9d-954cad972c49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 16:37:03.399120 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6ea7caac-3f50-42d2-8c9d-954cad972c49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 16:37:03.411203 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7caac-3f50-42d2-8c9d-954cad972c49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 16:37:03.413709 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7caac-3f50-42d2-8c9d-954cad972c49 service placement] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 16:37:03.425403 dv-cinder-836973-15-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1471/2928] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Jul 25 16:37:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 16:37:13.420039 dv-cinder-836973-15-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}